00000001:02000400:3.0F:1789263617.249047:0:3293:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg320-server.virtnet: executing set_hostid 00000001:02000400:3.0:1789263626.146164:0:3496:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg320-server.virtnet: executing load_modules_local 00000001:01000000:1.0F:1789263627.112703:0:3558:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 1391 MB/s 00000001:01000000:1.0:1789263627.362373:0:3558:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1695 MB/s 00000001:01000000:1.0:1789263627.612163:0:3558:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 10431 MB/s 00000020:02000000:2.0F:1789263627.935198:0:3587:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_103_g3c4c45f 00000400:02000000:1.0:1789263628.284356:0:3602:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.203.120@tcp [8/256/0/180] 00008000:02000000:0.0F:1789263630.564073:0:3751:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0:1789263656.157314:0:5715:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg320-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1789263661.454666:0:6464:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789263661.454672:0:6464:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1789263661.454674:0:6464:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1789263661.454859:0:6464:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000f6c6225f 00000080:02000400:1.0:1789263661.454870:0:6464:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1789263661.459064:0:6464:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1789263661.459098:0:6464:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1789263661.459131:0:6464:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000fbbf0733) 00000020:00000080:1.0:1789263661.459153:0:6464:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1789263661.478404:0:6464:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1789263661.478476:0:6464:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:1.0:1789263661.489880:0:6464:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1789263661.490157:0:6464:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1789263661.490164:0:6464:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789263661.490171:0:6464:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xce1582440fb1d426 00000020:01000004:1.0:1789263661.490176:0:6464:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1789263661.490179:0:6464:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1789263661.490182:0:6464:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000f6c6225f from MGS 00000020:01000004:1.0:1789263661.490185:0:6464:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1789263661.490192:0:6464:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000c3aff022) 00000020:00000080:1.0:1789263661.490198:0:6464:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1789263661.490246:0:6464:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000f6c6225f from MGS, refs=2 00080000:01000000:1.0:1789263661.490249:0:6464:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789263661.490252:0:6464:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xce1582440fb1d434 00000100:00100000:1.0:1789263661.490321:0:6464:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1789263661.490402:0:6464:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1789263661.490406:0:6464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1789263661.490632:0:6464:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1789263661.490639:0:6464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1789263661.491131:0:6464:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789263661.491233:0:6464:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1789263661.491236:0:6464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1789263661.491495:0:6464:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1789263661.491502:0:6464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1789263661.491851:0:6464:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1789263661.491856:0:6464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1789263661.492270:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789263661.492273:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789263661.492274:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263661.492392:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263661.492395:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263661.492397:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789263661.492780:0:6464:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1789263661.495370:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1789263661.742173:0:6464:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 6451 MB/s 00000001:01000000:2.0:1789263661.992113:0:6464:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 7931 MB/s 00000001:01000000:2.0:1789263662.242775:0:6464:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 1395 MB/s 00000001:01000000:2.0:1789263662.492500:0:6464:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 1699 MB/s 00080000:10000000:2.0:1789263662.495864:0:6464:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:2.0:1789263662.501823:0:6464:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1789263662.502300:0:6478:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1789263662.502337:0:6464:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1789263662.502416:0:6464:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1789263662.502745:0:6464:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1789263662.502775:0:6464:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1789263662.503408:0:6464:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789263662.503714:0:6464:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1789263662.503723:0:6464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1789263662.504255:0:6464:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1789263662.504269:0:6464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1789263662.504639:0:6464:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1789263662.504649:0:6464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1789263662.505538:0:6464:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1789263662.505568:0:6464:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.120@tcp' 00000020:01000004:3.0:1789263662.505571:0:6464:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1789263662.505623:0:6464:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.120@tcp (typ=mgc) 00000020:00000080:3.0:1789263662.505641:0:6464:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.120@tcp (000000005e317436) 00000020:00000080:3.0:1789263662.505659:0:6464:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1789263662.505785:0:6464:0:(ldlm_lib.c:102:import_set_conn()) imp 000000002dc1cf96@MGC192.168.203.120@tcp: add connection 192.168.203.120@tcp at head 00010000:00010000:3.0:1789263662.505957:0:6464:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.120@tcp-0 is initialized 00000040:01000000:3.0:1789263662.505963:0:6464:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.120@tcp ctxt 1 is initialized 10000000:01000000:2.0:1789263662.507413:0:6484:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1789263662.507475:0:6464:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.120@tcp (uuid 66a76ccf-c64c-4b18-8369-a2861ec3956c) 00000020:00000080:2.0:1789263662.507496:0:6464:0:(genops.c:1385:class_connect()) connect: client 66a76ccf-c64c-4b18-8369-a2861ec3956c, cookie 0xce1582440fb1d442 00000100:00080000:2.0:1789263662.507510:0:6464:0:(import.c:510:import_select_connection()) MGC192.168.203.120@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789263662.507515:0:6464:0:(import.c:624:import_select_connection()) MGC192.168.203.120@tcp: import 000000002dc1cf96 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:2.0:1789263662.507574:0:6464:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000b80e9bac x1876178897993856/t0(0) o250->MGC192.168.203.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789263662.507594:0:6464:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 66a76ccf-c64c-4b18-8369-a2861ec3956c->MGS 00000020:01000004:2.0:1789263662.507613:0:6464:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1789263662.507616:0:6464:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1789263662.507638:0:6464:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000e0ae0df1) 00000020:00000080:2.0:1789263662.507651:0:6464:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00080000:1.0:1789263662.507655:0:6483:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:1.0:1789263662.507777:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b80e9bac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:66a76ccf-c64c-4b18-8369-a2861ec3956c:3617:1876178897993856:0@lo:250: 00000100:00100000:1.0:1789263662.507902:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263662.508347:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178897993856 00000100:00100000:0.0:1789263662.508357:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178897993856 00000100:00100000:0.0:1789263662.508414:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789263662.508422:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cf027e73 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3617:x1876178897993856:12345-0@lo:250: 00010000:00080000:0.0:1789263662.508460:0:6480:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 66a76ccf-c64c-4b18-8369-a2861ec3956c@0@lo t0 exp 0000000000000000 cur 104 last 0 00000020:00000080:0.0:1789263662.508487:0:6480:0:(genops.c:1385:class_connect()) connect: client 66a76ccf-c64c-4b18-8369-a2861ec3956c, cookie 0xce1582440fb1d450 00000100:00080000:0.0:1789263662.508629:0:6480:0:(import.c:65:import_set_state_nolock()) 00000000d66e3d44 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789263662.508703:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cf027e73 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+5:3617:x1876178897993856:12345-0@lo:250: Request processed in 280us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263662.508711:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789263662.508755:0:3617:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.120@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1789263662.508766:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.120@tcp: connect to target with instance 0 00000100:00080000:0.0:1789263662.508775:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.120@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1789263662.508780:0:3617:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1789263662.508782:0:3617:0:(import.c:65:import_set_state_nolock()) 000000002dc1cf96 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1789263662.508785:0:3617:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1789263662.508788:0:3617:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1789263662.508792:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b80e9bac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:66a76ccf-c64c-4b18-8369-a2861ec3956c:3617:1876178897993856:0@lo:250: 00000100:00100000:2.0:1789263662.513748:0:6464:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789263662.513937:0:6464:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1789263662.513944:0:6464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00010000:00010000:1.0:1789263662.514008:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789263662.514752:0:6464:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1789263662.514760:0:6464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1789263662.515036:0:6464:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1789263662.515049:0:6464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1789263662.515682:0:6464:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789263662.515778:0:6464:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1789263662.515781:0:6464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1789263662.516148:0:6464:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1789263662.516156:0:6464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1789263662.536341:0:6464:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789263662.536551:0:6464:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1789263662.536557:0:6464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1789263662.537400:0:6464:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1789263662.537407:0:6464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1789263662.537901:0:6464:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789263662.538050:0:6464:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789263662.538053:0:6464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1789263662.538634:0:6464:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789263662.538640:0:6464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1789263662.539055:0:6464:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789263662.539192:0:6464:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789263662.539196:0:6464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1789263662.539505:0:6464:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789263662.539510:0:6464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1789263662.539901:0:6464:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789263662.540031:0:6464:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789263662.540036:0:6464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1789263662.540361:0:6464:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789263662.540374:0:6464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1789263662.551756:0:6464:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789263662.551953:0:6464:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789263662.551960:0:6464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1789263662.553005:0:6464:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789263662.553016:0:6464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1789263662.553787:0:6464:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789263662.553794:0:6464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1789263662.554657:0:6464:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1789263662.554681:0:6464:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1789263662.554687:0:6464:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.120@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1789263662.554778:0:6464:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.120@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789263662.554812:0:6464:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.120@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1789263662.554816:0:6464:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789263662.554821:0:6464:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789263662.554822:0:6464:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789263662.554823:0:6464:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789263662.554824:0:6464:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789263662.554826:0:6464:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789263662.554827:0:6464:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789263662.554828:0:6464:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789263662.554829:0:6464:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789263662.554830:0:6464:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789263662.554832:0:6464:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789263662.554833:0:6464:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789263662.554836:0:6464:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1789263662.554838:0:6464:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789263662.554839:0:6464:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789263662.554840:0:6464:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789263662.554841:0:6464:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789263662.554841:0:6464:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789263662.554842:0:6464:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789263662.554843:0:6464:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789263662.554844:0:6464:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789263662.554844:0:6464:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789263662.554845:0:6464:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789263662.554846:0:6464:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789263662.554846:0:6464:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789263662.554866:0:6464:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789263662.554878:0:6464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004254ae03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:6464:1876178897993984:0@lo:253: 00000100:00100000:2.0:1789263662.554948:0:6464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263662.554990:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178897993984 00000100:00100000:1.0:1789263662.554998:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178897993984 00000100:00100000:2.0:1789263662.554999:0:6464:0:(client.c:2715:ptlrpc_set_wait()) set 0000000028f2a33f going to sleep for 11 seconds 00000100:00100000:1.0:1789263662.555040:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789263662.555048:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000349e3dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+5:6464:x1876178897993984:12345-0@lo:253: 20000000:01000000:1.0:1789263662.555126:0:6482:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789263662.555130:0:6482:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1789263662.555318:0:6503:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1789263662.555341:0:6482:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1789263662.555679:0:6482:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789263662.556842:0:6504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1789263662.557136:0:6482:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789263662.557140:0:6482:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1789263662.557156:0:6482:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1789263662.557160:0:6482:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1789263662.557174:0:6482:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1789263662.557327:0:6482:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789263662.557483:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1789263662.557496:0:6482:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789263662.557515:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1789263662.557531:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1789263662.557544:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1789263662.557591:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1789263662.557598:0:6482:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1789263662.557622:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1789263662.557628:0:6482:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1789263662.557641:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1789263662.557646:0:6482:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1789263662.557658:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1789263662.557686:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1789263662.557713:0:6482:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1789263662.557718:0:6482:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1789263662.557725:0:6482:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789263662.557821:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1789263662.557831:0:6482:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1789263662.557846:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1789263662.557862:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1789263662.557877:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1789263662.557884:0:6482:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1789263662.557985:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1789263662.557995:0:6482:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1789263662.558007:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1789263662.558019:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1789263662.558031:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1789263662.558038:0:6482:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1789263662.558060:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1789263662.558066:0:6482:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1789263662.558131:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1789263662.558156:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1789263662.558215:0:6482:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1789263662.558233:0:6482:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1789263662.558239:0:6482:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1789263662.558573:0:6505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1789263662.558735:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1789263662.558754:0:6482:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.120@tcp for mdt 20000000:01000000:0.0:1789263662.558756:0:6482:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.120@tcp (null) (null) (null) 00000040:00080000:0.0:1789263662.558772:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1789263662.558786:0:6482:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1789263662.558801:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1789263662.558807:0:6482:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.120@tcp (null) (null) 00000040:00080000:0.0:1789263662.558820:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1789263662.558828:0:6482:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1789263662.558841:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1789263662.558857:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1789263662.558887:0:6482:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1789263662.558890:0:6482:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1789263662.558963:0:6482:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1789263662.559015:0:6482:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789263662.559017:0:6482:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789263662.559409:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1789263662.559559:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1789263662.559576:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1789263662.559589:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:1.0:1789263662.559609:0:6482:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789263662.559611:0:6482:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789263662.559891:0:6507:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:0.0:1789263662.560008:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1789263662.560027:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:0.0:1789263662.560041:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:0.0:1789263662.560050:0:6482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789263662.560053:0:6482:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:0.0:1789263662.560056:0:6482:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1789263662.560058:0:6482:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1789263662.560062:0:6482:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1789263662.560067:0:6482:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1789263662.560291:0:6508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:1.0:1789263662.560331:0:6482:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1789263662.566669:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:1.0:1789263662.566698:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:1.0:1789263662.566711:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:1.0:1789263662.566727:0:6482:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789263662.566745:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000d4c8d12a/0xce1582440fb1d457 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263662.566760:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d4c8d12a/0xce1582440fb1d457 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263662.566778:0:6482:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d4c8d12a/0xce1582440fb1d457 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263662.566784:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d4c8d12a/0xce1582440fb1d457 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263662.566789:0:6482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000d4c8d12a/0xce1582440fb1d457 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263662.566794:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000d4c8d12a/0xce1582440fb1d457 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263662.566803:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d4c8d12a already unused, calling callback (000000000583e00c) 00010000:00010000:1.0:1789263662.566806:0:6482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000d4c8d12a/0xce1582440fb1d457 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263662.566812:0:6482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000d4c8d12a/0xce1582440fb1d457 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263662.566838:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000d4c8d12a/0xce1582440fb1d457 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263662.566844:0:6482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000d4c8d12a/0xce1582440fb1d457 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263662.566849:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d4c8d12a/0xce1582440fb1d457 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789263662.566864:0:6482:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1789263662.571767:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000349e3dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+5:6464:x1876178897993984:12345-0@lo:253: Request processed in 16711us (16811us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263662.571784:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789263662.571806:0:6464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004254ae03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:6464:1876178897993984:0@lo:253: 10000000:01000000:2.0:1789263662.571825:0:6464:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789263662.571828:0:6464:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789263662.571830:0:6464:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789263662.571831:0:6464:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789263662.571832:0:6464:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1789263662.571833:0:6464:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789263662.571834:0:6464:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789263662.571836:0:6464:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789263662.571837:0:6464:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789263662.571844:0:6464:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789263662.571845:0:6464:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789263662.571846:0:6464:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789263662.571875:0:6464:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000f6c6225f from lustre-MDT0000 10000000:01000000:2.0:1789263662.571905:0:6464:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1789263662.571907:0:6464:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1789263662.571911:0:6464:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9dd9b7983370 10000000:01000000:2.0:1789263662.571924:0:6464:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789263662.571943:0:6464:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9dd9b7983370 from 1 10000000:01000000:2.0:1789263662.571946:0:6464:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789263662.571977:0:6464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: 000000004326b965/0xce1582440fb1d45e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263662.571987:0:6464:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: 000000004326b965/0xce1582440fb1d45e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263662.571996:0:6464:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: 000000004326b965/0xce1582440fb1d45e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263662.572012:0:6464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004254ae03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:6464:1876178897994112:0@lo:101: 00000100:00100000:2.0:1789263662.572066:0:6464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263662.572142:0:6464:0:(client.c:2715:ptlrpc_set_wait()) set 0000000022cfa6ef going to sleep for 11 seconds 00000100:00100000:0.0:1789263662.572184:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178897994112 00000100:00100000:0.0:1789263662.572191:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178897994112 00000100:00100000:0.0:1789263662.572237:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789263662.572246:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000032d823de pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+5:6464:x1876178897994112:12345-0@lo:101: 00010000:00010000:0.0:1789263662.572259:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263662.572271:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000edd439af/0xce1582440fb1d465 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1d45e expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263662.572296:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000edd439af/0xce1582440fb1d465 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1d45e expref: 6 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263662.572305:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000edd439af/0xce1582440fb1d465 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d45e expref: 6 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263662.572313:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000edd439af, rc 0) 00000100:00100000:0.0:1789263662.572347:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000032d823de pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+6:6464:x1876178897994112:12345-0@lo:101: Request processed in 104us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263662.572353:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789263662.572381:0:6464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004254ae03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:6464:1876178897994112:0@lo:101: 00010000:00010000:2.0:1789263662.572397:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: 000000004326b965/0xce1582440fb1d45e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d465 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263662.572406:0:6464:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: 000000004326b965/0xce1582440fb1d45e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1d465 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263662.572471:0:6464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004254ae03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:6464:1876178897994240:0@lo:501: 00000100:00100000:2.0:1789263662.572498:0:6464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263662.572521:0:6464:0:(client.c:2715:ptlrpc_set_wait()) set 0000000022cfa6ef going to sleep for 11 seconds 00000100:00100000:1.0:1789263662.572531:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178897994240 00000100:00100000:1.0:1789263662.572535:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178897994240 00000100:00100000:1.0:1789263662.572558:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789263662.572564:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006ce215a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+6:6464:x1876178897994240:12345-0@lo:501: 00000100:00100000:1.0:1789263662.572634:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006ce215a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+6:6464:x1876178897994240:12345-0@lo:501: Request processed in 70us (136us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789263662.572641:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789263662.572683:0:6464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004254ae03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:6464:1876178897994240:0@lo:501: 10000000:01000000:2.0:1789263662.572713:0:6464:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789263662.572728:0:6464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: 000000004326b965/0xce1582440fb1d45e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d465 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263662.572736:0:6464:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: 000000004326b965/0xce1582440fb1d45e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d465 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789263662.572742:0:6464:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9dd9896b8000 10000000:01000000:2.0:1789263662.572745:0:6464:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789263662.572748:0:6464:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9dd9896b8000 10000000:01000000:2.0:1789263662.572750:0:6464:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1789263662.572753:0:6464:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9dd9896b8000 from 1 10000000:01000000:2.0:1789263662.572754:0:6464:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1789263662.572765:0:6464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: 000000007cb506a3/0xce1582440fb1d46c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263662.572769:0:6464:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: 000000007cb506a3/0xce1582440fb1d46c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263662.572774:0:6464:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: 000000007cb506a3/0xce1582440fb1d46c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263662.572781:0:6464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004254ae03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:6464:1876178897994368:0@lo:101: 00000100:00100000:2.0:1789263662.572799:0:6464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263662.572812:0:6464:0:(client.c:2715:ptlrpc_set_wait()) set 0000000022cfa6ef going to sleep for 11 seconds 00000100:00100000:0.0:1789263662.572837:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178897994368 00000100:00100000:0.0:1789263662.572842:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178897994368 00000100:00100000:0.0:1789263662.572868:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789263662.572876:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004e785467 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+6:6464:x1876178897994368:12345-0@lo:101: 00010000:00010000:0.0:1789263662.572883:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263662.572890:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000040fc7659/0xce1582440fb1d473 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1d46c expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263662.572908:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000040fc7659/0xce1582440fb1d473 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1d46c expref: 7 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263662.572915:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000040fc7659/0xce1582440fb1d473 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d46c expref: 7 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263662.572922:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000040fc7659, rc 0) 00000100:00100000:0.0:1789263662.572954:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004e785467 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+7:6464:x1876178897994368:12345-0@lo:101: Request processed in 81us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263662.572960:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789263662.572987:0:6464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004254ae03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:6464:1876178897994368:0@lo:101: 00010000:00010000:2.0:1789263662.572997:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: 000000007cb506a3/0xce1582440fb1d46c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d473 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263662.573010:0:6464:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: 000000007cb506a3/0xce1582440fb1d46c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1d473 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789263662.573021:0:6464:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1789263662.573028:0:6464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: 000000007cb506a3/0xce1582440fb1d46c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d473 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263662.573035:0:6464:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: 000000007cb506a3/0xce1582440fb1d46c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d473 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789263662.573041:0:6464:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1789263662.573044:0:6464:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789263662.573048:0:6464:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9dd9896b8000 10000000:01000000:2.0:1789263662.573050:0:6464:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1789263662.573052:0:6464:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1789263662.573053:0:6464:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789263662.573064:0:6464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: 000000002adcd502/0xce1582440fb1d47a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263662.573070:0:6464:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: 000000002adcd502/0xce1582440fb1d47a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263662.573094:0:6464:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: 000000002adcd502/0xce1582440fb1d47a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263662.573106:0:6464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004254ae03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:6464:1876178897994496:0@lo:101: 00000100:00100000:2.0:1789263662.573131:0:6464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263662.573153:0:6464:0:(client.c:2715:ptlrpc_set_wait()) set 0000000022cfa6ef going to sleep for 11 seconds 00000100:00100000:1.0:1789263662.573169:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178897994496 00000100:00100000:1.0:1789263662.573174:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178897994496 00000100:00100000:1.0:1789263662.573201:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789263662.573209:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006455442d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+7:6464:x1876178897994496:12345-0@lo:101: 00010000:00010000:1.0:1789263662.573217:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263662.573223:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d4c8d12a/0xce1582440fb1d481 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1d47a expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263662.573249:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d4c8d12a/0xce1582440fb1d481 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1d47a expref: 8 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263662.573256:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d4c8d12a/0xce1582440fb1d481 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d47a expref: 8 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263662.573262:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d4c8d12a, rc 0) 00000100:00100000:1.0:1789263662.573296:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006455442d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+8:6464:x1876178897994496:12345-0@lo:101: Request processed in 88us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263662.573302:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789263662.573306:0:6464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004254ae03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:6464:1876178897994496:0@lo:101: 00010000:00010000:2.0:1789263662.573316:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: 000000002adcd502/0xce1582440fb1d47a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d481 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263662.573321:0:6464:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: 000000002adcd502/0xce1582440fb1d47a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1d481 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263662.573346:0:6464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004254ae03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:6464:1876178897994624:0@lo:501: 00000100:00100000:2.0:1789263662.573363:0:6464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263662.573376:0:6464:0:(client.c:2715:ptlrpc_set_wait()) set 0000000022cfa6ef going to sleep for 11 seconds 00000100:00100000:0.0:1789263662.573399:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178897994624 00000100:00100000:0.0:1789263662.573404:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178897994624 00000100:00100000:0.0:1789263662.573423:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789263662.573438:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003b3ced95 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+8:6464:x1876178897994624:12345-0@lo:501: 00000100:00100000:0.0:1789263662.573511:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003b3ced95 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+9:6464:x1876178897994624:12345-0@lo:501: Request processed in 73us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263662.573516:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789263662.573536:0:6464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004254ae03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:6464:1876178897994624:0@lo:501: 00000100:00100000:2.0:1789263662.573571:0:6464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004254ae03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:6464:1876178897994752:0@lo:503: 00000100:00100000:2.0:1789263662.573607:0:6464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263662.573627:0:6464:0:(client.c:2715:ptlrpc_set_wait()) set 0000000022cfa6ef going to sleep for 11 seconds 00000100:00100000:1.0:1789263662.573641:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178897994752 00000100:00100000:1.0:1789263662.573646:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178897994752 00000100:00100000:1.0:1789263662.573666:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789263662.573670:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002401f907 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+9:6464:x1876178897994752:12345-0@lo:503: 00000100:00100000:1.0:1789263662.573730:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002401f907 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+9:6464:x1876178897994752:12345-0@lo:503: Request processed in 58us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263662.573737:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789263662.573755:0:6464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004254ae03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:6464:1876178897994752:0@lo:503: 00000100:00100000:1.0:1789263662.574154:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c69d587b pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:6509:1876178897994880:0@lo:502: 00000100:00100000:1.0:1789263662.574186:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263662.574208:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set 00000000215f64d0 going to sleep for 11 seconds 00000100:00100000:0.0:1789263662.574219:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178897994880 00000100:00100000:0.0:1789263662.574225:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178897994880 00000100:00100000:0.0:1789263662.574248:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789263662.574254:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003c1b8446 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+9:6509:x1876178897994880:12345-0@lo:502: 00000100:00100000:0.0:1789263662.574327:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003c1b8446 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+9:6509:x1876178897994880:12345-0@lo:502: Request processed in 73us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263662.574334:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789263662.574372:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c69d587b pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:6509:1876178897994880:0@lo:502: 00000020:01000000:1.0:1789263662.574393:0:6509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789263662.574402:0:6509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789263662.574405:0:6509:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789263662.574409:0:6509:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1789263662.574411:0:6509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789263662.574441:0:6509:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000f9c6deb3) 00000020:00000080:1.0:1789263662.574460:0:6509:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1789263662.574466:0:6509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1789263662.574545:0:6509:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:1.0:1789263662.574554:0:6509:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xce1582440fb1d48f 00000020:00000080:1.0:1789263662.574785:0:6509:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1789263662.574794:0:6509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789263662.574797:0:6509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789263662.574799:0:6509:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789263662.574801:0:6509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789263662.574805:0:6509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789263662.574806:0:6509:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1789263662.574809:0:6509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789263662.574814:0:6509:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000006a280fe6) 00000020:00000080:1.0:1789263662.574823:0:6509:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1789263662.574826:0:6509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1789263662.574828:0:6509:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1789263662.574830:0:6509:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1789263662.574835:0:6509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789263662.574883:0:6509:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000f6c6225f from lustre-MDT0000, refs=3 00000020:00000080:1.0:1789263662.574901:0:6509:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (0000000013bf7523) 00000020:00000080:1.0:1789263662.574909:0:6509:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1789263662.574986:0:6509:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1789263662.574991:0:6509:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xce1582440fb1d4a4 00000020:00000080:1.0:1789263662.575104:0:6509:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1789263662.575110:0:6509:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1789263662.575115:0:6509:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xce1582440fb1d4ab 00080000:01000000:1.0:1789263662.575120:0:6509:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:1.0:1789263662.575122:0:6509:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xce1582440fb1d4b2 00080000:10000000:1.0:1789263662.575484:0:6509:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:1.0:1789263662.575615:0:6509:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1789263662.578612:0:6509:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:1.0:1789263662.617195:0:6509:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:1.0:1789263662.617420:0:6509:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:1.0:1789263662.619452:0:6509:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1789263662.619794:0:6509:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1789263662.621501:0:6509:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000968474dd) 00000020:00000080:1.0:1789263662.621523:0:6509:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1789263662.621614:0:6509:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:1.0:1789263662.621622:0:6509:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xce1582440fb1d4c0 00000020:00000080:2.0:1789263662.621973:0:6509:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1789263662.622805:0:6509:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:2.0:1789263662.624543:0:6509:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:3.0:1789263662.626180:0:6509:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:3.0:1789263662.627865:0:6509:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:3.0:1789263662.629554:0:6509:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:3.0:1789263662.630949:0:6509:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:3.0:1789263662.633221:0:6509:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xce1582440fb1d4c7 00000020:00000080:3.0:1789263662.633470:0:6509:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1789263662.633478:0:6509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789263662.633483:0:6509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789263662.633484:0:6509:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1789263662.633492:0:6509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789263662.633496:0:6509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789263662.633498:0:6509:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789263662.633500:0:6509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789263662.633502:0:6509:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789263662.633505:0:6509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789263662.633507:0:6509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789263662.633508:0:6509:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789263662.633509:0:6509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789263662.633514:0:6509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789263662.633515:0:6509:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1789263662.633527:0:6509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1789263662.633572:0:6509:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:3.0:1789263662.633630:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006d42849b pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:6509:1876178897995008:0@lo:502: 00000100:00100000:3.0:1789263662.633702:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263662.633758:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set 00000000db29d90b going to sleep for 11 seconds 00000100:00100000:1.0:1789263662.633798:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178897995008 00000100:00100000:1.0:1789263662.633805:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178897995008 00000100:00100000:1.0:1789263662.633845:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789263662.633854:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f0df06b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+9:6509:x1876178897995008:12345-0@lo:502: 00000100:00100000:1.0:1789263662.633982:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f0df06b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+9:6509:x1876178897995008:12345-0@lo:502: Request processed in 130us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263662.633993:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789263662.634021:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006d42849b pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:6509:1876178897995008:0@lo:502: 00000020:01000000:3.0:1789263662.634051:0:6509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789263662.634056:0:6509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789263662.634057:0:6509:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:3.0:1789263662.634061:0:6509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1789263662.634224:0:6464:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1789263662.634243:0:6464:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789263662.634259:0:6464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: 000000002adcd502/0xce1582440fb1d47a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d481 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263662.634269:0:6464:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: 000000002adcd502/0xce1582440fb1d47a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d481 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789263662.634277:0:6464:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9dd9896b8000 from 1 10000000:01000000:2.0:1789263662.634285:0:6464:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789263662.634308:0:6464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: 00000000cc0b4776/0xce1582440fb1d4ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263662.634313:0:6464:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: 00000000cc0b4776/0xce1582440fb1d4ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263662.634319:0:6464:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: 00000000cc0b4776/0xce1582440fb1d4ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263662.634327:0:6464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004254ae03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:6464:1876178897995136:0@lo:101: 00000100:00100000:2.0:1789263662.634352:0:6464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263662.634375:0:6464:0:(client.c:2715:ptlrpc_set_wait()) set 000000003d1565ae going to sleep for 11 seconds 00000100:00100000:0.0:1789263662.634401:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178897995136 00000100:00100000:0.0:1789263662.634406:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178897995136 00000100:00100000:0.0:1789263662.634447:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789263662.634454:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006070c2bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+9:6464:x1876178897995136:12345-0@lo:101: 00010000:00010000:0.0:1789263662.634463:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263662.634475:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000049e7aa8b/0xce1582440fb1d4d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1d4ce expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263662.634494:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000049e7aa8b/0xce1582440fb1d4d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1d4ce expref: 10 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263662.634503:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000049e7aa8b/0xce1582440fb1d4d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d4ce expref: 10 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263662.634510:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000049e7aa8b, rc 0) 00000100:00100000:0.0:1789263662.634557:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006070c2bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+10:6464:x1876178897995136:12345-0@lo:101: Request processed in 104us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263662.634564:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789263662.634599:0:6464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004254ae03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:6464:1876178897995136:0@lo:101: 00010000:00010000:2.0:1789263662.634612:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: 00000000cc0b4776/0xce1582440fb1d4ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d4d5 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263662.634620:0:6464:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: 00000000cc0b4776/0xce1582440fb1d4ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1d4d5 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263662.635229:0:6464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004254ae03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:6464:1876178897995264:0@lo:256: 00000100:00100000:2.0:1789263662.635261:0:6464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263662.635341:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178897995264 00000100:00100000:1.0:1789263662.635346:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178897995264 00000100:00100000:1.0:1789263662.635377:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789263662.635384:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dea10167 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+10:6464:x1876178897995264:12345-0@lo:256: 20000000:01000000:1.0:1789263662.635398:0:6482:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1789263662.635404:0:6482:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1789263662.635436:0:6464:0:(client.c:2715:ptlrpc_set_wait()) set 000000003d1565ae going to sleep for 11 seconds 00000100:00100000:1.0:1789263662.635485:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dea10167 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+10:6464:x1876178897995264:12345-0@lo:256: Request processed in 101us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263662.635492:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789263662.635502:0:6464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004254ae03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:6464:1876178897995264:0@lo:256: 10000000:01000000:2.0:1789263662.635986:0:6464:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789263662.636000:0:6464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: 00000000cc0b4776/0xce1582440fb1d4ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d4d5 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263662.636008:0:6464:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: 00000000cc0b4776/0xce1582440fb1d4ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d4d5 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789263662.636020:0:6464:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dd9896b8000 from 1 10000000:01000000:2.0:1789263662.636022:0:6464:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789263662.636040:0:6464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: 000000003f4fa762/0xce1582440fb1d4dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263662.636047:0:6464:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: 000000003f4fa762/0xce1582440fb1d4dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263662.636054:0:6464:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: 000000003f4fa762/0xce1582440fb1d4dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263662.636066:0:6464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004254ae03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:6464:1876178897995392:0@lo:101: 00000100:00100000:2.0:1789263662.636153:0:6464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263662.636267:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178897995392 00000100:00100000:0.0:1789263662.636273:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178897995392 00000100:00100000:2.0:1789263662.636280:0:6464:0:(client.c:2715:ptlrpc_set_wait()) set 000000003d1565ae going to sleep for 11 seconds 00000100:00100000:0.0:1789263662.636311:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789263662.636319:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000009fb093f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+10:6464:x1876178897995392:12345-0@lo:101: 00010000:00010000:0.0:1789263662.636327:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263662.636337:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000636ce276/0xce1582440fb1d4e3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1d4dc expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263662.636352:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000636ce276/0xce1582440fb1d4e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1d4dc expref: 11 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263662.636360:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000636ce276/0xce1582440fb1d4e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d4dc expref: 11 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263662.636367:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000636ce276, rc 0) 00000100:00100000:0.0:1789263662.636404:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000009fb093f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+11:6464:x1876178897995392:12345-0@lo:101: Request processed in 87us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263662.636410:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789263662.636693:0:6464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004254ae03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:6464:1876178897995392:0@lo:101: 00010000:00010000:2.0:1789263662.636704:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: 000000003f4fa762/0xce1582440fb1d4dc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d4e3 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263662.636712:0:6464:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: 000000003f4fa762/0xce1582440fb1d4dc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1d4e3 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263662.636762:0:6464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004254ae03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:6464:1876178897995520:0@lo:501: 00000100:00100000:2.0:1789263662.636788:0:6464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263662.636804:0:6464:0:(client.c:2715:ptlrpc_set_wait()) set 000000003d1565ae going to sleep for 11 seconds 00000100:00100000:1.0:1789263662.636828:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178897995520 00000100:00100000:1.0:1789263662.636834:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178897995520 00000100:00100000:1.0:1789263662.636867:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789263662.636874:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e97e0b9c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+11:6464:x1876178897995520:12345-0@lo:501: 00000100:00100000:1.0:1789263662.637020:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e97e0b9c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+11:6464:x1876178897995520:12345-0@lo:501: Request processed in 146us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263662.637035:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789263662.637044:0:6464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004254ae03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:6464:1876178897995520:0@lo:501: 00000100:00100000:2.0:1789263662.637136:0:6464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004254ae03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:6464:1876178897995648:0@lo:503: 00000100:00100000:2.0:1789263662.637182:0:6464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263662.637213:0:6464:0:(client.c:2715:ptlrpc_set_wait()) set 000000003d1565ae going to sleep for 11 seconds 00000100:00100000:3.0:1789263662.637261:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178897995648 00000100:00100000:3.0:1789263662.637265:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178897995648 00000100:00100000:3.0:1789263662.637321:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789263662.637327:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000e4229fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+11:6464:x1876178897995648:12345-0@lo:503: 00000040:00080000:3.0:1789263662.637358:0:6480:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789263662.637401:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000e4229fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+11:6464:x1876178897995648:12345-0@lo:503: Request processed in 75us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263662.637407:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789263662.637477:0:6464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004254ae03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:6464:1876178897995648:0@lo:503: 00000040:00080000:0.0:1789263662.638270:0:6513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1789263662.638335:0:6464:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1789263662.638357:0:6464:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789263662.638408:0:6464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: 000000003f4fa762/0xce1582440fb1d4dc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d4e3 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263662.638418:0:6464:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: 000000003f4fa762/0xce1582440fb1d4dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d4e3 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789263662.638471:0:6464:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789263662.638474:0:6464:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9dd9896b8000 10000000:01000000:2.0:1789263662.638477:0:6464:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9dd9896b8000 10000000:01000000:2.0:1789263662.638480:0:6464:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789263662.638485:0:6464:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9dd9896b8000 from 1 10000000:01000000:2.0:1789263662.638488:0:6464:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789263662.638511:0:6464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: 00000000a72943c1/0xce1582440fb1d4ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263662.638518:0:6464:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: 00000000a72943c1/0xce1582440fb1d4ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263662.638525:0:6464:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: 00000000a72943c1/0xce1582440fb1d4ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263662.638538:0:6464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002a8f4e82 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:6464:1876178897995776:0@lo:101: 00000100:00100000:2.0:1789263662.638576:0:6464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263662.638602:0:6464:0:(client.c:2715:ptlrpc_set_wait()) set 000000000ea5ef31 going to sleep for 11 seconds 00000100:00100000:1.0:1789263662.638629:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178897995776 00000100:00100000:1.0:1789263662.638636:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178897995776 00000100:00100000:1.0:1789263662.638674:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789263662.638680:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000147d54f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+11:6464:x1876178897995776:12345-0@lo:101: 00010000:00010000:1.0:1789263662.638690:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263662.638701:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000085a6aae7/0xce1582440fb1d4f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1d4ea expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263662.638731:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000085a6aae7/0xce1582440fb1d4f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1d4ea expref: 12 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263662.638741:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000085a6aae7/0xce1582440fb1d4f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d4ea expref: 12 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263662.638748:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000085a6aae7, rc 0) 00000100:00100000:1.0:1789263662.638788:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000147d54f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+12:6464:x1876178897995776:12345-0@lo:101: Request processed in 109us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263662.638794:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789263662.638829:0:6464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002a8f4e82 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:6464:1876178897995776:0@lo:101: 00010000:00010000:2.0:1789263662.638841:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: 00000000a72943c1/0xce1582440fb1d4ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d4f1 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263662.638856:0:6464:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: 00000000a72943c1/0xce1582440fb1d4ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1d4f1 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263662.638897:0:6464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002a8f4e82 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:6464:1876178897995904:0@lo:501: 00000100:00100000:2.0:1789263662.638921:0:6464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263662.638943:0:6464:0:(client.c:2715:ptlrpc_set_wait()) set 000000000ea5ef31 going to sleep for 11 seconds 00000100:00100000:3.0:1789263662.638958:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178897995904 00000100:00100000:3.0:1789263662.638967:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178897995904 00000100:00100000:3.0:1789263662.638995:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789263662.639000:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000022223553 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+12:6464:x1876178897995904:12345-0@lo:501: 00000100:00100000:3.0:1789263662.639136:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000022223553 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+12:6464:x1876178897995904:12345-0@lo:501: Request processed in 136us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263662.639143:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789263662.639158:0:6464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002a8f4e82 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:6464:1876178897995904:0@lo:501: 00000100:00100000:0.0:1789263662.639191:0:6464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005e286cab pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:6464:1876178897996032:0@lo:503: 00000100:00100000:0.0:1789263662.639232:0:6464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263662.639251:0:6464:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ba61d410 going to sleep for 11 seconds 00000100:00100000:1.0:1789263662.639272:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178897996032 00000100:00100000:1.0:1789263662.639277:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178897996032 00000100:00100000:1.0:1789263662.639314:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789263662.639320:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000079dde2c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+12:6464:x1876178897996032:12345-0@lo:503: 00000100:00100000:1.0:1789263662.639403:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000079dde2c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+12:6464:x1876178897996032:12345-0@lo:503: Request processed in 84us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263662.639410:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789263662.639441:0:6464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005e286cab pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:6464:1876178897996032:0@lo:503: 00000100:00100000:0.0:1789263662.639742:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005e286cab pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:6514:1876178897996160:0@lo:502: 00000100:00100000:0.0:1789263662.639776:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263662.639799:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d0f9ea6e going to sleep for 11 seconds 00000100:00100000:3.0:1789263662.639854:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178897996160 00000100:00100000:3.0:1789263662.639859:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178897996160 00000100:00100000:3.0:1789263662.639883:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789263662.639889:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eb97ea7e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+12:6514:x1876178897996160:12345-0@lo:502: 00000100:00100000:3.0:1789263662.639966:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eb97ea7e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+12:6514:x1876178897996160:12345-0@lo:502: Request processed in 76us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263662.639973:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789263662.640009:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005e286cab pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:6514:1876178897996160:0@lo:502: 00000020:01000004:0.0:1789263662.640063:0:6514:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1789263662.640099:0:6514:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000270074c3) 00000020:00000080:0.0:1789263662.640116:0:6514:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1789263662.640217:0:6514:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000f6c6225f from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789263662.640221:0:6514:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000f6c6225f from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789263662.640223:0:6514:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000f6c6225f 4 00010000:00080000:0.0:1789263662.640249:0:6514:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000a9116106@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.120@tcp at head 00010000:00010000:0.0:1789263662.642400:0:6514:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1789263662.642620:0:6514:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1789263662.642655:0:6514:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789263662.642673:0:6514:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xce1582440fb1d4ff 00000100:00080000:0.0:1789263662.642681:0:6514:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789263662.642685:0:6514:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000a9116106 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:0.0:1789263662.642709:0:6514:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000005e286cab x1876178897996288/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789263662.642730:0:6514:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789263662.642776:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005e286cab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876178897996288:0@lo:38: 00000100:00100000:1.0:1789263662.642857:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263662.642892:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178897996288 00000100:00100000:0.0:1789263662.642900:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178897996288 00000100:00100000:0.0:1789263662.642943:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789263662.642948:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c69d587b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3617:x1876178897996288:12345-0@lo:38: 00000100:00100000:0.0:1789263662.643051:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c69d587b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3617:x1876178897996288:12345-0@lo:38: Request processed in 100us (194us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789263662.643058:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789263662.643160:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003c9f963c pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:6514:1876178897996416:0@lo:502: 00000100:00100000:0.0:1789263662.643206:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263662.643235:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178897996416 00000100:00100000:0.0:1789263662.643238:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set 000000008619bd66 going to sleep for 11 seconds 00000100:00100000:3.0:1789263662.643241:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178897996416 00000100:00100000:3.0:1789263662.643287:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789263662.643293:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00100000:3.0:1789263662.643298:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009d8e6a44 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+12:6514:x1876178897996416:12345-0@lo:502: 00000100:00080000:1.0:1789263662.643302:0:3617:0:(import.c:65:import_set_state_nolock()) 00000000a9116106 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789263662.643307:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789263662.643311:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005e286cab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876178897996288:0@lo:38: 00000100:00100000:3.0:1789263662.643415:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009d8e6a44 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+12:6514:x1876178897996416:12345-0@lo:502: Request processed in 120us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263662.643420:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003c9f963c pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:6514:1876178897996416:0@lo:502: 00000100:00100000:3.0:1789263662.643439:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000040:00080000:0.0:1789263662.643451:0:6514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1789263662.643572:0:6464:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1789263662.643595:0:6464:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789263662.643609:0:6464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: 00000000a72943c1/0xce1582440fb1d4ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d4f1 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263662.643619:0:6464:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: 00000000a72943c1/0xce1582440fb1d4ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d4f1 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789263662.643669:0:6464:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789263662.643671:0:6464:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789263662.643672:0:6464:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789263662.643673:0:6464:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789263662.643674:0:6464:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789263662.643676:0:6464:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789263662.643677:0:6464:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789263662.643679:0:6464:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789263662.643680:0:6464:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789263662.643681:0:6464:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789263662.643683:0:6464:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789263662.643684:0:6464:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789263662.643687:0:6464:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1789263662.643689:0:6464:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789263662.643690:0:6464:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789263662.643691:0:6464:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789263662.643691:0:6464:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789263662.643692:0:6464:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789263662.643693:0:6464:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789263662.643693:0:6464:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789263662.643694:0:6464:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789263662.643700:0:6464:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789263662.643700:0:6464:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789263662.643701:0:6464:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789263662.643701:0:6464:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789263662.643712:0:6464:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789263662.643718:0:6464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ea075935 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:6464:1876178897996544:0@lo:253: 00000100:00100000:1.0:1789263662.643747:0:6464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263662.643765:0:6464:0:(client.c:2715:ptlrpc_set_wait()) set 00000000215f64d0 going to sleep for 11 seconds 00000100:00100000:3.0:1789263662.643788:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178897996544 00000100:00100000:3.0:1789263662.643793:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178897996544 00000100:00100000:3.0:1789263662.643826:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789263662.643834:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005ec05368 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+12:6464:x1876178897996544:12345-0@lo:253: 20000000:01000000:3.0:1789263662.643855:0:6480:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789263662.643867:0:6480:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789263662.649645:0:6480:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789263662.649656:0:6480:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1789263662.649675:0:6503:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789263662.649680:0:6503:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789263662.649697:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000003cca28ac/0xce1582440fb1d506 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263662.649715:0:6503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000049e7aa8b/0xce1582440fb1d4d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d4ce expref: 12 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263662.649722:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000003cca28ac/0xce1582440fb1d506 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263662.649760:0:6503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000049e7aa8b/0xce1582440fb1d4d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce1582440fb1d4ce expref: 12 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263662.649773:0:6503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000049e7aa8b/0xce1582440fb1d4d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce1582440fb1d4ce expref: 12 pid: 6480 timeout: 254 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263662.649786:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000017ff027d pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6503:1876178897996672:0@lo:104: 00000100:00100000:1.0:1789263662.649844:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263662.649875:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set 0000000075cbc567 going to sleep for 11 seconds 00000100:00100000:2.0:1789263662.649909:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178897996672 00000100:00100000:2.0:1789263662.649916:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178897996672 00000100:00100000:2.0:1789263662.649964:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789263662.649973:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fbfd5275 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:66a76ccf-c64c-4b18-8369-a2861ec3956c+3:6503:x1876178897996672:12345-0@lo:104: 00010000:00010000:2.0:1789263662.649985:0:6470:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: 00000000cc0b4776/0xce1582440fb1d4ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1d4d5 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263662.650040:0:6470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789263662.650045:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fbfd5275 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:66a76ccf-c64c-4b18-8369-a2861ec3956c+3:6503:x1876178897996672:12345-0@lo:104: Request processed in 74us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263662.650051:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1789263662.650070:0:6475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789263662.650091:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: 00000000cc0b4776/0xce1582440fb1d4ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1d4d5 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263662.650099:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000cc0b4776 already unused, calling callback (000000000c943745) 10000000:00010000:2.0:1789263662.650102:0:6475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: 00000000cc0b4776/0xce1582440fb1d4ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xce1582440fb1d4d5 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263662.650110:0:6475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: 00000000cc0b4776/0xce1582440fb1d4ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xce1582440fb1d4d5 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789263662.650126:0:6475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: 00000000cc0b4776/0xce1582440fb1d4ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xce1582440fb1d4d5 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789263662.650131:0:6475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789263662.650168:0:6475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: 00000000cc0b4776/0xce1582440fb1d4ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d4d5 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263662.650175:0:6475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789263662.650192:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: 00000000cc0b4776/0xce1582440fb1d4ce lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d4d5 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263662.650199:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: 00000000cc0b4776/0xce1582440fb1d4ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d4d5 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263662.650215:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789263662.650217:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789263662.650218:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789263662.650249:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000017ff027d pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6503:1876178897996672:0@lo:104: 00000100:00100000:1.0:1789263662.650258:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000184d3a29 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:66a76ccf-c64c-4b18-8369-a2861ec3956c:3619:1876178897996800:0@lo:103: 00010000:00010000:2.0:1789263662.650266:0:6503:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000003cca28ac/0xce1582440fb1d506 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263662.650289:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263662.650364:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005ec05368 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+12:6464:x1876178897996544:12345-0@lo:253: Request processed in 6532us (6618us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263662.650370:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789263662.650412:0:6464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ea075935 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:6464:1876178897996544:0@lo:253: 00000100:00100000:2.0:1789263662.650435:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178897996800 00000100:00100000:2.0:1789263662.650440:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178897996800 10000000:01000000:1.0:1789263662.650441:0:6464:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789263662.650445:0:6464:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789263662.650447:0:6464:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789263662.650448:0:6464:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789263662.650450:0:6464:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789263662.650451:0:6464:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789263662.650452:0:6464:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789263662.650453:0:6464:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789263662.650455:0:6464:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789263662.650457:0:6464:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789263662.650458:0:6464:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789263662.650459:0:6464:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789263662.650460:0:6464:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00010000:2.0:1789263662.650464:0:6472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000049e7aa8b/0xce1582440fb1d4d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1d4ce expref: 12 pid: 6480 timeout: 254 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:02000000:1.0:1789263662.650469:0:6464:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1789263662.650529:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789263662.650547:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000054c717f1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a76ccf-c64c-4b18-8369-a2861ec3956c+12:3619:x1876178897996800:12345-0@lo:103: 00010000:00010000:2.0:1789263662.650557:0:6472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789263662.650567:0:6472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000049e7aa8b/0xce1582440fb1d4d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1d4ce expref: 12 pid: 6480 timeout: 254 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263662.650581:0:6472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000049e7aa8b/0xce1582440fb1d4d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce1582440fb1d4ce expref: 12 pid: 6480 timeout: 254 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263662.650592:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000049e7aa8b/0xce1582440fb1d4d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce1582440fb1d4ce expref: 12 pid: 6480 timeout: 254 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263662.650604:0:6472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000003cca28ac/0xce1582440fb1d506 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263662.650611:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003cca28ac/0xce1582440fb1d506 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789263662.650621:0:6472:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000942088s 00010000:00010000:2.0:1789263662.650625:0:6472:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003cca28ac/0xce1582440fb1d506 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263662.650631:0:6472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003cca28ac/0xce1582440fb1d506 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263662.650637:0:6472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000003cca28ac/0xce1582440fb1d506 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263662.650643:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000003cca28ac/0xce1582440fb1d506 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263662.650648:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003cca28ac already unused, calling callback (000000000583e00c) 00010000:00010000:2.0:1789263662.650656:0:6472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000003cca28ac/0xce1582440fb1d506 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263662.650663:0:6472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000003cca28ac/0xce1582440fb1d506 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263662.650684:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000003cca28ac/0xce1582440fb1d506 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263662.650697:0:6472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789263662.650726:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000054c717f1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a76ccf-c64c-4b18-8369-a2861ec3956c+11:3619:x1876178897996800:12345-0@lo:103: Request processed in 191us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263662.650733:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789263662.650806:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000184d3a29 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:66a76ccf-c64c-4b18-8369-a2861ec3956c:3619:1876178897996800:0@lo:103: 00010000:00010000:2.0:1789263662.650818:0:6503:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000003cca28ac/0xce1582440fb1d506 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263662.650822:0:6503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000003cca28ac/0xce1582440fb1d506 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263662.650825:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003cca28ac/0xce1582440fb1d506 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:1.0:1789263662.654248:0:6464:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:1.0:1789263662.654417:0:6464:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1789263662.654656:0:6464:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:1.0:1789263662.654807:0:6464:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1789263662.654996:0:6464:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:1.0:1789263662.655184:0:6464:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:3.0:1789263662.656056:0:6464:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:3.0:1789263662.656252:0:6464:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:3.0:1789263662.656423:0:6464:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:3.0:1789263662.656610:0:6464:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:3.0:1789263662.656851:0:6464:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:3.0:1789263662.656979:0:6464:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:1.0:1789263662.659239:0:6464:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1789263662.666404:0:6464:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1789263662.666432:0:6519:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1789263662.666436:0:6519:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1789263662.666817:0:6520:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1789263662.667993:0:6464:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1789263662.668141:0:6464:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1789263662.668589:0:6464:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1789263662.668596:0:6464:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1789263662.669850:0:6520:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789263662.670115:0:6464:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789263662.671174:0:6464:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1789263662.674408:0:6464:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1789263662.674484:0:6464:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1789263662.674688:0:6464:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1789263662.674915:0:6464:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:3.0:1789263662.675557:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00000040:00080000:0.0:1789263662.675690:0:6520:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00100000:10000000:3.0:1789263662.675701:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00000004:00080000:0.0:1789263662.675740:0:6520:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1789263662.675744:0:6520:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:3.0:1789263662.675892:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1789263662.676017:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1789263662.676148:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1789263662.676237:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1789263662.676372:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1789263662.676497:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1789263662.676627:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1789263662.676758:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1789263662.676912:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1789263662.677040:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1789263662.677288:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1789263662.677452:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1789263662.677610:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1789263662.677757:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1789263662.677992:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1789263662.678183:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1789263662.678315:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1789263662.678459:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1789263662.678582:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1789263662.678700:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1789263662.678844:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1789263662.678970:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1789263662.679150:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1789263662.679245:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1789263662.679354:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1789263662.679467:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1789263662.679576:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1789263662.679699:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1789263662.679826:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1789263662.679912:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1789263662.680070:0:6464:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:2.0:1789263662.682498:0:6464:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1789263662.682533:0:6464:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb38e41cb7988 00100000:10000000:2.0:1789263662.682542:0:6464:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1789263662.683148:0:6464:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789263662.683172:0:6464:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.120@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789263662.683197:0:6464:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=45 00000080:00000004:1.0:1789263662.683225:0:6464:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1789263662.684421:0:6464:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789263662.684629:0:6464:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:1.0:1789263663.533214:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789263664.227347:0:6764:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg320-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789263664.557246:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789263664.630135:0:6816:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789263664.630333:0:6816:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789263665.581265:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789263666.350392:0:6917:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789263666.350543:0:6917:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789263666.605636:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263667.630140:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789263667.757979:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789263667.758129:0:479:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789263667.758134:0:479:0:(import.c:65:import_set_state_nolock()) 00000000a9116106 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789263667.758156:0:479:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000a9116106 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:1.0:1789263667.758199:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006d42849b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:66a76ccf-c64c-4b18-8369-a2861ec3956c:3620:1876178897996928:0@lo:400: 00000100:00100000:3.0:1789263667.758204:0:479:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000057afe259 x1876178897997056/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789263667.758265:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000057afe259 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876178897997056:0@lo:38: 00000100:00100000:1.0:1789263667.758297:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263667.758355:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263667.758356:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178897996928 00000100:00100000:0.0:1789263667.758370:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178897996928 00000100:00100000:0.0:1789263667.758446:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789263667.758448:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178897997056 00000100:00100000:2.0:1789263667.758457:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178897997056 00000100:00100000:0.0:1789263667.758458:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000053fdca78 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+11:3620:x1876178897996928:12345-0@lo:400: 00000100:00100000:2.0:1789263667.758501:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789263667.758508:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000184d3a29 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3617:x1876178897997056:12345-0@lo:38: 00010000:00080000:2.0:1789263667.758541:0:6489:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 110 last 0 00000100:00100000:0.0:1789263667.758546:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000053fdca78 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+11:3620:x1876178897996928:12345-0@lo:400: Request processed in 86us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263667.758557:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000020:00000080:2.0:1789263667.758600:0:6489:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xce1582440fb1d50d 00000004:00100000:2.0:1789263667.758670:0:6489:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789263667.758842:0:6489:0:(import.c:65:import_set_state_nolock()) 00000000d49e1e5f : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789263667.758949:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000184d3a29 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1876178897997056:12345-0@lo:38: Request processed in 430us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263667.758959:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789263667.758995:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006d42849b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:66a76ccf-c64c-4b18-8369-a2861ec3956c:3620:1876178897996928:0@lo:400: 00010000:00080000:2.0:1789263667.759035:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000057afe259 x1876178897997056/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789263677 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789263667.759055:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1789263667.759066:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1789263667.759072:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789263667.759305:0:3617:0:(import.c:65:import_set_state_nolock()) 00000000a9116106 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789263667.759313:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000057afe259 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876178897997056:0@lo:38: 00010000:00010000:2.0:1789263668.653167:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789263669.677179:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789263669.805420:0:6484:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789263669.805428:0:6484:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9dd9896b8000 from 3 10000000:01000000:2.0:1789263669.805432:0:6484:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789263669.805474:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: 00000000cc0b4776/0xce1582440fb1d514 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263669.805486:0:6484:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: 00000000cc0b4776/0xce1582440fb1d514 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263669.805497:0:6484:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: 00000000cc0b4776/0xce1582440fb1d514 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263669.805521:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fa97b207 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178897997184:0@lo:101: 00000100:00100000:2.0:1789263669.805588:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263669.805637:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178897997184 00000100:00100000:2.0:1789263669.805641:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a705d5aa going to sleep for 11 seconds 00000100:00100000:0.0:1789263669.805646:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178897997184 00000100:00100000:0.0:1789263669.805740:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789263669.805749:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fd6e7d21 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+11:6484:x1876178897997184:12345-0@lo:101: 00010000:00010000:0.0:1789263669.805763:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263669.805776:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fac6a03c/0xce1582440fb1d51b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1d514 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263669.805802:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fac6a03c/0xce1582440fb1d51b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1d514 expref: 12 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263669.805823:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fac6a03c/0xce1582440fb1d51b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d514 expref: 12 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263669.805831:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fac6a03c, rc 0) 00000100:00100000:0.0:1789263669.805868:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fd6e7d21 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+12:6484:x1876178897997184:12345-0@lo:101: Request processed in 121us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263669.805875:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789263669.805899:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fa97b207 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178897997184:0@lo:101: 00010000:00010000:2.0:1789263669.805913:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: 00000000cc0b4776/0xce1582440fb1d514 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d51b expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263669.805922:0:6484:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: 00000000cc0b4776/0xce1582440fb1d514 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1d51b expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263669.805962:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fa97b207 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178897997312:0@lo:256: 00000100:00100000:2.0:1789263669.805991:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263669.806008:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a705d5aa going to sleep for 11 seconds 00000100:00100000:0.0:1789263669.806025:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178897997312 00000100:00100000:0.0:1789263669.806030:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178897997312 00000100:00100000:0.0:1789263669.806054:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789263669.806059:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000846e15be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+12:6484:x1876178897997312:12345-0@lo:256: 20000000:01000000:0.0:1789263669.806072:0:6482:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789263669.806262:0:6482:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789263669.806265:0:6482:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1789263669.806341:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000846e15be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+12:6484:x1876178897997312:12345-0@lo:256: Request processed in 282us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263669.806348:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789263669.806567:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fa97b207 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178897997312:0@lo:256: 10000000:01000000:2.0:1789263669.806608:0:6484:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789263669.806614:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: 00000000cc0b4776/0xce1582440fb1d514 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d51b expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263669.806622:0:6484:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: 00000000cc0b4776/0xce1582440fb1d514 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d51b expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789263670.157369:0:7415:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789263670.157371:0:7415:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:1.0:1789263670.157384:0:7415:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1789263670.157500:0:7415:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000df8d6a98 00000020:01000004:1.0:1789263670.157515:0:7415:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:1.0:1789263670.157525:0:7415:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1789263670.157536:0:7415:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (0000000083d7bcd5) 00000020:00000080:1.0:1789263670.157559:0:7415:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1789263670.184710:0:7415:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:0.0:1789263670.184772:0:7415:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:0.0:1789263670.198108:0:7415:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1789263670.198340:0:7415:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1789263670.198351:0:7415:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789263670.198362:0:7415:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xce1582440fb1d529 00000020:01000004:0.0:1789263670.198369:0:7415:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1789263670.198399:0:7415:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.120@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789263670.198402:0:7415:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.120@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789263670.198407:0:7415:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1789263670.198429:0:7415:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1789263670.198437:0:7415:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.120@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1789263670.208254:0:7415:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.120@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789263670.208291:0:7415:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.120@tcp, index=0001, flags=0x20061 00000020:01000004:0.0:1789263670.208295:0:7415:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789263670.208297:0:7415:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789263670.208298:0:7415:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789263670.208300:0:7415:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789263670.208301:0:7415:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789263670.208303:0:7415:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789263670.208304:0:7415:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789263670.208305:0:7415:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789263670.208306:0:7415:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789263670.208308:0:7415:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789263670.208309:0:7415:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789263670.208312:0:7415:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:0.0:1789263670.208314:0:7415:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789263670.208316:0:7415:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789263670.208317:0:7415:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789263670.208318:0:7415:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789263670.208319:0:7415:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789263670.208320:0:7415:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789263670.208321:0:7415:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789263670.208322:0:7415:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789263670.208323:0:7415:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789263670.208324:0:7415:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789263670.208324:0:7415:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789263670.208349:0:7415:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1789263670.208365:0:7415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003c9f963c pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:7415:1876178897997440:0@lo:253: 00000100:00100000:0.0:1789263670.208442:0:7415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263670.208489:0:7415:0:(client.c:2715:ptlrpc_set_wait()) set 000000006f57c253 going to sleep for 11 seconds 00000100:00100000:3.0:1789263670.208508:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178897997440 00000100:00100000:3.0:1789263670.208524:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178897997440 00000100:00100000:3.0:1789263670.208610:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789263670.208621:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e37dce48 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+12:7415:x1876178897997440:12345-0@lo:253: 20000000:01000000:3.0:1789263670.208668:0:6480:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1789263670.208674:0:6480:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:3.0:1789263670.208681:0:6480:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:3.0:1789263670.208685:0:6480:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:3.0:1789263670.208845:0:6480:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:3.0:1789263670.209124:0:6480:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789263670.209259:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1789263670.209277:0:6480:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789263670.209290:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:3.0:1789263670.209300:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:3.0:1789263670.209309:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:3.0:1789263670.209349:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:3.0:1789263670.209354:0:6480:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:3.0:1789263670.209361:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:3.0:1789263670.209365:0:6480:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:3.0:1789263670.209395:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:3.0:1789263670.209400:0:6480:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:3.0:1789263670.209407:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:3.0:1789263670.209417:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:3.0:1789263670.209541:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:3.0:1789263670.209552:0:6480:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.120@tcp (null) (null) (null) 00000040:00080000:3.0:1789263670.209567:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:3.0:1789263670.209573:0:6480:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789263670.209587:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:3.0:1789263670.209592:0:6480:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.203.120@tcp (null) (null) 00000040:00080000:3.0:1789263670.209605:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:3.0:1789263670.209611:0:6480:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1789263670.209624:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:3.0:1789263670.209641:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:3.0:1789263670.209649:0:6480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:3.0:1789263670.209719:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:3.0:1789263670.209726:0:6480:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:3.0:1789263670.209735:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:3.0:1789263670.209752:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:3.0:1789263670.209770:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:3.0:1789263670.209777:0:6480:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:3.0:1789263670.209790:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:3.0:1789263670.209811:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:3.0:1789263670.209817:0:6480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:3.0:1789263670.209836:0:6480:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1789263670.209843:0:6480:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:3.0:1789263670.210231:0:7421:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1789263670.210349:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1789263670.210368:0:6480:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.120@tcp for mdt 20000000:01000000:0.0:1789263670.210370:0:6480:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.120@tcp (null) (null) (null) 00000040:00080000:0.0:1789263670.210396:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1789263670.210403:0:6480:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1789263670.210416:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1789263670.210428:0:6480:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.203.120@tcp (null) (null) 00000040:00080000:0.0:1789263670.210448:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1789263670.210456:0:6480:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:0.0:1789263670.210467:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:0.0:1789263670.210476:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:0.0:1789263670.210513:0:6480:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:0.0:1789263670.210519:0:6480:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:0.0:1789263670.210683:0:7422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:3.0:1789263670.210790:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1789263670.210805:0:6480:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.203.120@tcp for mdt 20000000:01000000:3.0:1789263670.210807:0:6480:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.120@tcp (null) (null) (null) 00000040:00080000:3.0:1789263670.210831:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1789263670.210838:0:6480:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789263670.210850:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1789263670.210856:0:6480:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.203.120@tcp (null) (null) 00000040:00080000:3.0:1789263670.210868:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1789263670.210874:0:6480:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:3.0:1789263670.210885:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1789263670.210909:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:3.0:1789263670.210929:0:6480:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1789263670.210932:0:6480:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1789263670.210937:0:6480:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1789263670.210983:0:6480:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789263670.210985:0:6480:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789263670.212199:0:7423:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:3.0:1789263670.212237:0:7423:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:3.0:1789263670.212257:0:7423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1789263670.212384:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:0.0:1789263670.212408:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:0.0:1789263670.212425:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:0.0:1789263670.212435:0:6480:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1789263670.212438:0:6480:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789263670.213598:0:7424:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1789263670.213625:0:7424:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1789263670.213639:0:7424:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:3.0:1789263670.213847:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:3.0:1789263670.213864:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:3.0:1789263670.213873:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:3.0:1789263670.213882:0:6480:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789263670.213884:0:6480:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789263670.214684:0:7425:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1789263670.214706:0:7425:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1789263670.214721:0:7425:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1789263670.214830:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1789263670.214854:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1789263670.214881:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1789263670.214897:0:6480:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1789263670.214900:0:6480:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1789263670.214906:0:6480:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1789263670.214914:0:6480:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1789263670.215317:0:7426:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:3.0:1789263670.215476:0:6480:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789263670.222668:0:6480:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789263670.222708:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000b2a4a5a4/0xce1582440fb1d530 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263670.222732:0:6480:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000edd439af/0xce1582440fb1d465 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d45e expref: 12 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263670.222761:0:6480:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000d4c8d12a/0xce1582440fb1d481 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d47a expref: 12 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263670.222767:0:6480:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000085a6aae7/0xce1582440fb1d4f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d4ea expref: 12 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263670.222775:0:6480:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000b2a4a5a4/0xce1582440fb1d530 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263670.222826:0:6480:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000085a6aae7/0xce1582440fb1d4f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce1582440fb1d4ea expref: 12 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263670.222843:0:6480:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000085a6aae7/0xce1582440fb1d4f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce1582440fb1d4ea expref: 12 pid: 6482 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263670.222859:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000148dfbb4 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6480:1876178897997568:0@lo:104: 00000100:00100000:3.0:1789263670.222936:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789263670.223069:0:6480:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000d4c8d12a/0xce1582440fb1d481 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce1582440fb1d47a expref: 12 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263670.223115:0:6480:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000d4c8d12a/0xce1582440fb1d481 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce1582440fb1d47a expref: 12 pid: 6482 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263670.223126:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000504c5a63 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6480:1876178897997696:0@lo:104: 00000100:00100000:3.0:1789263670.223157:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263670.223342:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178897997568 00000100:00100000:1.0:1789263670.223353:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178897997568 00010000:00010000:2.0:1789263670.223356:0:6480:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000edd439af/0xce1582440fb1d465 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce1582440fb1d45e expref: 12 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263670.223383:0:6480:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000edd439af/0xce1582440fb1d465 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce1582440fb1d45e expref: 12 pid: 6480 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263670.223394:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fa97b207 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6480:1876178897997824:0@lo:104: 00000100:00100000:1.0:1789263670.223409:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178897997696 00000100:00100000:1.0:1789263670.223413:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178897997696 00000100:00100000:2.0:1789263670.223427:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263670.223430:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789263670.223439:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ac00f795 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:66a76ccf-c64c-4b18-8369-a2861ec3956c+4:6480:x1876178897997568:12345-0@lo:104: 00000100:00100000:2.0:1789263670.223445:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bc6f1d04 going to sleep for 11 seconds 00010000:00010000:1.0:1789263670.223451:0:6471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: 00000000a72943c1/0xce1582440fb1d4ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1d4f1 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263670.223521:0:6471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789263670.223527:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ac00f795 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:66a76ccf-c64c-4b18-8369-a2861ec3956c+4:6480:x1876178897997568:12345-0@lo:104: Request processed in 90us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263670.223535:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000148dfbb4 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6480:1876178897997568:0@lo:104: 00000100:00100000:1.0:1789263670.223536:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789263670.223556:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178897997824 00000100:00100000:1.0:1789263670.223560:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178897997824 00000100:00100000:1.0:1789263670.223574:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789263670.223579:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000025c8c91d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:66a76ccf-c64c-4b18-8369-a2861ec3956c+4:6480:x1876178897997696:12345-0@lo:104: 00010000:00010000:1.0:1789263670.223594:0:6471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: 000000002adcd502/0xce1582440fb1d47a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1d481 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263670.223635:0:6471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789263670.223640:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000025c8c91d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:66a76ccf-c64c-4b18-8369-a2861ec3956c+4:6480:x1876178897997696:12345-0@lo:104: Request processed in 61us (484us total) trans 0 rc 0/0 00010000:00010000:2.0:1789263670.223647:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:1.0:1789263670.223647:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1789263670.223656:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: 00000000a72943c1/0xce1582440fb1d4ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1d4f1 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263670.223664:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1789263670.223667:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a72943c1 already unused, calling callback (000000000c943745) 10000000:00010000:2.0:1789263670.223672:0:6476:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: 00000000a72943c1/0xce1582440fb1d4ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xce1582440fb1d4f1 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263670.223672:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007df245df pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:66a76ccf-c64c-4b18-8369-a2861ec3956c+3:6480:x1876178897997824:12345-0@lo:104: 00010000:00010000:1.0:1789263670.223681:0:6471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: 000000004326b965/0xce1582440fb1d45e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1d465 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263670.223685:0:6476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: 00000000a72943c1/0xce1582440fb1d4ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xce1582440fb1d4f1 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789263670.223698:0:6476:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: 00000000a72943c1/0xce1582440fb1d4ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xce1582440fb1d4f1 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789263670.223704:0:6476:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789263670.223717:0:6471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789263670.223722:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007df245df pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:66a76ccf-c64c-4b18-8369-a2861ec3956c+3:6480:x1876178897997824:12345-0@lo:104: Request processed in 52us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263670.223728:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1789263670.223738:0:6476:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: 00000000a72943c1/0xce1582440fb1d4ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d4f1 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263670.223746:0:6476:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789263670.223768:0:6475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789263670.223775:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: 00000000a72943c1/0xce1582440fb1d4ea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d4f1 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263670.223784:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: 00000000a72943c1/0xce1582440fb1d4ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d4f1 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263670.223798:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1789263670.223801:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789263670.223805:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: 000000004326b965/0xce1582440fb1d45e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1d465 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263670.223811:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004326b965 already unused, calling callback (000000000c943745) 00000100:00100000:1.0:1789263670.223813:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fe231a88 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:66a76ccf-c64c-4b18-8369-a2861ec3956c:3620:1876178897997952:0@lo:103: 10000000:00010000:2.0:1789263670.223814:0:6476:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: 000000004326b965/0xce1582440fb1d45e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xce1582440fb1d465 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263670.223830:0:6476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: 000000004326b965/0xce1582440fb1d45e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xce1582440fb1d465 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789263670.223836:0:6476:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: 000000004326b965/0xce1582440fb1d45e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xce1582440fb1d465 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789263670.223842:0:6476:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789263670.223848:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789263670.223873:0:6476:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: 000000004326b965/0xce1582440fb1d45e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d465 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263670.223881:0:6476:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789263670.223899:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: 000000004326b965/0xce1582440fb1d45e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d465 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263670.223903:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178897997952 00010000:00010000:2.0:1789263670.223908:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: 000000004326b965/0xce1582440fb1d45e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d465 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263670.223909:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178897997952 00010000:00010000:2.0:1789263670.223923:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263670.223928:0:6473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000085a6aae7/0xce1582440fb1d4f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1d4ea expref: 13 pid: 6482 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263670.223935:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789263670.223939:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789263670.223951:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000046944190 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:66a76ccf-c64c-4b18-8369-a2861ec3956c:3618:1876178897998080:0@lo:103: 00000100:00100000:1.0:1789263670.223957:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789263670.223965:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ea075935 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a76ccf-c64c-4b18-8369-a2861ec3956c+13:3620:x1876178897997952:12345-0@lo:103: 00010000:00010000:1.0:1789263670.223977:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789263670.223983:0:6473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000085a6aae7/0xce1582440fb1d4f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1d4ea expref: 13 pid: 6482 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263670.223985:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789263670.224002:0:6473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000085a6aae7/0xce1582440fb1d4f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce1582440fb1d4ea expref: 13 pid: 6482 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263670.224018:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000085a6aae7/0xce1582440fb1d4f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce1582440fb1d4ea expref: 13 pid: 6482 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263670.224027:0:6472:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:1.0:1789263670.224031:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789263670.224037:0:6472:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1789263670.224051:0:6474:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1789263670.224063:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ea075935 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a76ccf-c64c-4b18-8369-a2861ec3956c+12:3620:x1876178897997952:12345-0@lo:103: Request processed in 99us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263670.224069:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789263670.224074:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178897998080 00000100:00100000:1.0:1789263670.224121:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fe231a88 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:66a76ccf-c64c-4b18-8369-a2861ec3956c:3620:1876178897997952:0@lo:103: 00000100:00100000:2.0:1789263670.224128:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178897998080 00010000:00010000:2.0:1789263670.224149:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000edd439af/0xce1582440fb1d465 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1d45e expref: 12 pid: 6480 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263670.224191:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789263670.224199:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002f5bd68d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a76ccf-c64c-4b18-8369-a2861ec3956c+12:3618:x1876178897998080:12345-0@lo:103: 00010000:00010000:2.0:1789263670.224208:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789263670.224211:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000edd439af/0xce1582440fb1d465 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1d45e expref: 12 pid: 6480 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263670.224219:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000edd439af/0xce1582440fb1d465 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce1582440fb1d45e expref: 12 pid: 6480 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263670.224237:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789263670.224273:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002f5bd68d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a76ccf-c64c-4b18-8369-a2861ec3956c+12:3618:x1876178897998080:12345-0@lo:103: Request processed in 76us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263670.224280:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789263670.224337:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000046944190 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:66a76ccf-c64c-4b18-8369-a2861ec3956c:3618:1876178897998080:0@lo:103: 00000100:00100000:2.0:1789263670.224349:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000504c5a63 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6480:1876178897997696:0@lo:104: 00010000:00010000:1.0:1789263670.224462:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263670.224464:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263670.224466:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789263670.224516:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000edd439af/0xce1582440fb1d465 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce1582440fb1d45e expref: 11 pid: 6480 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263670.224524:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fa97b207 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6480:1876178897997824:0@lo:104: 00010000:00010000:2.0:1789263670.224539:0:6480:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000b2a4a5a4/0xce1582440fb1d530 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263670.224569:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: 000000002adcd502/0xce1582440fb1d47a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1d481 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263670.224599:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002adcd502 already unused, calling callback (000000000c943745) 10000000:00010000:0.0:1789263670.224603:0:6475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: 000000002adcd502/0xce1582440fb1d47a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xce1582440fb1d481 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263670.224611:0:6475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: 000000002adcd502/0xce1582440fb1d47a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xce1582440fb1d481 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789263670.224618:0:6475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: 000000002adcd502/0xce1582440fb1d47a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xce1582440fb1d481 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789263670.224622:0:6475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789263670.224670:0:6475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: 000000002adcd502/0xce1582440fb1d47a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d481 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263670.224676:0:6475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789263670.224719:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005b338d30 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:66a76ccf-c64c-4b18-8369-a2861ec3956c:3619:1876178897998208:0@lo:103: 00000100:00100000:2.0:1789263670.224748:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263670.224781:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178897998208 00000100:00100000:1.0:1789263670.224786:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178897998208 00010000:00010000:1.0:1789263670.224803:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000d4c8d12a/0xce1582440fb1d481 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1d47a expref: 11 pid: 6482 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263670.224826:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: 000000002adcd502/0xce1582440fb1d47a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d481 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263670.224837:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: 000000002adcd502/0xce1582440fb1d47a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d481 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263670.224843:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789263670.224858:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fa97b207 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a76ccf-c64c-4b18-8369-a2861ec3956c+11:3619:x1876178897998208:12345-0@lo:103: 00010000:00010000:1.0:1789263670.224869:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789263670.224871:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263670.224874:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000d4c8d12a/0xce1582440fb1d481 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1d47a expref: 11 pid: 6482 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263670.224877:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263670.224882:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263670.224892:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000d4c8d12a/0xce1582440fb1d481 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce1582440fb1d47a expref: 11 pid: 6482 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263670.224905:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d4c8d12a/0xce1582440fb1d481 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce1582440fb1d47a expref: 11 pid: 6482 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263670.224924:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000b2a4a5a4/0xce1582440fb1d530 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263670.224932:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b2a4a5a4/0xce1582440fb1d530 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263670.224945:0:6474:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b2a4a5a4/0xce1582440fb1d530 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263670.224951:0:6474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b2a4a5a4/0xce1582440fb1d530 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263670.224957:0:6474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000b2a4a5a4/0xce1582440fb1d530 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263670.224964:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000b2a4a5a4/0xce1582440fb1d530 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263670.224969:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b2a4a5a4 already unused, calling callback (000000000583e00c) 00010000:00010000:1.0:1789263670.224972:0:6474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000b2a4a5a4/0xce1582440fb1d530 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263670.224979:0:6474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000b2a4a5a4/0xce1582440fb1d530 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263670.224992:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000b2a4a5a4/0xce1582440fb1d530 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263670.225000:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789263670.225011:0:6480:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000b2a4a5a4/0xce1582440fb1d530 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263670.225018:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000b2a4a5a4/0xce1582440fb1d530 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263670.225027:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b2a4a5a4/0xce1582440fb1d530 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263670.225036:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fa97b207 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a76ccf-c64c-4b18-8369-a2861ec3956c+10:3619:x1876178897998208:12345-0@lo:103: Request processed in 180us (286us total) trans 0 rc 0/0 20000000:01000000:2.0:1789263670.225043:0:6480:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1789263670.225054:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789263670.225419:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005b338d30 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:66a76ccf-c64c-4b18-8369-a2861ec3956c:3619:1876178897998208:0@lo:103: 00000100:00100000:2.0:1789263670.226884:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e37dce48 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+9:7415:x1876178897997440:12345-0@lo:253: Request processed in 18259us (18435us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263670.226900:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789263670.226918:0:7415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003c9f963c pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:7415:1876178897997440:0@lo:253: 10000000:01000000:0.0:1789263670.226940:0:7415:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1789263670.226944:0:7415:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789263670.226955:0:7415:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789263670.226957:0:7415:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789263670.226958:0:7415:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:0.0:1789263670.226959:0:7415:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789263670.226960:0:7415:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789263670.226961:0:7415:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789263670.226962:0:7415:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1789263670.226964:0:7415:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789263670.226965:0:7415:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789263670.226982:0:7415:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000df8d6a98 from lustre-MDT0001 10000000:01000000:0.0:1789263670.227011:0:7415:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1789263670.227013:0:7415:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1789263670.227019:0:7415:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9dd9b7983370 local copy 10000000:01000000:0.0:1789263670.227022:0:7415:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789263670.227051:0:7415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: 000000005f2e3c15/0xce1582440fb1d537 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263670.227060:0:7415:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.120@tcp lock: 000000005f2e3c15/0xce1582440fb1d537 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263670.227068:0:7415:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: 000000005f2e3c15/0xce1582440fb1d537 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263670.227115:0:7415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003c9f963c pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:7415:1876178897998336:0@lo:101: 00000100:00100000:0.0:1789263670.227172:0:7415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263670.227213:0:7415:0:(client.c:2715:ptlrpc_set_wait()) set 000000007517762d going to sleep for 11 seconds 00000100:00100000:1.0:1789263670.227307:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178897998336 00000100:00100000:1.0:1789263670.227316:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178897998336 00000100:00100000:1.0:1789263670.227360:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789263670.227369:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009b473b4d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+9:7415:x1876178897998336:12345-0@lo:101: 00010000:00010000:1.0:1789263670.227395:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263670.227412:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003788306f/0xce1582440fb1d53e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1d537 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263670.227436:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003788306f/0xce1582440fb1d53e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1d537 expref: 10 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263670.227446:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003788306f/0xce1582440fb1d53e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d537 expref: 10 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263670.227455:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003788306f, rc 0) 00000100:00100000:1.0:1789263670.227641:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009b473b4d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+10:7415:x1876178897998336:12345-0@lo:101: Request processed in 274us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263670.227647:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789263670.227761:0:7415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003c9f963c pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:7415:1876178897998336:0@lo:101: 00010000:00010000:0.0:1789263670.227775:0:7415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: 000000005f2e3c15/0xce1582440fb1d537 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xce1582440fb1d53e expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263670.227782:0:7415:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: 000000005f2e3c15/0xce1582440fb1d537 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xce1582440fb1d53e expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263670.227856:0:7415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003c9f963c pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:7415:1876178897998464:0@lo:501: 00000100:00100000:0.0:1789263670.227879:0:7415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263670.227894:0:7415:0:(client.c:2715:ptlrpc_set_wait()) set 000000007517762d going to sleep for 11 seconds 00000100:00100000:2.0:1789263670.227922:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178897998464 00000100:00100000:2.0:1789263670.227935:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178897998464 00000100:00100000:2.0:1789263670.227969:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789263670.227975:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000003907aec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+10:7415:x1876178897998464:12345-0@lo:501: 00000100:00100000:2.0:1789263670.228062:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000003907aec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+10:7415:x1876178897998464:12345-0@lo:501: Request processed in 87us (181us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789263670.228070:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789263670.228153:0:7415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003c9f963c pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:7415:1876178897998464:0@lo:501: 10000000:01000000:1.0:1789263670.228193:0:7415:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.120@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789263670.228233:0:7415:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.120@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789263670.228238:0:7415:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: 000000005f2e3c15/0xce1582440fb1d537 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xce1582440fb1d53e expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263670.228244:0:7415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: 000000005f2e3c15/0xce1582440fb1d537 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xce1582440fb1d53e expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263670.228260:0:7415:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: 000000005f2e3c15/0xce1582440fb1d537 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xce1582440fb1d53e expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263670.228274:0:7415:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789263670.228301:0:7415:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9dd9c0889800 10000000:01000000:1.0:1789263670.228304:0:7415:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789263670.228308:0:7415:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9dd9b7983370 10000000:01000000:1.0:1789263670.228310:0:7415:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1789263670.228312:0:7415:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9dd9b7983370 from 1 10000000:01000000:1.0:1789263670.228314:0:7415:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789263670.228335:0:7415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: 00000000d4c8d12a/0xce1582440fb1d545 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263670.228340:0:7415:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: 00000000d4c8d12a/0xce1582440fb1d545 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263670.228346:0:7415:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: 00000000d4c8d12a/0xce1582440fb1d545 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263670.228347:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789263670.228355:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: 000000005f2e3c15/0xce1582440fb1d537 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xce1582440fb1d53e expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263670.228362:0:7415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000047072755 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:7415:1876178897998592:0@lo:101: 00010000:00010000:2.0:1789263670.228366:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005f2e3c15 already unused, calling callback (000000000c943745) 10000000:00010000:2.0:1789263670.228370:0:6476:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: 000000005f2e3c15/0xce1582440fb1d537 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xce1582440fb1d53e expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263670.228388:0:6476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: 000000005f2e3c15/0xce1582440fb1d537 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xce1582440fb1d53e expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789263670.228395:0:6476:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: 000000005f2e3c15/0xce1582440fb1d537 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xce1582440fb1d53e expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263670.228411:0:7415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:2.0:1789263670.228417:0:6476:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789263670.228437:0:6476:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: 000000005f2e3c15/0xce1582440fb1d537 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xce1582440fb1d53e expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263670.228444:0:6476:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789263670.228451:0:7415:0:(client.c:2715:ptlrpc_set_wait()) set 000000003e5c9ead going to sleep for 11 seconds 00010000:00010000:2.0:1789263670.228472:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: 000000005f2e3c15/0xce1582440fb1d537 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xce1582440fb1d53e expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263670.228481:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005c0e61e8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:66a76ccf-c64c-4b18-8369-a2861ec3956c:3620:1876178897998720:0@lo:103: 00010000:00010000:2.0:1789263670.228481:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: 000000005f2e3c15/0xce1582440fb1d537 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xce1582440fb1d53e expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263670.228500:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789263670.228503:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789263670.228505:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789263670.228525:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263670.228551:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178897998720 00000100:00100000:2.0:1789263670.228556:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178897998720 00000100:00100000:0.0:1789263670.228578:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178897998592 00000100:00100000:0.0:1789263670.228584:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178897998592 00000100:00100000:2.0:1789263670.228598:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789263670.228607:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000045bd3abf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a76ccf-c64c-4b18-8369-a2861ec3956c+11:3620:x1876178897998720:12345-0@lo:103: 00010000:00010000:2.0:1789263670.228617:0:6472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789263670.228621:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789263670.228631:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003a55e1b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+11:7415:x1876178897998592:12345-0@lo:101: 00010000:00010000:2.0:1789263670.228633:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003788306f/0xce1582440fb1d53e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xce1582440fb1d537 expref: 11 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263670.228642:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263670.228648:0:6472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789263670.228653:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000051d62c32/0xce1582440fb1d54c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1d545 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263670.228670:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000051d62c32/0xce1582440fb1d54c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1d545 expref: 11 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263670.228677:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000045bd3abf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a76ccf-c64c-4b18-8369-a2861ec3956c+11:3620:x1876178897998720:12345-0@lo:103: Request processed in 71us (152us total) trans 0 rc 0/0 00010000:00010000:0.0:1789263670.228679:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000051d62c32/0xce1582440fb1d54c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d545 expref: 11 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263670.228691:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000051d62c32, rc 0) 00000100:00100000:2.0:1789263670.228694:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789263670.228724:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005c0e61e8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:66a76ccf-c64c-4b18-8369-a2861ec3956c:3620:1876178897998720:0@lo:103: 00000100:00100000:0.0:1789263670.228735:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003a55e1b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+10:7415:x1876178897998592:12345-0@lo:101: Request processed in 105us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263670.228741:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789263670.228785:0:7415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000047072755 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:7415:1876178897998592:0@lo:101: 00010000:00010000:3.0:1789263670.228804:0:7415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: 00000000d4c8d12a/0xce1582440fb1d545 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d54c expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263670.228812:0:7415:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: 00000000d4c8d12a/0xce1582440fb1d545 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1d54c expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789263670.228828:0:7415:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789263670.228843:0:7415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: 00000000d4c8d12a/0xce1582440fb1d545 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d54c expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263670.228851:0:7415:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: 00000000d4c8d12a/0xce1582440fb1d545 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d54c expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789263670.228859:0:7415:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9dd9c0889800 10000000:01000000:3.0:1789263670.228863:0:7415:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1789263670.228866:0:7415:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9dd9c0889800 from 1 10000000:01000000:3.0:1789263670.228868:0:7415:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1789263670.228883:0:7415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: 00000000fc4986b9/0xce1582440fb1d553 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263670.228890:0:7415:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: 00000000fc4986b9/0xce1582440fb1d553 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263670.228896:0:7415:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: 00000000fc4986b9/0xce1582440fb1d553 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263670.228907:0:7415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001c272b2d pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:7415:1876178897998848:0@lo:101: 00000100:00100000:3.0:1789263670.228938:0:7415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263670.228952:0:7415:0:(client.c:2715:ptlrpc_set_wait()) set 000000003bf07ab1 going to sleep for 11 seconds 00000100:00100000:0.0:1789263670.228966:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178897998848 00000100:00100000:0.0:1789263670.228970:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178897998848 00000100:00100000:0.0:1789263670.228997:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789263670.229004:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000027de94ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+10:7415:x1876178897998848:12345-0@lo:101: 00010000:00010000:0.0:1789263670.229011:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263670.229019:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000db67ccb7/0xce1582440fb1d55a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1d553 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263670.229041:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000db67ccb7/0xce1582440fb1d55a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1d553 expref: 11 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263670.229049:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000db67ccb7/0xce1582440fb1d55a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d553 expref: 11 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263670.229056:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000db67ccb7, rc 0) 00000100:00100000:3.0:1789263670.229124:0:7415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001c272b2d pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:7415:1876178897998848:0@lo:101: 00010000:00010000:3.0:1789263670.229140:0:7415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: 00000000fc4986b9/0xce1582440fb1d553 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d55a expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263670.229146:0:7415:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: 00000000fc4986b9/0xce1582440fb1d553 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1d55a expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263670.229146:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000027de94ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+11:7415:x1876178897998848:12345-0@lo:101: Request processed in 143us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263670.229152:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 10000000:01000000:3.0:1789263670.229158:0:7415:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1789263670.229178:0:7415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: 00000000fc4986b9/0xce1582440fb1d553 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d55a expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263670.229188:0:7415:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: 00000000fc4986b9/0xce1582440fb1d553 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d55a expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789263670.229194:0:7415:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1789263670.229297:0:7415:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789263670.229306:0:7415:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9dd9c0889800 10000000:01000000:2.0:1789263670.229308:0:7415:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1789263670.229310:0:7415:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1789263670.229312:0:7415:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1789263670.229323:0:7415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: 000000004326b965/0xce1582440fb1d561 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263670.229328:0:7415:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: 000000004326b965/0xce1582440fb1d561 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263670.229332:0:7415:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: 000000004326b965/0xce1582440fb1d561 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263670.229340:0:7415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005c0e61e8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:7415:1876178897998976:0@lo:101: 00000100:00100000:2.0:1789263670.229360:0:7415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263670.229388:0:7415:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fb3e5149 going to sleep for 11 seconds 00000100:00100000:0.0:1789263670.229395:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178897998976 00000100:00100000:0.0:1789263670.229401:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178897998976 00000100:00100000:0.0:1789263670.229430:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789263670.229436:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000809d175d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+11:7415:x1876178897998976:12345-0@lo:101: 00010000:00010000:0.0:1789263670.229443:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263670.229451:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000049e7aa8b/0xce1582440fb1d568 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1d561 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263670.229462:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000049e7aa8b/0xce1582440fb1d568 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1d561 expref: 12 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263670.229469:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000049e7aa8b/0xce1582440fb1d568 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d561 expref: 12 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263670.229475:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000049e7aa8b, rc 0) 00000100:00100000:0.0:1789263670.229599:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000809d175d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+12:7415:x1876178897998976:12345-0@lo:101: Request processed in 163us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263670.229606:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789263670.229620:0:7415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005c0e61e8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:7415:1876178897998976:0@lo:101: 00010000:00010000:2.0:1789263670.229633:0:7415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: 000000004326b965/0xce1582440fb1d561 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d568 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263670.229641:0:7415:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: 000000004326b965/0xce1582440fb1d561 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1d568 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263670.229715:0:7415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005c0e61e8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:7415:1876178897999104:0@lo:501: 00000100:00100000:2.0:1789263670.229737:0:7415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263670.229749:0:7415:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fb3e5149 going to sleep for 11 seconds 00000100:00100000:0.0:1789263670.229758:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178897999104 00000100:00100000:0.0:1789263670.229763:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178897999104 00000100:00100000:0.0:1789263670.229818:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789263670.229824:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000060b93c22 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+12:7415:x1876178897999104:12345-0@lo:501: 00000100:00100000:0.0:1789263670.229925:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000060b93c22 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+12:7415:x1876178897999104:12345-0@lo:501: Request processed in 102us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263670.229933:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789263670.229946:0:7415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005c0e61e8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:7415:1876178897999104:0@lo:501: 00000100:00100000:2.0:1789263670.229975:0:7415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005c0e61e8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:7415:1876178897999232:0@lo:503: 00000100:00100000:2.0:1789263670.230022:0:7415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263670.230037:0:7415:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fb3e5149 going to sleep for 11 seconds 00000100:00100000:0.0:1789263670.230043:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178897999232 00000100:00100000:0.0:1789263670.230048:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178897999232 00000100:00100000:0.0:1789263670.230182:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789263670.230189:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001c59958e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+12:7415:x1876178897999232:12345-0@lo:503: 00000100:00100000:0.0:1789263670.230269:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001c59958e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+12:7415:x1876178897999232:12345-0@lo:503: Request processed in 81us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263670.230278:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789263670.230288:0:7415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005c0e61e8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:7415:1876178897999232:0@lo:503: 00000040:00080000:2.0:1789263670.230555:0:7415:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789263670.230632:0:7415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005c0e61e8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:7415:1876178897999360:0@lo:502: 00000100:00100000:2.0:1789263670.230665:0:7415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263670.230687:0:7415:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fb3e5149 going to sleep for 11 seconds 00000100:00100000:0.0:1789263670.230698:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178897999360 00000100:00100000:0.0:1789263670.230703:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178897999360 00000100:00100000:0.0:1789263670.230759:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789263670.230766:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000007b94e6c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+12:7415:x1876178897999360:12345-0@lo:502: 00000100:00100000:0.0:1789263670.230837:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000007b94e6c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+12:7415:x1876178897999360:12345-0@lo:502: Request processed in 72us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263670.230845:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789263670.230848:0:7415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005c0e61e8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:7415:1876178897999360:0@lo:502: 00000040:00080000:2.0:1789263670.231061:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1789263670.231097:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:2.0:1789263670.231109:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:2.0:1789263670.231117:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:2.0:1789263670.231126:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:2.0:1789263670.231135:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:2.0:1789263670.231142:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:2.0:1789263670.231153:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:2.0:1789263670.231166:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:2.0:1789263670.231179:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:2.0:1789263670.231192:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:2.0:1789263670.231206:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:2.0:1789263670.231220:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:2.0:1789263670.231233:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:2.0:1789263670.231247:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:2.0:1789263670.231259:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:2.0:1789263670.231266:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:2.0:1789263670.231273:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:2.0:1789263670.231280:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:2.0:1789263670.231288:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:2.0:1789263670.231304:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:2.0:1789263670.231318:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:2.0:1789263670.231341:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:2.0:1789263670.231359:0:7415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005c0e61e8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:7415:1876178897999488:0@lo:502: 00000100:00100000:2.0:1789263670.231395:0:7415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263670.231410:0:7415:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fb3e5149 going to sleep for 11 seconds 00000100:00100000:0.0:1789263670.231426:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178897999488 00000100:00100000:0.0:1789263670.231431:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178897999488 00000100:00100000:0.0:1789263670.231461:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789263670.231467:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cc45d7ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+12:7415:x1876178897999488:12345-0@lo:502: 00000100:00100000:0.0:1789263670.231623:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cc45d7ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+12:7415:x1876178897999488:12345-0@lo:502: Request processed in 156us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263670.231641:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789263670.231718:0:7415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005c0e61e8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:7415:1876178897999488:0@lo:502: 00000040:00080000:2.0:1789263670.231752:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:2.0:1789263670.231759:0:7415:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:2.0:1789263670.232188:0:7429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789263670.232199:0:7429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263670.232201:0:7429:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1789263670.232205:0:7429:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1789263670.232208:0:7429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789263670.232223:0:7429:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (000000007725dbda) 00000020:00000080:2.0:1789263670.232244:0:7429:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:2.0:1789263670.232250:0:7429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1789263670.232418:0:7429:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789263670.232425:0:7429:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xce1582440fb1d576 00000020:00000080:2.0:1789263670.232654:0:7429:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1789263670.232657:0:7429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789263670.232659:0:7429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263670.232660:0:7429:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1789263670.232661:0:7429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789263670.232664:0:7429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263670.232665:0:7429:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1789263670.232667:0:7429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789263670.232673:0:7429:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (000000000b210c38) 00000020:00000080:2.0:1789263670.232680:0:7429:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:2.0:1789263670.232682:0:7429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1789263670.232684:0:7429:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1789263670.232686:0:7429:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1789263670.232691:0:7429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789263670.232731:0:7429:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000df8d6a98 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1789263670.232742:0:7429:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (00000000f8b5f699) 00000020:00000080:2.0:1789263670.232748:0:7429:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:2.0:1789263670.232801:0:7429:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1789263670.232812:0:7429:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xce1582440fb1d58b 00000020:00000080:2.0:1789263670.232885:0:7429:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1789263670.232890:0:7429:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1789263670.232893:0:7429:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xce1582440fb1d592 00080000:01000000:2.0:1789263670.232897:0:7429:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:2.0:1789263670.232900:0:7429:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xce1582440fb1d599 00080000:10000000:2.0:1789263670.233278:0:7429:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:2.0:1789263670.233424:0:7429:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:2.0:1789263670.287817:0:7429:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:2.0:1789263670.288035:0:7429:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:2.0:1789263670.289939:0:7429:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1789263670.290318:0:7429:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1789263670.297370:0:7429:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1789263670.297398:0:7429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789263670.297405:0:7429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789263670.297408:0:7429:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1789263670.297413:0:7429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789263670.297421:0:7429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789263670.297423:0:7429:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1789263670.297443:0:7429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789263670.297450:0:7429:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.120@tcp to nid 0x20000c0a8cb78 (192.168.203.120@tcp) 00000020:00000080:1.0:1789263670.297478:0:7429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789263670.297497:0:7429:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (000000007aea0035) 00000020:00000080:1.0:1789263670.297523:0:7429:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1789263670.297530:0:7429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789263670.297615:0:7429:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1789263670.297624:0:7429:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:1.0:1789263670.297633:0:7429:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xce1582440fb1d5a7 00010000:00080000:1.0:1789263670.297685:0:7429:0:(ldlm_lib.c:102:import_set_conn()) imp 000000002ee4c24c@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.120@tcp at head 00010000:00010000:1.0:1789263670.300240:0:7429:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:3.0:1789263670.301355:0:7429:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789263670.301387:0:7429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1789263670.301461:0:7429:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789263670.301493:0:7429:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xce1582440fb1d5ae 00000100:00080000:3.0:1789263670.301510:0:7429:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789263670.301516:0:7429:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 000000002ee4c24c using connection 192.168.203.120@tcp/0@lo 00000100:00100000:3.0:1789263670.301563:0:7429:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000001c272b2d x1876178897999616/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789263670.301600:0:7429:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789263670.301734:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001c272b2d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1876178897999616:0@lo:38: 00000020:01000000:3.0:1789263670.301737:0:7429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789263670.301745:0:7429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789263670.301748:0:7429:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1789263670.301752:0:7429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789263670.301756:0:7429:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1789263670.301759:0:7429:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789263670.301768:0:7429:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789263670.301770:0:7429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789263670.301774:0:7429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789263670.301776:0:7429:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789263670.301779:0:7429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789263670.301786:0:7429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789263670.301787:0:7429:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1789263670.301793:0:7429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1789263670.301834:0:7429:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1789263670.301852:0:7429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789263670.301857:0:7429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789263670.301858:0:7429:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1789263670.301862:0:7429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789263670.301866:0:7429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789263670.301867:0:7429:0:(obd_config.c:1563:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789263670.301872:0:7429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789263670.301874:0:7429:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789263670.301915:0:7429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789263670.301920:0:7429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789263670.301921:0:7429:0:(obd_config.c:1563:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789263670.301925:0:7429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000020:01000000:3.0:1789263670.302140:0:7415:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 00000100:00100000:0.0:1789263670.302184:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:3.0:1789263670.302202:0:7415:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1789263670.302227:0:7415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: 000000004326b965/0xce1582440fb1d561 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d568 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263670.302243:0:7415:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: 000000004326b965/0xce1582440fb1d561 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d568 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789263670.302256:0:7415:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9dd9c0889800 from 1 10000000:01000000:3.0:1789263670.302260:0:7415:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00000100:00100000:2.0:1789263670.302293:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cfa477b5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1876178897999744:0@lo:400: 00010000:00010000:3.0:1789263670.302301:0:7415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: 0000000068b043a3/0xce1582440fb1d5b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263670.302307:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178897999616 00000100:00100000:1.0:1789263670.302321:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178897999616 00010000:00010000:3.0:1789263670.302325:0:7415:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: 0000000068b043a3/0xce1582440fb1d5b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263670.302347:0:7415:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: 0000000068b043a3/0xce1582440fb1d5b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263670.302359:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263670.302386:0:7415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000086acda01 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:7415:1876178897999872:0@lo:101: 00000100:00100000:1.0:1789263670.302393:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789263670.302408:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005b338d30 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3617:x1876178897999616:12345-0@lo:38: 00000100:00100000:0.0:1789263670.302435:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178897999744 00010000:00080000:1.0:1789263670.302441:0:6492:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 112 last 0 00000100:00100000:0.0:1789263670.302442:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178897999744 00000100:00100000:3.0:1789263670.302453:0:7415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263670.302489:0:7415:0:(client.c:2715:ptlrpc_set_wait()) set 0000000007504278 going to sleep for 11 seconds 00000020:00000080:1.0:1789263670.302504:0:6492:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xce1582440fb1d5bc 00000004:00100000:1.0:1789263670.302522:0:6492:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1789263670.302528:0:6492:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1789263670.302606:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789263670.302623:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005c0e61e8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1876178897999744:12345-0@lo:400: 00000100:00100000:3.0:1789263670.302634:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789263670.302647:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1789263670.302714:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005c0e61e8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1876178897999744:12345-0@lo:400: Request processed in 99us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263670.302725:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789263670.302773:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000cfa477b5 x1876178897999744/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263686 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263670.302774:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178897999872 00000100:00100000:0.0:1789263670.302782:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178897999872 00000100:00100000:3.0:1789263670.302803:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cfa477b5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1876178897999744:0@lo:400: 00000100:00100000:0.0:1789263670.302826:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789263670.302837:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007d1d5b13 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+12:7415:x1876178897999872:12345-0@lo:101: 00010000:00010000:0.0:1789263670.302848:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263670.302868:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005f2e3c15/0xce1582440fb1d5c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1d5b5 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263670.302896:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005f2e3c15/0xce1582440fb1d5c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1d5b5 expref: 13 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263670.302908:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005f2e3c15/0xce1582440fb1d5c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d5b5 expref: 13 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263670.302920:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005f2e3c15, rc 0) 00000100:00100000:0.0:1789263670.302968:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007d1d5b13 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+13:7415:x1876178897999872:12345-0@lo:101: Request processed in 135us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263670.302975:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789263670.303022:0:7415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000086acda01 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:7415:1876178897999872:0@lo:101: 00010000:00010000:3.0:1789263670.303055:0:7415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: 0000000068b043a3/0xce1582440fb1d5b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d5c3 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263670.303072:0:7415:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: 0000000068b043a3/0xce1582440fb1d5b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1d5c3 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263670.303612:0:7415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000086acda01 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:7415:1876178898000000:0@lo:256: 00000100:00100000:3.0:1789263670.303654:0:7415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263670.303755:0:7415:0:(client.c:2715:ptlrpc_set_wait()) set 0000000007504278 going to sleep for 11 seconds 00000100:00100000:0.0:1789263670.303797:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898000000 00000100:00100000:0.0:1789263670.303804:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898000000 00000100:00100000:0.0:1789263670.303875:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789263670.303886:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d7de5ebc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+13:7415:x1876178898000000:12345-0@lo:256: 20000000:01000000:0.0:1789263670.303907:0:6482:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1789263670.303926:0:6482:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789263670.303931:0:6482:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1789263670.304042:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d7de5ebc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+13:7415:x1876178898000000:12345-0@lo:256: Request processed in 159us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263670.304051:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789263670.304107:0:7415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000086acda01 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:7415:1876178898000000:0@lo:256: 10000000:01000000:2.0:1789263670.304874:0:7415:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789263670.304898:0:7415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: 0000000068b043a3/0xce1582440fb1d5b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d5c3 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263670.304908:0:7415:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: 0000000068b043a3/0xce1582440fb1d5b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d5c3 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789263670.304917:0:7415:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dd9c0889800 from 1 10000000:01000000:2.0:1789263670.304920:0:7415:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789263670.304952:0:7415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: 00000000a72943c1/0xce1582440fb1d5ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263670.305595:0:7415:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: 00000000a72943c1/0xce1582440fb1d5ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263670.305606:0:7415:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: 00000000a72943c1/0xce1582440fb1d5ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263670.305625:0:7415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000073652f0c pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:7415:1876178898000128:0@lo:101: 00000100:00100000:2.0:1789263670.305685:0:7415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263670.305790:0:7415:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e476dd77 going to sleep for 11 seconds 00000100:00100000:1.0:1789263670.305833:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898000128 00000100:00100000:1.0:1789263670.305842:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898000128 00000100:00100000:1.0:1789263670.305895:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789263670.305904:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b97fa6f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+13:7415:x1876178898000128:12345-0@lo:101: 00010000:00010000:1.0:1789263670.305917:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263670.305932:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000085a6aae7/0xce1582440fb1d5d1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1d5ca expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263670.305957:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000085a6aae7/0xce1582440fb1d5d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1d5ca expref: 14 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263670.305979:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000085a6aae7/0xce1582440fb1d5d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d5ca expref: 14 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263670.305989:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000085a6aae7, rc 0) 00000100:00100000:1.0:1789263670.306163:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b97fa6f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+14:7415:x1876178898000128:12345-0@lo:101: Request processed in 261us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263670.306171:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1789263670.306363:0:6492:0:(import.c:65:import_set_state_nolock()) 000000008e468012 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789263670.306477:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005b338d30 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3617:x1876178897999616:12345-0@lo:38: Request processed in 4074us (4304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263670.306496:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789263670.306560:0:7415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000073652f0c pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:7415:1876178898000128:0@lo:101: 00010000:00010000:3.0:1789263670.306577:0:7415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: 00000000a72943c1/0xce1582440fb1d5ca lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d5d1 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263670.306593:0:7415:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: 00000000a72943c1/0xce1582440fb1d5ca lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1d5d1 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263670.306713:0:7415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e93023b4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:7415:1876178898000256:0@lo:501: 00000100:00100000:3.0:1789263670.306742:0:7415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263670.306774:0:7415:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fd18218b going to sleep for 11 seconds 00000100:00100000:0.0:1789263670.306824:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898000256 00000100:00100000:0.0:1789263670.306829:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898000256 00000100:00100000:0.0:1789263670.306860:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789263670.306866:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000d6fcaf3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+14:7415:x1876178898000256:12345-0@lo:501: 00000100:00100000:0.0:1789263670.306972:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000d6fcaf3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+14:7415:x1876178898000256:12345-0@lo:501: Request processed in 107us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263670.306980:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789263670.307345:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789263670.307356:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1789263670.307365:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1789263670.307370:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789263670.307382:0:3617:0:(import.c:65:import_set_state_nolock()) 000000002ee4c24c lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789263670.307441:0:7415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e93023b4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:7415:1876178898000256:0@lo:501: 00000100:00100000:2.0:1789263670.307461:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001c272b2d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1876178897999616:0@lo:38: 00000100:00100000:1.0:1789263670.307482:0:7415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e611fee0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:7415:1876178898000384:0@lo:503: 00000100:00100000:2.0:1789263670.307526:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789263670.307531:0:7415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263670.307537:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008dafc841 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898000512:0@lo:41: 00000100:00100000:1.0:1789263670.307564:0:7415:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e5e6c74b going to sleep for 11 seconds 00000100:00100000:2.0:1789263670.307574:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263670.307584:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898000384 00000100:00100000:3.0:1789263670.307589:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898000384 00000100:00100000:3.0:1789263670.307656:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789263670.307664:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b90feebf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+14:7415:x1876178898000384:12345-0@lo:503: 00000040:00080000:3.0:1789263670.307701:0:6481:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789263670.307746:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b90feebf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+14:7415:x1876178898000384:12345-0@lo:503: Request processed in 84us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263670.307753:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789263670.307790:0:7415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e611fee0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:7415:1876178898000384:0@lo:503: 00000100:00100000:0.0:1789263670.307820:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898000512 00000100:00100000:0.0:1789263670.307824:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898000512 00000100:00100000:0.0:1789263670.307847:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789263670.307852:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000278ef6b0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3619:x1876178898000512:12345-0@lo:41: 00000004:00000024:0.0:1789263670.307876:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:0.0:1789263670.307918:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000278ef6b0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3619:x1876178898000512:12345-0@lo:41: Request processed in 66us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263670.307933:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789263670.307951:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008dafc841 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898000512:0@lo:41: 00000040:00080000:2.0:1789263670.308188:0:7415:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789263670.308246:0:7415:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:2.0:1789263670.308311:0:7415:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789263670.309040:0:7435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:1.0:1789263670.309228:0:7415:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1789263670.309254:0:7415:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789263670.309270:0:7415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: 00000000a72943c1/0xce1582440fb1d5ca lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d5d1 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263670.309283:0:7415:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: 00000000a72943c1/0xce1582440fb1d5ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d5d1 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789263670.309337:0:7415:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789263670.309339:0:7415:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9dd9c0889800 10000000:01000000:1.0:1789263670.309343:0:7415:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9dd9c0889800 10000000:01000000:1.0:1789263670.309346:0:7415:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789263670.309351:0:7415:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9dd9c0889800 from 1 10000000:01000000:1.0:1789263670.309353:0:7415:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789263670.309395:0:7415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: 00000000029952b1/0xce1582440fb1d5d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263670.309414:0:7415:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: 00000000029952b1/0xce1582440fb1d5d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263670.309425:0:7415:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: 00000000029952b1/0xce1582440fb1d5d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263670.309443:0:7415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e24697ee pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:7415:1876178898000640:0@lo:101: 00000100:00100000:1.0:1789263670.309495:0:7415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263670.309530:0:7415:0:(client.c:2715:ptlrpc_set_wait()) set 0000000044960f48 going to sleep for 11 seconds 00000100:00100000:3.0:1789263670.309693:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898000640 00000100:00100000:3.0:1789263670.309700:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898000640 00000100:00100000:3.0:1789263670.309732:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789263670.309739:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003b19ab04 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+14:7415:x1876178898000640:12345-0@lo:101: 00010000:00010000:3.0:1789263670.309751:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263670.309764:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fce086e6/0xce1582440fb1d5df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1d5d8 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263670.309786:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fce086e6/0xce1582440fb1d5df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1d5d8 expref: 15 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263670.309795:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fce086e6/0xce1582440fb1d5df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d5d8 expref: 15 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263670.309810:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fce086e6, rc 0) 00000100:00100000:3.0:1789263670.309843:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003b19ab04 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+15:7415:x1876178898000640:12345-0@lo:101: Request processed in 105us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263670.309850:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789263670.309864:0:7415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e24697ee pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:7415:1876178898000640:0@lo:101: 00010000:00010000:1.0:1789263670.309876:0:7415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: 00000000029952b1/0xce1582440fb1d5d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d5df expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263670.309885:0:7415:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: 00000000029952b1/0xce1582440fb1d5d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1d5df expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263670.309960:0:7415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e24697ee pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:7415:1876178898000768:0@lo:501: 00000100:00100000:1.0:1789263670.309987:0:7415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263670.310006:0:7415:0:(client.c:2715:ptlrpc_set_wait()) set 0000000044960f48 going to sleep for 11 seconds 00000100:00100000:3.0:1789263670.310026:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898000768 00000100:00100000:3.0:1789263670.310030:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898000768 00000100:00100000:3.0:1789263670.310058:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789263670.310063:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009815f6dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+15:7415:x1876178898000768:12345-0@lo:501: 00000100:00100000:3.0:1789263670.310203:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009815f6dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+15:7415:x1876178898000768:12345-0@lo:501: Request processed in 140us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263670.310210:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789263670.310224:0:7415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e24697ee pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:7415:1876178898000768:0@lo:501: 00000100:00100000:1.0:1789263670.310249:0:7415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e24697ee pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:7415:1876178898000896:0@lo:503: 00000100:00100000:1.0:1789263670.310281:0:7415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263670.310306:0:7415:0:(client.c:2715:ptlrpc_set_wait()) set 0000000044960f48 going to sleep for 11 seconds 00000100:00100000:3.0:1789263670.310352:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898000896 00000100:00100000:3.0:1789263670.310356:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898000896 00000100:00100000:3.0:1789263670.310385:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789263670.310391:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c124f706 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+15:7415:x1876178898000896:12345-0@lo:503: 00000100:00100000:3.0:1789263670.310460:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c124f706 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+15:7415:x1876178898000896:12345-0@lo:503: Request processed in 69us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263670.310466:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789263670.310469:0:7415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e24697ee pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:7415:1876178898000896:0@lo:503: 00000040:00080000:1.0:1789263670.310708:0:7415:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789263670.310780:0:7415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e24697ee pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:7415:1876178898001024:0@lo:502: 00000100:00100000:1.0:1789263670.310802:0:7415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263670.310817:0:7415:0:(client.c:2715:ptlrpc_set_wait()) set 000000006f57c253 going to sleep for 11 seconds 00000100:00100000:3.0:1789263670.310831:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898001024 00000100:00100000:3.0:1789263670.310835:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898001024 00000100:00100000:3.0:1789263670.310855:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789263670.310861:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000744e9adf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+15:7415:x1876178898001024:12345-0@lo:502: 00000100:00100000:3.0:1789263670.310933:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000744e9adf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+15:7415:x1876178898001024:12345-0@lo:502: Request processed in 73us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263670.310941:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789263670.310944:0:7415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e24697ee pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:7415:1876178898001024:0@lo:502: 00000040:00080000:1.0:1789263670.311176:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1789263670.311202:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1789263670.311217:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1789263670.311232:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1789263670.311247:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1789263670.311257:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1789263670.311269:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1789263670.311282:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1789263670.311293:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1789263670.311305:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1789263670.311317:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1789263670.311328:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1789263670.311341:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1789263670.311354:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1789263670.311392:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1789263670.311409:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1789263670.311422:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1789263670.311435:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1789263670.311448:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1789263670.311469:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1789263670.311484:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1789263670.311498:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1789263670.311511:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1789263670.311525:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1789263670.311538:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1789263670.311550:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1789263670.311563:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1789263670.311585:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:1.0:1789263670.311605:0:7415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e24697ee pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:7415:1876178898001152:0@lo:502: 00000100:00100000:1.0:1789263670.311642:0:7415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263670.311668:0:7415:0:(client.c:2715:ptlrpc_set_wait()) set 0000000044960f48 going to sleep for 11 seconds 00000100:00100000:3.0:1789263670.311686:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898001152 00000100:00100000:3.0:1789263670.311697:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898001152 00000100:00100000:3.0:1789263670.311729:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789263670.311737:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fb5d90ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+15:7415:x1876178898001152:12345-0@lo:502: 00000100:00100000:3.0:1789263670.311812:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fb5d90ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+15:7415:x1876178898001152:12345-0@lo:502: Request processed in 76us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263670.311819:0:7415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e24697ee pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:7415:1876178898001152:0@lo:502: 00000100:00100000:3.0:1789263670.311822:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000040:00080000:1.0:1789263670.311863:0:7415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1789263670.311869:0:7415:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1789263670.312303:0:7436:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1789263670.312333:0:7436:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (00000000deceabd5) 00000020:00000080:1.0:1789263670.312357:0:7436:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1789263670.312472:0:7436:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000df8d6a98 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1789263670.312477:0:7436:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000df8d6a98 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1789263670.312480:0:7436:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000df8d6a98 3 00010000:00080000:1.0:1789263670.312515:0:7436:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000b7ac38ad@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.120@tcp at head 00010000:00010000:1.0:1789263670.314535:0:7436:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:1.0:1789263670.314754:0:7436:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1789263670.314798:0:7436:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789263670.314811:0:7436:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xce1582440fb1d5ed 00000100:00080000:1.0:1789263670.314820:0:7436:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789263670.314825:0:7436:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 00000000b7ac38ad using connection 192.168.203.120@tcp/0@lo 00000100:00100000:1.0:1789263670.314864:0:7436:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000e24697ee x1876178898001280/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789263670.314884:0:7436:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789263670.315009:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e24697ee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3617:1876178898001280:0@lo:38: 00000100:00100000:0.0:1789263670.315136:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263670.315361:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898001280 00000100:00100000:1.0:1789263670.315385:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898001280 00000100:00100000:1.0:1789263670.315435:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789263670.315448:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003d416b06 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3617:x1876178898001280:12345-0@lo:38: 00010000:00080000:1.0:1789263670.315477:0:6489:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 112 last 0 00000020:00000080:1.0:1789263670.315543:0:6489:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xce1582440fb1d5f4 00000004:00100000:1.0:1789263670.315558:0:6489:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789263670.315592:0:6489:0:(import.c:65:import_set_state_nolock()) 000000000dabd1fd : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789263670.315670:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003d416b06 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1876178898001280:12345-0@lo:38: Request processed in 226us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263670.315678:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789263670.315788:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000e24697ee x1876178898001280/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789263680 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263670.315803:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000040:00080000:1.0:1789263670.315810:0:7436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000100:00080000:3.0:1789263670.315813:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1789263670.315824:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1789263670.315831:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789263670.315834:0:3617:0:(import.c:65:import_set_state_nolock()) 00000000b7ac38ad lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789263670.315850:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e24697ee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3617:1876178898001280:0@lo:38: 40000000:00080000:3.0:1789263670.315956:0:7437:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000020:01000000:0.0:1789263670.316038:0:7415:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1789263670.316171:0:7415:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789263670.316235:0:7415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: 00000000029952b1/0xce1582440fb1d5d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d5df expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263670.316247:0:7415:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: 00000000029952b1/0xce1582440fb1d5d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d5df expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789263670.316310:0:7415:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789263670.316313:0:7415:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789263670.316314:0:7415:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789263670.316316:0:7415:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789263670.316317:0:7415:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789263670.316318:0:7415:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789263670.316320:0:7415:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789263670.316321:0:7415:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789263670.316322:0:7415:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789263670.316324:0:7415:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789263670.316325:0:7415:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789263670.316329:0:7415:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:0.0:1789263670.316332:0:7415:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789263670.316333:0:7415:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789263670.316334:0:7415:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789263670.316335:0:7415:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789263670.316336:0:7415:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789263670.316337:0:7415:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789263670.316338:0:7415:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789263670.316339:0:7415:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789263670.316340:0:7415:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789263670.316341:0:7415:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789263670.316342:0:7415:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789263670.316360:0:7415:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1789263670.316397:0:7415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fe85f2b7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:7415:1876178898001408:0@lo:253: 00000100:00100000:0.0:1789263670.316451:0:7415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263670.316493:0:7415:0:(client.c:2715:ptlrpc_set_wait()) set 000000008c078061 going to sleep for 11 seconds 00000100:00100000:3.0:1789263670.316532:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898001408 00000100:00100000:3.0:1789263670.316542:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898001408 00000100:00100000:3.0:1789263670.316600:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789263670.316611:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b2069978 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+15:7415:x1876178898001408:12345-0@lo:253: 20000000:01000000:3.0:1789263670.316645:0:6481:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1789263670.316665:0:6481:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:0.0:1789263670.318247:0:6466:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1789263670.318510:0:6481:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789263670.318533:0:6481:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1789263670.318571:0:6503:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789263670.318577:0:6503:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789263670.318597:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000edd439af/0xce1582440fb1d5fb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263670.318612:0:6503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000fac6a03c/0xce1582440fb1d51b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d514 expref: 15 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263670.318619:0:6503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000005f2e3c15/0xce1582440fb1d5c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d5b5 expref: 15 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263670.318625:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000edd439af/0xce1582440fb1d5fb lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263670.318661:0:6503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000005f2e3c15/0xce1582440fb1d5c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce1582440fb1d5b5 expref: 15 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263670.318674:0:6503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000005f2e3c15/0xce1582440fb1d5c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce1582440fb1d5b5 expref: 15 pid: 6481 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263670.318686:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005c3a3f99 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6503:1876178898001536:0@lo:104: 00000100:00100000:0.0:1789263670.318741:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789263670.318808:0:6503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000fac6a03c/0xce1582440fb1d51b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce1582440fb1d514 expref: 15 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263670.318817:0:6503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000fac6a03c/0xce1582440fb1d51b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce1582440fb1d514 expref: 15 pid: 6480 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263670.318839:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000045297fa1 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6503:1876178898001664:0@lo:104: 00000100:00100000:0.0:1789263670.318864:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263670.318886:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set 0000000041d64b03 going to sleep for 11 seconds 00000100:00100000:3.0:1789263670.318926:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898001536 00000100:00100000:3.0:1789263670.318935:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898001536 00000100:00100000:3.0:1789263670.318978:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898001664 00000100:00100000:3.0:1789263670.318983:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898001664 00000100:00100000:3.0:1789263670.319007:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789263670.319023:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001981ce8c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:66a76ccf-c64c-4b18-8369-a2861ec3956c+4:6503:x1876178898001536:12345-0@lo:104: 00010000:00010000:3.0:1789263670.319035:0:6470:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: 0000000068b043a3/0xce1582440fb1d5b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1d5c3 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263670.319132:0:6470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789263670.319139:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001981ce8c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:66a76ccf-c64c-4b18-8369-a2861ec3956c+4:6503:x1876178898001536:12345-0@lo:104: Request processed in 118us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263670.319147:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1789263670.319152:0:7427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263670.319160:0:7427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: 0000000068b043a3/0xce1582440fb1d5b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1d5c3 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263670.319169:0:7427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000068b043a3 already unused, calling callback (000000000c943745) 00000100:00100000:3.0:1789263670.319173:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 10000000:00010000:1.0:1789263670.319173:0:7427:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: 0000000068b043a3/0xce1582440fb1d5b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xce1582440fb1d5c3 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263670.319187:0:7427:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: 0000000068b043a3/0xce1582440fb1d5b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xce1582440fb1d5c3 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263670.319188:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002e7110ba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:66a76ccf-c64c-4b18-8369-a2861ec3956c+3:6503:x1876178898001664:12345-0@lo:104: 10000000:00010000:1.0:1789263670.319202:0:7427:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: 0000000068b043a3/0xce1582440fb1d5b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xce1582440fb1d5c3 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263670.319203:0:6470:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: 00000000cc0b4776/0xce1582440fb1d514 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1d51b expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789263670.319218:0:7427:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789263670.319253:0:7427:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: 0000000068b043a3/0xce1582440fb1d5b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d5c3 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263670.319258:0:6470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1789263670.319261:0:7427:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789263670.319265:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002e7110ba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:66a76ccf-c64c-4b18-8369-a2861ec3956c+3:6503:x1876178898001664:12345-0@lo:104: Request processed in 82us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263670.319274:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1789263670.319296:0:7427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: 0000000068b043a3/0xce1582440fb1d5b5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d5c3 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263670.319297:0:6475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789263670.319304:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: 00000000cc0b4776/0xce1582440fb1d514 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1d51b expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263670.319305:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c3af859f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:66a76ccf-c64c-4b18-8369-a2861ec3956c:3619:1876178898001792:0@lo:103: 00010000:00010000:1.0:1789263670.319319:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: 0000000068b043a3/0xce1582440fb1d5b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d5c3 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263670.319334:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000cc0b4776 already unused, calling callback (000000000c943745) 10000000:00010000:3.0:1789263670.319339:0:6475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: 00000000cc0b4776/0xce1582440fb1d514 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xce1582440fb1d51b expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263670.319348:0:6475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: 00000000cc0b4776/0xce1582440fb1d514 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xce1582440fb1d51b expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263670.319350:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263670.319353:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:3.0:1789263670.319358:0:6475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: 00000000cc0b4776/0xce1582440fb1d514 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xce1582440fb1d51b expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263670.319359:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789263670.319387:0:6475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:2.0:1789263670.319404:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789263670.319413:0:6475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: 00000000cc0b4776/0xce1582440fb1d514 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d51b expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263670.319422:0:6475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789263670.319454:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: 00000000cc0b4776/0xce1582440fb1d514 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d51b expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263670.319463:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: 00000000cc0b4776/0xce1582440fb1d514 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d51b expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263670.319489:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263670.319492:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789263670.319494:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005c3a3f99 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6503:1876178898001536:0@lo:104: 00010000:00010000:3.0:1789263670.319495:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789263670.319505:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789263670.319511:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000045297fa1 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6503:1876178898001664:0@lo:104: 00000100:00100000:3.0:1789263670.319527:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fe8fb4b1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:66a76ccf-c64c-4b18-8369-a2861ec3956c:3621:1876178898001920:0@lo:103: 00010000:00010000:0.0:1789263670.319540:0:6503:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000edd439af/0xce1582440fb1d5fb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263670.319573:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263670.319611:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898001792 00000100:00100000:1.0:1789263670.319617:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898001792 00010000:00010000:1.0:1789263670.319638:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000005f2e3c15/0xce1582440fb1d5c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1d5b5 expref: 16 pid: 6481 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263670.319666:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b2069978 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+16:7415:x1876178898001408:12345-0@lo:253: Request processed in 3057us (3214us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263670.319674:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789263670.319713:0:7415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fe85f2b7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:7415:1876178898001408:0@lo:253: 10000000:01000000:3.0:1789263670.319723:0:7415:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1789263670.319725:0:7415:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000100:00100000:1.0:1789263670.319756:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898001920 00000100:00100000:1.0:1789263670.319761:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898001920 00000100:00100000:2.0:1789263670.319770:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789263670.319783:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009789a751 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a76ccf-c64c-4b18-8369-a2861ec3956c+16:3619:x1876178898001792:12345-0@lo:103: 00010000:00010000:1.0:1789263670.319783:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000fac6a03c/0xce1582440fb1d51b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1d514 expref: 16 pid: 6480 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789263670.319798:0:7415:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789263670.319803:0:7415:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789263670.319808:0:7415:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789263670.319809:0:7415:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00010000:00010000:2.0:1789263670.319813:0:6472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:01000004:3.0:1789263670.319815:0:7415:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789263670.319822:0:7415:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789263670.319825:0:7415:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00010000:00010000:2.0:1789263670.319827:0:6472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000005f2e3c15/0xce1582440fb1d5c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1d5b5 expref: 16 pid: 6481 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263670.319839:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000020:01000004:3.0:1789263670.319840:0:7415:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789263670.319848:0:7415:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789263670.319856:0:7415:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00010000:2.0:1789263670.319866:0:6472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000005f2e3c15/0xce1582440fb1d5c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce1582440fb1d5b5 expref: 16 pid: 6481 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263670.319873:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000033bdb641 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a76ccf-c64c-4b18-8369-a2861ec3956c+16:3621:x1876178898001920:12345-0@lo:103: 00000020:02000000:3.0:1789263670.319876:0:7415:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1789263670.319901:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789263670.319904:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005f2e3c15/0xce1582440fb1d5c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce1582440fb1d5b5 expref: 16 pid: 6481 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263670.319915:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000fac6a03c/0xce1582440fb1d51b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1d514 expref: 16 pid: 6480 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263670.319926:0:6472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789263670.319933:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000fac6a03c/0xce1582440fb1d51b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce1582440fb1d514 expref: 15 pid: 6480 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263670.319963:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009789a751 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a76ccf-c64c-4b18-8369-a2861ec3956c+15:3619:x1876178898001792:12345-0@lo:103: Request processed in 184us (564us total) trans 0 rc 0/0 00010000:00010000:1.0:1789263670.319968:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000fac6a03c/0xce1582440fb1d51b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce1582440fb1d514 expref: 15 pid: 6480 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263670.319975:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1789263670.320003:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000edd439af/0xce1582440fb1d5fb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263670.320011:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000edd439af/0xce1582440fb1d5fb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263670.320020:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c3af859f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:66a76ccf-c64c-4b18-8369-a2861ec3956c:3619:1876178898001792:0@lo:103: 20000000:01000000:1.0:1789263670.320052:0:6474:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001475076s 00010000:00010000:1.0:1789263670.320056:0:6474:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000edd439af/0xce1582440fb1d5fb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263670.320066:0:6474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000edd439af/0xce1582440fb1d5fb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263670.320072:0:6474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000edd439af/0xce1582440fb1d5fb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263670.320112:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000edd439af/0xce1582440fb1d5fb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263670.320119:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000edd439af already unused, calling callback (000000000583e00c) 00010000:00010000:1.0:1789263670.320126:0:6474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000edd439af/0xce1582440fb1d5fb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263670.320135:0:6474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000edd439af/0xce1582440fb1d5fb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263670.320154:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000edd439af/0xce1582440fb1d5fb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263670.320167:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789263670.320236:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000033bdb641 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a76ccf-c64c-4b18-8369-a2861ec3956c+13:3621:x1876178898001920:12345-0@lo:103: Request processed in 376us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263670.320245:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1789263670.320303:0:6503:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000edd439af/0xce1582440fb1d5fb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263670.320321:0:6503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000edd439af/0xce1582440fb1d5fb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263670.320327:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000edd439af/0xce1582440fb1d5fb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263670.321044:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fe8fb4b1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:66a76ccf-c64c-4b18-8369-a2861ec3956c:3621:1876178898001920:0@lo:103: 00080000:10000000:3.0:1789263670.325602:0:7415:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:3.0:1789263670.325862:0:7415:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1789263670.326040:0:7415:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1789263670.326326:0:7415:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1789263670.326517:0:7415:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1789263670.326681:0:7415:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:0.0:1789263670.327463:0:7415:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1789263670.327720:0:7415:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:0.0:1789263670.327892:0:7415:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:0.0:1789263670.328058:0:7415:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:0.0:1789263670.328344:0:7415:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:0.0:1789263670.328534:0:7415:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:0.0:1789263670.331588:0:7415:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:1.0:1789263670.331651:0:7441:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1789263670.331655:0:7441:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:1.0:1789263670.332400:0:7442:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:1.0:1789263670.332444:0:7442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000054c717f1 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7442:1876178898002048:0@lo:700: 00000040:01000000:0.0:1789263670.332619:0:7415:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:1.0:1789263670.332735:0:7442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263670.332782:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898002048 00000100:00100000:2.0:1789263670.332790:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898002048 00000100:00100000:1.0:1789263670.332794:0:7442:0:(client.c:2715:ptlrpc_set_wait()) set 00000000dbfa77c8 going to sleep for 11 seconds 00000100:00100000:2.0:1789263670.332835:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789263670.332842:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ea075935 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7442:x1876178898002048:12345-0@lo:700: 00000100:00100000:3.0:1789263670.333002:0:7443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c8735381 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7443:1876178898002176:0@lo:1000: 00000100:00100000:3.0:1789263670.333041:0:7443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263670.333093:0:7443:0:(client.c:2715:ptlrpc_set_wait()) set 00000000100038ab going to sleep for 11 seconds 00000040:01000000:0.0:1789263670.333338:0:7415:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:0.0:1789263670.333435:0:7415:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1789263670.333829:0:7415:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1789263670.333835:0:7415:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:0.0:1789263670.333964:0:7415:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789263670.334189:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898002176 00000100:00100000:1.0:1789263670.334194:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898002176 00000100:00100000:1.0:1789263670.334230:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789263670.334235:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000040563a67 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7443:x1876178898002176:12345-0@lo:1000: 00000100:00100000:1.0:1789263670.334308:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000040563a67 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7443:x1876178898002176:12345-0@lo:1000: Request processed in 73us (1269us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263670.334313:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789263670.334389:0:7443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c8735381 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7443:1876178898002176:0@lo:1000: 00000040:01000000:3.0:1789263670.334420:0:7443:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:3.0:1789263670.334448:0:7443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c8735381 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7443:1876178898002304:0@lo:700: 00000100:00100000:3.0:1789263670.334481:0:7443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263670.334523:0:7443:0:(client.c:2715:ptlrpc_set_wait()) set 00000000266ca4f5 going to sleep for 11 seconds 00000100:00100000:2.0:1789263670.334592:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898002304 00000100:00100000:2.0:1789263670.334597:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898002304 00000100:00100000:2.0:1789263670.334649:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789263670.334657:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d534f960 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7443:x1876178898002304:12345-0@lo:700: 00000100:00100000:2.0:1789263670.334723:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d534f960 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7443:x1876178898002304:12345-0@lo:700: Request processed in 67us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263670.334730:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789263670.334756:0:7443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c8735381 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7443:1876178898002304:0@lo:700: 00000100:00100000:2.0:1789263670.334802:0:7443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000efbae42d pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7443:1876178898002432:0@lo:900: 00000100:00100000:2.0:1789263670.334832:0:7443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263670.334864:0:7443:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d3a25c31 going to sleep for 11 seconds 00000100:00100000:1.0:1789263670.334886:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898002432 00000100:00100000:1.0:1789263670.334891:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898002432 00000100:00100000:1.0:1789263670.334961:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789263670.334967:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a0075ed1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7443:x1876178898002432:12345-0@lo:900: 00000100:00100000:1.0:1789263670.334999:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a0075ed1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7443:x1876178898002432:12345-0@lo:900: Request processed in 33us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263670.335003:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:00080000:0.0:1789263670.335017:0:7415:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00010000:00080000:2.0:1789263670.335122:0:7443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000efbae42d x1876178898002432/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789263686 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789263670.335134:0:7443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000efbae42d pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7443:1876178898002432:0@lo:900: 00000100:00100000:2.0:1789263670.335210:0:7443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000efbae42d pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7443:1876178898002560:0@lo:1000: 00000100:00100000:2.0:1789263670.335247:0:7443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263670.335265:0:7443:0:(client.c:2715:ptlrpc_set_wait()) set 000000008c6849c7 going to sleep for 11 seconds 00000100:00100000:1.0:1789263670.335277:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898002560 00000100:00100000:1.0:1789263670.335290:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898002560 00000100:00100000:1.0:1789263670.335313:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789263670.335318:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e1299c1a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7443:x1876178898002560:12345-0@lo:1000: 00000100:00100000:1.0:1789263670.335361:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e1299c1a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7443:x1876178898002560:12345-0@lo:1000: Request processed in 44us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263670.335367:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789263670.335396:0:7443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000efbae42d pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7443:1876178898002560:0@lo:1000: 00000040:00080000:0.0:1789263670.335452:0:7415:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1789263670.335476:0:7415:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000004:00080000:3.0:1789263670.335508:0:7443:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000d3a25c31 with version 0 00000020:00100000:3.0:1789263670.335525:0:7443:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1789263670.335530:0:7443:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000a525c5f0 x1876178898002816/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789263670.335544:0:7443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a525c5f0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7443:1876178898002816:0@lo:1000: 00000100:00100000:3.0:1789263670.335574:0:7443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263670.335593:0:7443:0:(client.c:2715:ptlrpc_set_wait()) set 00000000100038ab going to sleep for 11 seconds 00000100:00100000:1.0:1789263670.335600:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898002816 00000100:00100000:1.0:1789263670.335604:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898002816 00000040:00080000:0.0:1789263670.335616:0:7415:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789263670.335629:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789263670.335634:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ae7dbf09 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7443:x1876178898002816:12345-0@lo:1000: 00080000:10000000:0.0:1789263670.335753:0:7415:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1789263670.336350:0:7415:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1789263670.336509:0:7415:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 40000000:02000000:1.0:1789263670.336629:0:6494:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00100000:10000000:0.0:1789263670.336666:0:7415:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1789263670.336798:0:7415:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1789263670.336929:0:7415:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1789263670.337158:0:7415:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1789263670.337250:0:7415:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1789263670.337355:0:7415:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1789263670.337725:0:7415:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1789263670.337842:0:7415:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1789263670.337925:0:7415:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1789263670.338008:0:7415:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1789263670.338134:0:7415:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1789263670.338308:0:7415:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1789263670.338457:0:7415:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1789263670.338540:0:7415:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1789263670.338816:0:7415:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1789263670.338936:0:7415:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1789263670.339017:0:7415:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1789263670.339216:0:7415:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1789263670.339309:0:7415:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1789263670.339432:0:7415:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1789263670.339548:0:7415:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1789263670.339666:0:7415:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1789263670.339747:0:7415:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1789263670.339854:0:7415:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1789263670.339995:0:7415:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1789263670.340196:0:7415:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1789263670.340329:0:7415:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1789263670.340518:0:7415:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1789263670.340625:0:7415:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1789263670.340716:0:7415:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1789263670.340878:0:7415:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1789263670.341468:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ea075935 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7442:x1876178898002048:12345-0@lo:700: Request processed in 8622us (8729us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263670.341495:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789263670.341578:0:7442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000054c717f1 x1876178898002048/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789263686 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263670.341594:0:7442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000054c717f1 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7442:1876178898002048:0@lo:700: 40000000:02000000:0.0:1789263670.341607:0:7442:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000001:00080000:3.0:1789263670.343606:0:6466:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:1.0:1789263670.343781:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ae7dbf09 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7443:x1876178898002816:12345-0@lo:1000: Request processed in 8144us (8205us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1789263670.343792:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:3.0:1789263670.343875:0:7443:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:3.0:1789263670.343888:0:7443:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1789263670.343902:0:7443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a525c5f0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7443:1876178898002816:0@lo:1000: 00000100:00100000:3.0:1789263670.343998:0:7443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a525c5f0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7443:1876178898002944:0@lo:1000: 00000100:00100000:3.0:1789263670.344041:0:7443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263670.344118:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898002944 00000100:00100000:3.0:1789263670.344119:0:7443:0:(client.c:2715:ptlrpc_set_wait()) set 00000000de52ceff going to sleep for 11 seconds 00000100:00100000:2.0:1789263670.344127:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898002944 00000100:00100000:2.0:1789263670.344166:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789263670.344172:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009376656c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7443:x1876178898002944:12345-0@lo:1000: 00000100:00100000:2.0:1789263670.344235:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009376656c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7443:x1876178898002944:12345-0@lo:1000: Request processed in 63us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263670.344239:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789263670.344274:0:7443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a525c5f0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7443:1876178898002944:0@lo:1000: 00000040:00080000:3.0:1789263670.344290:0:7443:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:3.0:1789263670.344316:0:7443:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000100038ab with version 1 00000004:00080000:1.0:1789263670.344364:0:7432:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000984e17f0 version 1 rpc_version 1 00000020:00100000:1.0:1789263670.344394:0:7432:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789263670.344401:0:7432:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000716027d7 x1876178898003200/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789263670.344415:0:7432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000716027d7 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7432:1876178898003200:0@lo:1000: 00000100:00100000:1.0:1789263670.344457:0:7432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263670.344477:0:7432:0:(client.c:2715:ptlrpc_set_wait()) set 0000000026864d2a going to sleep for 11 seconds 00000100:00100000:2.0:1789263670.344624:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898003200 00000100:00100000:2.0:1789263670.344629:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898003200 00000100:00100000:2.0:1789263670.344674:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789263670.344681:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e6ae424e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7432:x1876178898003200:12345-0@lo:1000: 00000001:00080000:1.0:1789263670.345856:0:7415:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1789263670.345913:0:7415:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb38e455c3988 00100000:10000000:1.0:1789263670.345922:0:7415:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1789263670.346491:0:7415:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789263670.346535:0:7415:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.120@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789263670.346560:0:7415:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1789263670.346611:0:7415:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000040:00080000:3.0:1789263670.347120:0:7443:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789263670.347188:0:7443:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000001:00080000:0.0:1789263670.348574:0:6466:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000020:00000004:3.0:1789263670.348828:0:7415:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789263670.349116:0:7415:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00000100:00100000:2.0:1789263670.352284:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e6ae424e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7432:x1876178898003200:12345-0@lo:1000: Request processed in 7599us (7822us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1789263670.352304:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:0.0:1789263670.352413:0:7432:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:0.0:1789263670.352419:0:7432:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1789263670.352527:0:7432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000716027d7 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7432:1876178898003200:0@lo:1000: 00000040:00080000:0.0:1789263670.356611:0:7442:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789263670.363738:0:7442:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789263670.363818:0:7442:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1789263670.363823:0:7442:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:2.0:1789263670.701313:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263671.725259:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789263671.958827:0:7687:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg320-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000020:00000004:2.0:1789263672.329764:0:7739:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789263672.329916:0:7739:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789263672.749310:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789263673.773183:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789263674.056605:0:7840:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789263674.056780:0:7840:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000020:00000080:1.0:1789263674.467866:0:7888:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdd54b24d0 20000000:00000080:1.0:1789263674.467884:0:7888:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9dd9c1b66c00 uarg=0000000000000000 20000000:01000000:1.0:1789263674.467921:0:7888:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1789263674.467928:0:7888:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1789263674.467932:0:7888:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1789263674.467996:0:7888:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1789263674.468008:0:7888:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1789263674.471304:0:7888:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789263674.471514:0:7888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1789263674.471546:0:7888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1789263674.471565:0:7888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1789263674.471581:0:7888:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789263674.471597:0:7888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000000878f705/0xce1582440fb1d602 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263674.471615:0:7888:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000636ce276/0xce1582440fb1d4e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d4dc expref: 12 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263674.471623:0:7888:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000085a6aae7/0xce1582440fb1d5d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d5ca expref: 12 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263674.471630:0:7888:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000000878f705/0xce1582440fb1d602 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263674.471664:0:7888:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000085a6aae7/0xce1582440fb1d5d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce1582440fb1d5ca expref: 12 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263674.471688:0:7888:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000085a6aae7/0xce1582440fb1d5d1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce1582440fb1d5ca expref: 12 pid: 6481 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263674.471702:0:7888:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000008f75c3 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7888:1876178898003328:0@lo:104: 00000100:00100000:1.0:1789263674.471761:0:7888:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789263674.471820:0:7888:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000636ce276/0xce1582440fb1d4e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce1582440fb1d4dc expref: 12 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263674.471827:0:6471:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:1.0:1789263674.471829:0:7888:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000636ce276/0xce1582440fb1d4e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce1582440fb1d4dc expref: 12 pid: 6480 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263674.471843:0:7888:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e5f14c96 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7888:1876178898003456:0@lo:104: 00000100:00100000:2.0:1789263674.471848:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898003328 00000100:00100000:2.0:1789263674.471856:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898003328 00000100:00100000:1.0:1789263674.471868:0:7888:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263674.471945:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898003456 00000100:00100000:2.0:1789263674.471949:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898003456 00000100:00100000:1.0:1789263674.471951:0:7888:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b5e9d6d7 going to sleep for 11 seconds 00000100:00100000:2.0:1789263674.471969:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789263674.471976:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f245a54d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:66a76ccf-c64c-4b18-8369-a2861ec3956c+4:7888:x1876178898003328:12345-0@lo:104: 00010000:00010000:2.0:1789263674.471988:0:6471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: 00000000a72943c1/0xce1582440fb1d5ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1d5d1 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263674.472133:0:6471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789263674.472137:0:7888:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000008f75c3 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7888:1876178898003328:0@lo:104: 00000100:00100000:2.0:1789263674.472143:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f245a54d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:66a76ccf-c64c-4b18-8369-a2861ec3956c+4:7888:x1876178898003328:12345-0@lo:104: Request processed in 165us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263674.472152:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789263674.472194:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789263674.472201:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000039b29451 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:66a76ccf-c64c-4b18-8369-a2861ec3956c+3:7888:x1876178898003456:12345-0@lo:104: 00010000:00010000:2.0:1789263674.472208:0:6471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: 000000003f4fa762/0xce1582440fb1d4dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1d4e3 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263674.472268:0:7427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789263674.472275:0:7427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: 00000000a72943c1/0xce1582440fb1d5ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1d5d1 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263674.472282:0:7888:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e5f14c96 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7888:1876178898003456:0@lo:104: 00010000:00010000:3.0:1789263674.472284:0:7427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a72943c1 already unused, calling callback (000000000c943745) 10000000:00010000:3.0:1789263674.472291:0:7427:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: 00000000a72943c1/0xce1582440fb1d5ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xce1582440fb1d5d1 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263674.472299:0:7427:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: 00000000a72943c1/0xce1582440fb1d5ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xce1582440fb1d5d1 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263674.472305:0:7888:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000000878f705/0xce1582440fb1d602 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789263674.472306:0:7427:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: 00000000a72943c1/0xce1582440fb1d5ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xce1582440fb1d5d1 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789263674.472324:0:7427:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789263674.472364:0:7427:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: 00000000a72943c1/0xce1582440fb1d5ca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d5d1 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263674.472377:0:7427:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789263674.472402:0:7427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: 00000000a72943c1/0xce1582440fb1d5ca lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d5d1 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263674.472407:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: 00000000a72943c1/0xce1582440fb1d5ca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d5d1 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263674.472419:0:7427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789263674.472421:0:7427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: 000000003f4fa762/0xce1582440fb1d4dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1d4e3 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263674.472427:0:7427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003f4fa762 already unused, calling callback (000000000c943745) 10000000:00010000:3.0:1789263674.472429:0:7427:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: 000000003f4fa762/0xce1582440fb1d4dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xce1582440fb1d4e3 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263674.472435:0:7427:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: 000000003f4fa762/0xce1582440fb1d4dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xce1582440fb1d4e3 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263674.472437:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 10000000:00010000:3.0:1789263674.472444:0:7427:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: 000000003f4fa762/0xce1582440fb1d4dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xce1582440fb1d4e3 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789263674.472450:0:7427:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1789263674.472451:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a525c5f0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:66a76ccf-c64c-4b18-8369-a2861ec3956c:3620:1876178898003584:0@lo:103: 00010000:00010000:3.0:1789263674.472474:0:7427:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: 000000003f4fa762/0xce1582440fb1d4dc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d4e3 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263674.472482:0:7427:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789263674.472488:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789263674.472500:0:7427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: 000000003f4fa762/0xce1582440fb1d4dc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d4e3 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263674.472507:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: 000000003f4fa762/0xce1582440fb1d4dc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d4e3 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263674.472525:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263674.472527:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263674.472529:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789263674.472540:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ac00f795 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:66a76ccf-c64c-4b18-8369-a2861ec3956c:3618:1876178898003712:0@lo:103: 00000100:00100000:3.0:1789263674.472568:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263674.472602:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898003584 00000100:00100000:1.0:1789263674.472607:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898003584 00010000:00010000:1.0:1789263674.472627:0:6473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000085a6aae7/0xce1582440fb1d5d1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1d5ca expref: 13 pid: 6481 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263674.472636:0:6471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1789263674.472643:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000039b29451 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:66a76ccf-c64c-4b18-8369-a2861ec3956c+3:7888:x1876178898003456:12345-0@lo:104: Request processed in 442us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263674.472652:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898003712 00000100:00100000:2.0:1789263674.472659:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789263674.472663:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898003712 00010000:00010000:1.0:1789263674.472678:0:6473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000636ce276/0xce1582440fb1d4e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1d4dc expref: 14 pid: 6480 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263674.472686:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789263674.472710:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e5f14c96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a76ccf-c64c-4b18-8369-a2861ec3956c+14:3620:x1876178898003584:12345-0@lo:103: 00000100:00100000:1.0:1789263674.472717:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00010000:00010000:2.0:1789263674.472721:0:6472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789263674.472726:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000025c8c91d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a76ccf-c64c-4b18-8369-a2861ec3956c+14:3618:x1876178898003712:12345-0@lo:103: 00010000:00010000:2.0:1789263674.472728:0:6472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000085a6aae7/0xce1582440fb1d5d1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1d5ca expref: 14 pid: 6481 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263674.472738:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789263674.472743:0:6472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000085a6aae7/0xce1582440fb1d5d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce1582440fb1d5ca expref: 14 pid: 6481 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263674.472745:0:6473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000636ce276/0xce1582440fb1d4e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1d4dc expref: 14 pid: 6480 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263674.472767:0:6473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000636ce276/0xce1582440fb1d4e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce1582440fb1d4dc expref: 14 pid: 6480 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263674.472798:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789263674.472893:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000085a6aae7/0xce1582440fb1d5d1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce1582440fb1d5ca expref: 14 pid: 6481 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263674.472898:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000636ce276/0xce1582440fb1d4e3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce1582440fb1d4dc expref: 14 pid: 6480 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263674.472904:0:6472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000000878f705/0xce1582440fb1d602 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263674.472912:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000878f705/0xce1582440fb1d602 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263674.472918:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789263674.472922:0:6472:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000878f705/0xce1582440fb1d602 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263674.472927:0:6472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000878f705/0xce1582440fb1d602 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263674.472932:0:6472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000000878f705/0xce1582440fb1d602 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263674.472939:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000000878f705/0xce1582440fb1d602 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263674.472954:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000878f705 already unused, calling callback (000000000583e00c) 00010000:00010000:2.0:1789263674.472958:0:6472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000000878f705/0xce1582440fb1d602 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263674.472965:0:6472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000000878f705/0xce1582440fb1d602 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263674.472968:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000025c8c91d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a76ccf-c64c-4b18-8369-a2861ec3956c+12:3618:x1876178898003712:12345-0@lo:103: Request processed in 244us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263674.472983:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789263674.473026:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ac00f795 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:66a76ccf-c64c-4b18-8369-a2861ec3956c:3618:1876178898003712:0@lo:103: 00010000:00010000:2.0:1789263674.473064:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000000878f705/0xce1582440fb1d602 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263674.473190:0:6472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789263674.473244:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e5f14c96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a76ccf-c64c-4b18-8369-a2861ec3956c+11:3620:x1876178898003584:12345-0@lo:103: Request processed in 550us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263674.473253:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1789263674.473268:0:7888:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000000878f705/0xce1582440fb1d602 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263674.473282:0:7888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000000878f705/0xce1582440fb1d602 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263674.473288:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000878f705/0xce1582440fb1d602 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263674.473318:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a525c5f0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:66a76ccf-c64c-4b18-8369-a2861ec3956c:3620:1876178898003584:0@lo:103: 00010000:00010000:2.0:1789263674.798206:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789263675.437222:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000045297fa1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:66a76ccf-c64c-4b18-8369-a2861ec3956c:3619:1876178898003840:0@lo:400: 00000100:00100000:0.0:1789263675.437238:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005c3a3f99 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1876178898003968:0@lo:400: 00000100:00100000:0.0:1789263675.437299:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263675.437302:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263675.437310:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e34b59f3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876178898004224:0@lo:400: 00000100:00100000:1.0:1789263675.437368:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263675.437384:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789263675.437394:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000eedb45fd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898004096:0@lo:400: 00000100:00100000:3.0:1789263675.437402:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898003840 00000100:00100000:3.0:1789263675.437410:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898003840 00000100:00100000:1.0:1789263675.437415:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898003968 00000100:00100000:1.0:1789263675.437421:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898003968 00000100:00100000:0.0:1789263675.437425:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263675.437467:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898004224 00000100:00100000:1.0:1789263675.437471:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898004224 00000100:00100000:3.0:1789263675.437476:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789263675.437484:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789263675.437488:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000469c44a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+11:3619:x1876178898003840:12345-0@lo:400: 00000100:00100000:0.0:1789263675.437495:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a0715f7d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1876178898003968:12345-0@lo:400: 00000100:00100000:1.0:1789263675.437506:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789263675.437516:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000008f75c3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876178898004224:12345-0@lo:400: 00000100:00100000:3.0:1789263675.437550:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000469c44a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+11:3619:x1876178898003840:12345-0@lo:400: Request processed in 66us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263675.437557:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a0715f7d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1876178898003968:12345-0@lo:400: Request processed in 63us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263675.437562:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789263675.437571:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789263675.437573:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000008f75c3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876178898004224:12345-0@lo:400: Request processed in 58us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263675.437591:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789263675.437598:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898004096 00000100:00100000:0.0:1789263675.437603:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898004096 00000100:00100000:3.0:1789263675.437615:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000045297fa1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:66a76ccf-c64c-4b18-8369-a2861ec3956c:3619:1876178898003840:0@lo:400: 00000100:00100000:0.0:1789263675.437636:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789263675.437645:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000047dbb971 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898004096:12345-0@lo:400: 00010000:00080000:1.0:1789263675.437647:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000e34b59f3 x1876178898004224/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263691 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789263675.437663:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e34b59f3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876178898004224:0@lo:400: 00000100:00100000:0.0:1789263675.437684:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000047dbb971 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898004096:12345-0@lo:400: Request processed in 41us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263675.437690:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789263675.437713:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000eedb45fd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898004096:0@lo:400: 00010000:00080000:1.0:1789263675.437725:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000005c3a3f99 x1876178898003968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263691 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789263675.437733:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005c3a3f99 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1876178898003968:0@lo:400: 00000100:00100000:1.0:1789263675.438212:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000058bafafb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898004352:0@lo:41: 00000100:00100000:1.0:1789263675.438244:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263675.438297:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898004352 00000100:00100000:0.0:1789263675.438302:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898004352 00000100:00100000:0.0:1789263675.438331:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789263675.438352:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f3ceb9b3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1876178898004352:12345-0@lo:41: 00000004:00000024:0.0:1789263675.438378:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:0.0:1789263675.438422:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f3ceb9b3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1876178898004352:12345-0@lo:41: Request processed in 85us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263675.438429:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789263675.438511:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000058bafafb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898004352:0@lo:41: 00010000:00010000:1.0:1789263675.823701:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263676.845182:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263677.869355:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789263678.184260:0:8386:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789263678.184265:0:8386:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1789263678.184267:0:8386:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1789263678.184501:0:8386:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000082652e84 00000020:01000004:3.0:1789263678.184517:0:8386:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1789263678.184529:0:8386:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789263678.184542:0:8386:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (000000002fadaee1) 00000020:00000080:3.0:1789263678.184560:0:8386:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1789263678.204945:0:8386:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1789263678.205002:0:8386:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:1.0:1789263678.217434:0:8386:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1789263678.217733:0:8386:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1789263678.217743:0:8386:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789263678.217753:0:8386:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xce1582440fb1d610 00000020:01000004:1.0:1789263678.217758:0:8386:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:1.0:1789263678.217775:0:8386:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.120@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1789263678.217778:0:8386:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.120@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1789263678.217782:0:8386:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1789263678.217785:0:8386:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1789263678.217793:0:8386:0:(genops.c:413:class_newdev()) Allocate new device OSS (000000007067e896) 00000020:00000080:1.0:1789263678.217803:0:8386:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type ost with refcount 2 00000100:00100000:1.0:1789263678.219705:0:8386:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789263678.219854:0:8386:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1789263678.219858:0:8386:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1789263678.221437:0:8386:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1789263678.221449:0:8386:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1789263678.221772:0:8386:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1789263678.221779:0:8386:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1789263678.223637:0:8386:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789263678.223804:0:8386:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1789263678.223811:0:8386:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1789263678.224575:0:8386:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1789263678.224584:0:8386:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1789263678.239146:0:8386:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789263678.239859:0:8386:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789263678.239866:0:8386:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1789263678.241070:0:8386:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789263678.241391:0:8386:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1789263678.243158:0:8386:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789263678.243169:0:8386:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1789263678.244781:0:8386:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789263678.244961:0:8386:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1789263678.244969:0:8386:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1789263678.245566:0:8386:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1789263678.245574:0:8386:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1789263678.272478:0:8386:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789263678.272647:0:8386:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1789263678.272651:0:8386:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1789263678.273800:0:8386:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1789263678.273806:0:8386:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1789263678.274404:0:8386:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1789263678.274431:0:8386:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1789263678.274437:0:8386:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.120@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1789263678.286377:0:8386:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.120@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789263678.286417:0:8386:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.120@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1789263678.286420:0:8386:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789263678.286422:0:8386:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789263678.286422:0:8386:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789263678.286423:0:8386:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789263678.286424:0:8386:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789263678.286425:0:8386:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789263678.286426:0:8386:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789263678.286426:0:8386:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789263678.286427:0:8386:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789263678.286428:0:8386:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789263678.286429:0:8386:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789263678.286432:0:8386:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1789263678.286433:0:8386:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789263678.286434:0:8386:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789263678.286437:0:8386:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789263678.286438:0:8386:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789263678.286439:0:8386:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789263678.286439:0:8386:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789263678.286440:0:8386:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789263678.286440:0:8386:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789263678.286441:0:8386:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789263678.286441:0:8386:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789263678.286442:0:8386:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789263678.286461:0:8386:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789263678.286475:0:8386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002bba77ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:8386:1876178898004480:0@lo:253: 00000100:00100000:0.0:1789263678.286528:0:8386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263678.286602:0:8386:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f99b5445 going to sleep for 11 seconds 00000100:00100000:3.0:1789263678.286817:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898004480 00000100:00100000:3.0:1789263678.286825:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898004480 00000100:00100000:3.0:1789263678.286877:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789263678.286886:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000681b7085 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+11:8386:x1876178898004480:12345-0@lo:253: 20000000:01000000:3.0:1789263678.286923:0:6481:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1789263678.286927:0:6481:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1789263678.286932:0:6481:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1789263678.286934:0:6481:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1789263678.287162:0:6481:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789263678.287278:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1789263678.287292:0:6481:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1789263678.287309:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1789263678.287315:0:6481:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1789263678.287338:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1789263678.287350:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1789263678.287419:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1789263678.287433:0:6481:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.120@tcp 20000000:01000000:3.0:1789263678.287435:0:6481:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.120@tcp (null) (null) (null) 00000040:00080000:3.0:1789263678.287451:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1789263678.287458:0:6481:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789263678.287485:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1789263678.287493:0:6481:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.120@tcp (null) (null) 00000040:00080000:3.0:1789263678.287506:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1789263678.287512:0:6481:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1789263678.287525:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1789263678.287541:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1789263678.287610:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:3.0:1789263678.287622:0:6481:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.120@tcp 20000000:01000000:3.0:1789263678.287623:0:6481:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.120@tcp (null) (null) (null) 00000040:00080000:3.0:1789263678.287636:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:3.0:1789263678.287642:0:6481:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789263678.287663:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:3.0:1789263678.287669:0:6481:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.203.120@tcp (null) (null) 00000040:00080000:3.0:1789263678.287681:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:3.0:1789263678.287686:0:6481:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1789263678.287698:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:3.0:1789263678.287713:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:3.0:1789263678.288048:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:3.0:1789263678.288060:0:6481:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.120@tcp 20000000:01000000:3.0:1789263678.288061:0:6481:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.120@tcp (null) (null) (null) 00000040:00080000:3.0:1789263678.288094:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:3.0:1789263678.288103:0:6481:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1789263678.288119:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:3.0:1789263678.288126:0:6481:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.120@tcp (null) (null) 00000040:00080000:3.0:1789263678.288138:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:3.0:1789263678.288144:0:6481:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1789263678.288155:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:3.0:1789263678.288170:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:3.0:1789263678.288184:0:6481:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1789263678.288187:0:6481:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1789263678.288191:0:6481:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1789263678.288221:0:6481:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789263678.288223:0:6481:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789263678.288570:0:8405:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 18 1->4: lustre sys.timeout 20000000:01000000:0.0:1789263678.288588:0:8405:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 18 2->4: lustre sys.timeout 00000040:00080000:0.0:1789263678.288600:0:8405:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1789263678.288702:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:3.0:1789263678.288721:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:3.0:1789263678.288730:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:3.0:1789263678.288735:0:6481:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1789263678.288737:0:6481:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789263678.288937:0:8406:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:0.0:1789263678.288955:0:8406:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:0.0:1789263678.288968:0:8406:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:3.0:1789263678.289053:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:3.0:1789263678.289071:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:3.0:1789263678.289117:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:3.0:1789263678.289128:0:6481:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1789263678.289129:0:6481:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789263678.289497:0:8407:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1789263678.289586:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1789263678.289607:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1789263678.289621:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1789263678.289630:0:6481:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789263678.289632:0:6481:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789263678.289918:0:8408:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:0.0:1789263678.289940:0:8408:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:0.0:1789263678.289958:0:8408:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1789263678.290039:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1789263678.290058:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1789263678.290073:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 10000000:01000000:3.0:1789263678.290105:0:6481:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789263678.290122:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000fdaca686/0xce1582440fb1d61e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263678.290139:0:6481:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000049e7aa8b/0xce1582440fb1d568 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d561 expref: 11 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263678.290146:0:6481:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000fce086e6/0xce1582440fb1d5df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d5d8 expref: 11 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263678.290152:0:6481:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000fdaca686/0xce1582440fb1d61e lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263678.290185:0:6481:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000fce086e6/0xce1582440fb1d5df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce1582440fb1d5d8 expref: 11 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263678.290198:0:6481:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000fce086e6/0xce1582440fb1d5df lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce1582440fb1d5d8 expref: 11 pid: 6480 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263678.290210:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ac00f795 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6481:1876178898004608:0@lo:104: 00000100:00100000:3.0:1789263678.290265:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789263678.290314:0:6481:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000049e7aa8b/0xce1582440fb1d568 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce1582440fb1d561 expref: 11 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263678.290333:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898004608 00000100:00100000:2.0:1789263678.290341:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898004608 00010000:00010000:3.0:1789263678.290349:0:6481:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000049e7aa8b/0xce1582440fb1d568 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce1582440fb1d561 expref: 11 pid: 6482 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263678.290360:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fe8fb4b1 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6481:1876178898004736:0@lo:104: 00000100:00100000:3.0:1789263678.290385:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263678.290397:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898004736 00000100:00100000:3.0:1789263678.290399:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set 000000009ecab1be going to sleep for 11 seconds 00000100:00100000:2.0:1789263678.290401:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898004736 00000100:00100000:2.0:1789263678.290424:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789263678.290432:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c8735381 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:66a76ccf-c64c-4b18-8369-a2861ec3956c+4:6481:x1876178898004608:12345-0@lo:104: 00010000:00010000:2.0:1789263678.290444:0:6470:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: 00000000029952b1/0xce1582440fb1d5d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1d5df expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263678.290515:0:6470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789263678.290527:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c8735381 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:66a76ccf-c64c-4b18-8369-a2861ec3956c+4:6481:x1876178898004608:12345-0@lo:104: Request processed in 96us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263678.290534:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ac00f795 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6481:1876178898004608:0@lo:104: 00000100:00100000:2.0:1789263678.290537:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789263678.290559:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789263678.290565:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000045bd3abf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:66a76ccf-c64c-4b18-8369-a2861ec3956c+3:6481:x1876178898004736:12345-0@lo:104: 00010000:00010000:2.0:1789263678.290572:0:6470:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: 000000004326b965/0xce1582440fb1d561 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1d568 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263678.290609:0:6470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:3.0:1789263678.290614:0:6475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:2.0:1789263678.290615:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000045bd3abf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:66a76ccf-c64c-4b18-8369-a2861ec3956c+3:6481:x1876178898004736:12345-0@lo:104: Request processed in 50us (229us total) trans 0 rc 0/0 00010000:00010000:3.0:1789263678.290622:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: 00000000029952b1/0xce1582440fb1d5d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1d5df expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263678.290626:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:3.0:1789263678.290635:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000029952b1 already unused, calling callback (000000000c943745) 10000000:00010000:3.0:1789263678.290639:0:6475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: 00000000029952b1/0xce1582440fb1d5d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xce1582440fb1d5df expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263678.290647:0:6475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: 00000000029952b1/0xce1582440fb1d5d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xce1582440fb1d5df expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789263678.290658:0:6475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: 00000000029952b1/0xce1582440fb1d5d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xce1582440fb1d5df expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789263678.290664:0:6475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1789263678.290674:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fe8fb4b1 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6481:1876178898004736:0@lo:104: 00010000:00010000:3.0:1789263678.290692:0:6475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: 00000000029952b1/0xce1582440fb1d5d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d5df expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263678.290694:0:6481:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000fdaca686/0xce1582440fb1d61e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263678.290711:0:6475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789263678.290734:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: 00000000029952b1/0xce1582440fb1d5d8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d5df expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263678.290750:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008dafc841 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:66a76ccf-c64c-4b18-8369-a2861ec3956c:3620:1876178898004864:0@lo:103: 00010000:00010000:3.0:1789263678.290751:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: 00000000029952b1/0xce1582440fb1d5d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d5df expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263678.290767:0:6475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789263678.290770:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: 000000004326b965/0xce1582440fb1d561 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1d568 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263678.290776:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004326b965 already unused, calling callback (000000000c943745) 10000000:00010000:3.0:1789263678.290779:0:6475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: 000000004326b965/0xce1582440fb1d561 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xce1582440fb1d568 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263678.290785:0:6475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: 000000004326b965/0xce1582440fb1d561 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xce1582440fb1d568 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263678.290788:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:3.0:1789263678.290797:0:6475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: 000000004326b965/0xce1582440fb1d561 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xce1582440fb1d568 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789263678.290803:0:6475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789263678.290826:0:6475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: 000000004326b965/0xce1582440fb1d561 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d568 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263678.290833:0:6475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789263678.290848:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: 000000004326b965/0xce1582440fb1d561 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d568 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263678.290854:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: 000000004326b965/0xce1582440fb1d561 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d568 expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263678.290860:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001c272b2d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:66a76ccf-c64c-4b18-8369-a2861ec3956c:3621:1876178898004992:0@lo:103: 00010000:00010000:3.0:1789263678.290868:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263678.290876:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263678.290878:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789263678.290889:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263678.290950:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898004864 00000100:00100000:1.0:1789263678.290956:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898004864 00010000:00010000:0.0:1789263678.290963:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263678.290975:0:6473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000fce086e6/0xce1582440fb1d5df lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1d5d8 expref: 12 pid: 6480 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263678.290980:0:7428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898004992 00000100:00100000:0.0:1789263678.290986:0:7428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898004992 00010000:00010000:0.0:1789263678.291005:0:7428:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000049e7aa8b/0xce1582440fb1d568 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1d561 expref: 13 pid: 6482 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263678.291008:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789263678.291019:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007df245df pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a76ccf-c64c-4b18-8369-a2861ec3956c+13:3620:x1876178898004864:12345-0@lo:103: 00010000:00010000:1.0:1789263678.291039:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789263678.291040:0:7428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789263678.291047:0:6472:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00010000:00010000:1.0:1789263678.291047:0:6473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000fce086e6/0xce1582440fb1d5df lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1d5d8 expref: 13 pid: 6480 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263678.291053:0:7428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000011511d28 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a76ccf-c64c-4b18-8369-a2861ec3956c+13:3621:x1876178898004992:12345-0@lo:103: 00000100:00100000:3.0:1789263678.291054:0:6472:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00010000:00010000:1.0:1789263678.291060:0:6473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000fce086e6/0xce1582440fb1d5df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce1582440fb1d5d8 expref: 13 pid: 6480 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263678.291067:0:7428:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789263678.291072:0:7428:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000049e7aa8b/0xce1582440fb1d568 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1d561 expref: 13 pid: 6482 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263678.291094:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000fce086e6/0xce1582440fb1d5df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce1582440fb1d5d8 expref: 13 pid: 6480 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263678.291107:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789263678.291123:0:7428:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000049e7aa8b/0xce1582440fb1d568 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce1582440fb1d561 expref: 12 pid: 6482 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263678.291136:0:7428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000049e7aa8b/0xce1582440fb1d568 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce1582440fb1d561 expref: 12 pid: 6482 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263678.291141:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007df245df pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a76ccf-c64c-4b18-8369-a2861ec3956c+12:3620:x1876178898004864:12345-0@lo:103: Request processed in 122us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263678.291153:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1789263678.291156:0:7428:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000fdaca686/0xce1582440fb1d61e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263678.291165:0:7428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fdaca686/0xce1582440fb1d61e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263678.291178:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008dafc841 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:66a76ccf-c64c-4b18-8369-a2861ec3956c:3620:1876178898004864:0@lo:103: 00010000:00010000:0.0:1789263678.291186:0:7428:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000fdaca686/0xce1582440fb1d61e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263678.291194:0:7428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000fdaca686/0xce1582440fb1d61e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263678.291200:0:7428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000fdaca686/0xce1582440fb1d61e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263678.291206:0:7428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000fdaca686/0xce1582440fb1d61e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263678.291210:0:7428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000fdaca686 already unused, calling callback (000000000583e00c) 00010000:00010000:0.0:1789263678.291214:0:7428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000fdaca686/0xce1582440fb1d61e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263678.291221:0:7428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000fdaca686/0xce1582440fb1d61e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263678.291258:0:7428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000fdaca686/0xce1582440fb1d61e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263678.291268:0:7428:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789263678.291304:0:7428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000011511d28 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a76ccf-c64c-4b18-8369-a2861ec3956c+10:3621:x1876178898004992:12345-0@lo:103: Request processed in 255us (413us total) trans 0 rc 0/0 00010000:00010000:1.0:1789263678.291309:0:6481:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000fdaca686/0xce1582440fb1d61e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263678.291312:0:7428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789263678.291329:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001c272b2d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:66a76ccf-c64c-4b18-8369-a2861ec3956c:3621:1876178898004992:0@lo:103: 00010000:00010000:1.0:1789263678.291339:0:6481:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000fdaca686/0xce1582440fb1d61e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263678.291345:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000fdaca686/0xce1582440fb1d61e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789263678.291356:0:6481:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1789263678.293103:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000681b7085 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+9:8386:x1876178898004480:12345-0@lo:253: Request processed in 6213us (6568us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263678.293118:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789263678.293147:0:8386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002bba77ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:8386:1876178898004480:0@lo:253: 10000000:01000000:0.0:1789263678.293160:0:8386:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789263678.293162:0:8386:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789263678.293163:0:8386:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789263678.293164:0:8386:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789263678.293165:0:8386:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1789263678.293166:0:8386:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789263678.293167:0:8386:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789263678.293169:0:8386:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789263678.293170:0:8386:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1789263678.293171:0:8386:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789263678.293172:0:8386:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789263678.293194:0:8386:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000082652e84 from lustre-OST0000 10000000:01000000:0.0:1789263678.293220:0:8386:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1789263678.293223:0:8386:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789263678.293230:0:8386:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9dd9b7983370 local copy 10000000:01000000:0.0:1789263678.293234:0:8386:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789263678.293260:0:8386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: 00000000edd439af/0xce1582440fb1d625 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263678.293268:0:8386:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.120@tcp lock: 00000000edd439af/0xce1582440fb1d625 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263678.293275:0:8386:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: 00000000edd439af/0xce1582440fb1d625 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263678.293299:0:8386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002bba77ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:8386:1876178898005120:0@lo:101: 00000100:00100000:0.0:1789263678.293341:0:8386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263678.293372:0:8386:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f99b5445 going to sleep for 11 seconds 00000100:00100000:1.0:1789263678.293377:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898005120 00000100:00100000:1.0:1789263678.293384:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898005120 00000100:00100000:1.0:1789263678.293419:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789263678.293428:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d0009bcd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+9:8386:x1876178898005120:12345-0@lo:101: 00010000:00010000:1.0:1789263678.293439:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263678.293451:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005f6138d7/0xce1582440fb1d62c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1d625 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263678.293471:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005f6138d7/0xce1582440fb1d62c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1d625 expref: 10 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263678.293480:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005f6138d7/0xce1582440fb1d62c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d625 expref: 10 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263678.293487:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005f6138d7, rc 0) 00000100:00100000:1.0:1789263678.293522:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d0009bcd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+10:8386:x1876178898005120:12345-0@lo:101: Request processed in 96us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263678.293527:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789263678.293570:0:8386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002bba77ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:8386:1876178898005120:0@lo:101: 00010000:00010000:0.0:1789263678.293588:0:8386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: 00000000edd439af/0xce1582440fb1d625 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xce1582440fb1d62c expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263678.293596:0:8386:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: 00000000edd439af/0xce1582440fb1d625 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xce1582440fb1d62c expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263678.293742:0:8386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002bba77ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:8386:1876178898005248:0@lo:501: 00000100:00100000:0.0:1789263678.293764:0:8386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263678.293780:0:8386:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f99b5445 going to sleep for 11 seconds 00000100:00100000:1.0:1789263678.293798:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898005248 00000100:00100000:1.0:1789263678.293803:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898005248 00000100:00100000:1.0:1789263678.293829:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789263678.293835:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f26bd1cb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+10:8386:x1876178898005248:12345-0@lo:501: 00000100:00100000:1.0:1789263678.293892:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f26bd1cb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+10:8386:x1876178898005248:12345-0@lo:501: Request processed in 56us (126us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789263678.293899:0:8386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002bba77ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:8386:1876178898005248:0@lo:501: 00000100:00100000:1.0:1789263678.293907:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 10000000:01000000:0.0:1789263678.293909:0:8386:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.120@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789263678.293928:0:8386:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.120@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789263678.293932:0:8386:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: 00000000edd439af/0xce1582440fb1d625 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xce1582440fb1d62c expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263678.293939:0:8386:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: 00000000edd439af/0xce1582440fb1d625 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xce1582440fb1d62c expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263678.293945:0:8386:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: 00000000edd439af/0xce1582440fb1d625 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xce1582440fb1d62c expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263678.293965:0:8386:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789263678.293995:0:8386:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9dd9c1b57000 10000000:01000000:0.0:1789263678.294000:0:8386:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789263678.294003:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:0.0:1789263678.294005:0:8386:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789263678.294009:0:8386:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789263678.294011:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: 00000000edd439af/0xce1582440fb1d625 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xce1582440fb1d62c expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789263678.294014:0:8386:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1789263678.294019:0:8386:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789263678.294024:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000edd439af already unused, calling callback (000000000c943745) 10000000:00010000:2.0:1789263678.294028:0:6476:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: 00000000edd439af/0xce1582440fb1d625 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xce1582440fb1d62c expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263678.294048:0:8386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: 000000005f2e3c15/0xce1582440fb1d633 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263678.294065:0:8386:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: 000000005f2e3c15/0xce1582440fb1d633 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263678.294068:0:6476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: 00000000edd439af/0xce1582440fb1d625 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x8400000000 nid: local remote: 0xce1582440fb1d62c expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789263678.294095:0:6476:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: 00000000edd439af/0xce1582440fb1d625 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x9400000000 nid: local remote: 0xce1582440fb1d62c expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789263678.294101:0:6476:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789263678.294106:0:8386:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: 000000005f2e3c15/0xce1582440fb1d633 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263678.294121:0:8386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002bba77ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:8386:1876178898005376:0@lo:101: 00010000:00010000:2.0:1789263678.294123:0:6476:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: 00000000edd439af/0xce1582440fb1d625 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xce1582440fb1d62c expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263678.294131:0:6476:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789263678.294154:0:8386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789263678.294160:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: 00000000edd439af/0xce1582440fb1d625 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xce1582440fb1d62c expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263678.294160:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005af3aa64 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:66a76ccf-c64c-4b18-8369-a2861ec3956c:3618:1876178898005504:0@lo:103: 00010000:00010000:2.0:1789263678.294173:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: 00000000edd439af/0xce1582440fb1d625 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xce1582440fb1d62c expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263678.294177:0:8386:0:(client.c:2715:ptlrpc_set_wait()) set 000000008745ac82 going to sleep for 11 seconds 00010000:00010000:2.0:1789263678.294192:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789263678.294195:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789263678.294197:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789263678.294210:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263678.294245:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898005376 00000100:00100000:1.0:1789263678.294248:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898005376 00000100:00100000:1.0:1789263678.294270:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789263678.294277:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bdbaeae6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+10:8386:x1876178898005376:12345-0@lo:101: 00010000:00010000:1.0:1789263678.294284:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263678.294292:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f22cf00f/0xce1582440fb1d63a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1d633 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263678.294305:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f22cf00f/0xce1582440fb1d63a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1d633 expref: 11 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263678.294313:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f22cf00f/0xce1582440fb1d63a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d633 expref: 11 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263678.294330:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f22cf00f, rc 0) 00000100:00100000:3.0:1789263678.294334:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898005504 00000100:00100000:3.0:1789263678.294340:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898005504 00000100:00100000:1.0:1789263678.294362:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bdbaeae6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+12:8386:x1876178898005376:12345-0@lo:101: Request processed in 85us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263678.294368:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789263678.294379:0:8386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002bba77ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:8386:1876178898005376:0@lo:101: 00000100:00100000:3.0:1789263678.294386:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1789263678.294395:0:8386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: 000000005f2e3c15/0xce1582440fb1d633 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d63a expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263678.294396:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000904f323c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a76ccf-c64c-4b18-8369-a2861ec3956c+11:3618:x1876178898005504:12345-0@lo:103: 00010000:00010000:3.0:1789263678.294408:0:6472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789263678.294418:0:8386:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: 000000005f2e3c15/0xce1582440fb1d633 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1d63a expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263678.294420:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005f6138d7/0xce1582440fb1d62c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xce1582440fb1d625 expref: 11 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263678.294446:0:6472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789263678.294478:0:8386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002bba77ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:8386:1876178898005632:0@lo:501: 00000100:00100000:3.0:1789263678.294485:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000904f323c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a76ccf-c64c-4b18-8369-a2861ec3956c+10:3618:x1876178898005504:12345-0@lo:103: Request processed in 91us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263678.294491:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789263678.294510:0:8386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263678.294536:0:8386:0:(client.c:2715:ptlrpc_set_wait()) set 000000008745ac82 going to sleep for 11 seconds 00000100:00100000:1.0:1789263678.294537:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005af3aa64 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:66a76ccf-c64c-4b18-8369-a2861ec3956c:3618:1876178898005504:0@lo:103: 00000100:00100000:2.0:1789263678.294553:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898005632 00000100:00100000:2.0:1789263678.294559:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898005632 00000100:00100000:2.0:1789263678.294590:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789263678.294596:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f6dbd94a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+10:8386:x1876178898005632:12345-0@lo:501: 00000100:00100000:2.0:1789263678.294685:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f6dbd94a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+10:8386:x1876178898005632:12345-0@lo:501: Request processed in 89us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263678.294694:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789263678.294700:0:8386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002bba77ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:8386:1876178898005632:0@lo:501: 00000100:00100000:0.0:1789263678.294737:0:8386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002bba77ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:8386:1876178898005760:0@lo:503: 00000100:00100000:0.0:1789263678.294774:0:8386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263678.294790:0:8386:0:(client.c:2715:ptlrpc_set_wait()) set 000000008745ac82 going to sleep for 11 seconds 00000100:00100000:1.0:1789263678.294808:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898005760 00000100:00100000:1.0:1789263678.294814:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898005760 00000100:00100000:1.0:1789263678.294839:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789263678.294845:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000048413473 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+10:8386:x1876178898005760:12345-0@lo:503: 00000100:00100000:1.0:1789263678.294919:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000048413473 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+10:8386:x1876178898005760:12345-0@lo:503: Request processed in 74us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263678.294926:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789263678.294936:0:8386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002bba77ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:8386:1876178898005760:0@lo:503: 00000040:00080000:0.0:1789263678.295181:0:8386:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789263678.295249:0:8386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002bba77ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:8386:1876178898005888:0@lo:502: 00000100:00100000:0.0:1789263678.295283:0:8386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263678.295308:0:8386:0:(client.c:2715:ptlrpc_set_wait()) set 000000008745ac82 going to sleep for 11 seconds 00000100:00100000:2.0:1789263678.295328:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898005888 00000100:00100000:2.0:1789263678.295333:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898005888 00000100:00100000:2.0:1789263678.295365:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789263678.295372:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000080b07f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+10:8386:x1876178898005888:12345-0@lo:502: 00000100:00100000:2.0:1789263678.295439:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000080b07f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+10:8386:x1876178898005888:12345-0@lo:502: Request processed in 68us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263678.295446:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789263678.295463:0:8386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002bba77ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:8386:1876178898005888:0@lo:502: 00000040:00080000:0.0:1789263678.295660:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1789263678.295685:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1789263678.295701:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1789263678.295714:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1789263678.295727:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1789263678.295739:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1789263678.295758:0:8386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002bba77ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:8386:1876178898006016:0@lo:502: 00000100:00100000:0.0:1789263678.295788:0:8386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263678.295805:0:8386:0:(client.c:2715:ptlrpc_set_wait()) set 000000008745ac82 going to sleep for 11 seconds 00000100:00100000:1.0:1789263678.295825:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898006016 00000100:00100000:1.0:1789263678.295830:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898006016 00000100:00100000:1.0:1789263678.295856:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789263678.295862:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006f5adb2b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+10:8386:x1876178898006016:12345-0@lo:502: 00000100:00100000:1.0:1789263678.295939:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006f5adb2b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+10:8386:x1876178898006016:12345-0@lo:502: Request processed in 76us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263678.295944:0:8386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002bba77ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:8386:1876178898006016:0@lo:502: 00000100:00100000:1.0:1789263678.295949:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000040:00080000:0.0:1789263678.295986:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1789263678.295993:0:8386:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1789263678.297421:0:8410:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789263678.297431:0:8410:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1789263678.297438:0:8410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789263678.297440:0:8410:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1789263678.297447:0:8410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789263678.297461:0:8410:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (00000000bc0e4ad2) 00000020:00000080:0.0:1789263678.297490:0:8410:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789263678.297497:0:8410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789263678.297585:0:8410:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000082652e84 from lustre-OST0000, refs=2 00080000:01000000:0.0:1789263678.297594:0:8410:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789263678.297609:0:8410:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xce1582440fb1d648 00010000:00010000:0.0:1789263678.301347:0:8410:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:0.0:1789263678.302204:0:8410:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1789263678.304563:0:8410:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1789263678.304927:0:8410:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1789263678.307986:0:8410:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:1.0:1789263678.308147:0:8410:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:1.0:1789263678.311835:0:8410:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:1.0:1789263678.312794:0:8410:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1789263678.312804:0:8410:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789263678.312809:0:8410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789263678.312811:0:8410:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1789263678.312814:0:8410:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789263678.312818:0:8410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789263678.312819:0:8410:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789263678.312822:0:8410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789263678.312824:0:8410:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789263678.312840:0:8410:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789263678.312843:0:8410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789263678.312848:0:8410:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789263678.312850:0:8410:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1789263678.312920:0:8386:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1789263678.312950:0:8386:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789263678.312968:0:8386:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: 000000005f2e3c15/0xce1582440fb1d633 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d63a expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263678.312980:0:8386:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: 000000005f2e3c15/0xce1582440fb1d633 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d63a expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789263678.312988:0:8386:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dd9c1b57000 from 1 10000000:01000000:0.0:1789263678.312991:0:8386:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789263678.313023:0:8386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: 0000000049e7aa8b/0xce1582440fb1d64f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263678.313030:0:8386:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: 0000000049e7aa8b/0xce1582440fb1d64f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263678.313040:0:8386:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: 0000000049e7aa8b/0xce1582440fb1d64f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263678.313060:0:8386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002bba77ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:8386:1876178898006144:0@lo:101: 00000100:00100000:0.0:1789263678.313164:0:8386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263678.313219:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898006144 00000100:00100000:0.0:1789263678.313221:0:8386:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f99b5445 going to sleep for 11 seconds 00000100:00100000:2.0:1789263678.313228:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898006144 00000100:00100000:2.0:1789263678.313271:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789263678.313281:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000184107bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+10:8386:x1876178898006144:12345-0@lo:101: 00010000:00010000:2.0:1789263678.313294:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263678.313308:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a72943c1/0xce1582440fb1d656 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1d64f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263678.313343:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a72943c1/0xce1582440fb1d656 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1d64f expref: 11 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263678.313353:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a72943c1/0xce1582440fb1d656 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d64f expref: 11 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263678.313362:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a72943c1, rc 0) 00000100:00100000:2.0:1789263678.313403:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000184107bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+11:8386:x1876178898006144:12345-0@lo:101: Request processed in 125us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263678.313411:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789263678.313438:0:8386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002bba77ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:8386:1876178898006144:0@lo:101: 00010000:00010000:0.0:1789263678.313458:0:8386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: 0000000049e7aa8b/0xce1582440fb1d64f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d656 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263678.313466:0:8386:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: 0000000049e7aa8b/0xce1582440fb1d64f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1d656 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263678.313541:0:8386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002bba77ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:8386:1876178898006272:0@lo:501: 00000100:00100000:0.0:1789263678.313571:0:8386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263678.313587:0:8386:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f99b5445 going to sleep for 11 seconds 00000100:00100000:1.0:1789263678.313606:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898006272 00000100:00100000:1.0:1789263678.313612:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898006272 00000100:00100000:1.0:1789263678.313642:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789263678.313651:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ba28a330 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+11:8386:x1876178898006272:12345-0@lo:501: 00000100:00100000:1.0:1789263678.313748:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ba28a330 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+11:8386:x1876178898006272:12345-0@lo:501: Request processed in 100us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263678.313756:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789263678.313781:0:8386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002bba77ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:8386:1876178898006272:0@lo:501: 00000100:00100000:0.0:1789263678.313816:0:8386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002bba77ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:8386:1876178898006400:0@lo:503: 00000100:00100000:0.0:1789263678.313853:0:8386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263678.313869:0:8386:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f99b5445 going to sleep for 11 seconds 00000100:00100000:2.0:1789263678.313896:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898006400 00000100:00100000:2.0:1789263678.313902:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898006400 00000100:00100000:2.0:1789263678.313932:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789263678.313940:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000079d7ba79 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+11:8386:x1876178898006400:12345-0@lo:503: 00000100:00100000:2.0:1789263678.314033:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000079d7ba79 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+11:8386:x1876178898006400:12345-0@lo:503: Request processed in 94us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263678.314049:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789263678.314058:0:8386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002bba77ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:8386:1876178898006400:0@lo:503: 00000040:00080000:0.0:1789263678.314250:0:8386:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789263678.314334:0:8386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002bba77ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:8386:1876178898006528:0@lo:502: 00000100:00100000:0.0:1789263678.314373:0:8386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263678.314402:0:8386:0:(client.c:2715:ptlrpc_set_wait()) set 0000000088045d65 going to sleep for 11 seconds 00000100:00100000:1.0:1789263678.314462:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898006528 00000100:00100000:1.0:1789263678.314468:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898006528 00000100:00100000:1.0:1789263678.314497:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789263678.314505:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cda0045c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+11:8386:x1876178898006528:12345-0@lo:502: 00000100:00100000:1.0:1789263678.314589:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cda0045c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+11:8386:x1876178898006528:12345-0@lo:502: Request processed in 86us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263678.314598:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789263678.314604:0:8386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002bba77ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:8386:1876178898006528:0@lo:502: 00000040:00080000:0.0:1789263678.314753:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1789263678.314778:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1789263678.314796:0:8386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002bba77ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:8386:1876178898006656:0@lo:502: 00000100:00100000:0.0:1789263678.314832:0:8386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263678.314850:0:8386:0:(client.c:2715:ptlrpc_set_wait()) set 0000000088045d65 going to sleep for 11 seconds 00000100:00100000:1.0:1789263678.314873:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898006656 00000100:00100000:1.0:1789263678.314879:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898006656 00000100:00100000:1.0:1789263678.314910:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789263678.314919:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ca6d02b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+11:8386:x1876178898006656:12345-0@lo:502: 00000100:00100000:1.0:1789263678.314992:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ca6d02b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+11:8386:x1876178898006656:12345-0@lo:502: Request processed in 75us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263678.315001:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789263678.315019:0:8386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002bba77ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:8386:1876178898006656:0@lo:502: 00000040:00080000:0.0:1789263678.315069:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1789263678.315096:0:8386:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1789263678.315401:0:8414:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789263678.315409:0:8414:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789263678.315411:0:8414:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789263678.315417:0:8414:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dd9c1b57000 00000020:00000080:0.0:1789263678.315420:0:8414:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789263678.315496:0:8414:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789263678.315501:0:8414:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789263678.315503:0:8414:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1789263678.315506:0:8414:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1789263678.315579:0:8386:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1789263678.315598:0:8386:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789263678.315614:0:8386:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd990433800/0xce1582440fb1d64f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d656 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263678.315623:0:8386:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd990433800/0xce1582440fb1d64f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d656 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789263678.315676:0:8386:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789263678.315680:0:8386:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9dd9c1b57000 10000000:01000000:1.0:1789263678.315683:0:8386:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9dd9c1b57000 10000000:01000000:1.0:1789263678.315687:0:8386:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789263678.315691:0:8386:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9dd9c1b57000 from 1 10000000:01000000:1.0:1789263678.315694:0:8386:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789263678.315714:0:8386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd981682200/0xce1582440fb1d65d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263678.315722:0:8386:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd981682200/0xce1582440fb1d65d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263678.315730:0:8386:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd981682200/0xce1582440fb1d65d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263678.315743:0:8386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:8386:1876178898006784:0@lo:101: 00000100:00100000:1.0:1789263678.315771:0:8386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263678.315810:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898006784 00000100:00100000:1.0:1789263678.315814:0:8386:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9861e6540 going to sleep for 11 seconds 00000100:00100000:0.0:1789263678.315815:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898006784 00000100:00100000:0.0:1789263678.315848:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789263678.315856:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd991564850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+11:8386:x1876178898006784:12345-0@lo:101: 00010000:00010000:0.0:1789263678.315864:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263678.315875:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd990433a00/0xce1582440fb1d664 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1d65d expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263678.315894:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd990433a00/0xce1582440fb1d664 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1d65d expref: 12 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263678.315904:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd990433a00/0xce1582440fb1d664 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d65d expref: 12 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263678.315912:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd990433a00, rc 0) 00000100:00100000:0.0:1789263678.315951:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd991564850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+12:8386:x1876178898006784:12345-0@lo:101: Request processed in 96us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263678.315958:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789263678.315993:0:8386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:8386:1876178898006784:0@lo:101: 00010000:00010000:1.0:1789263678.316007:0:8386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd981682200/0xce1582440fb1d65d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d664 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263678.316017:0:8386:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd981682200/0xce1582440fb1d65d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1d664 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263678.316130:0:8386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:8386:1876178898006912:0@lo:501: 00000100:00100000:1.0:1789263678.316161:0:8386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263678.316200:0:8386:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9861e6540 going to sleep for 11 seconds 00000100:00100000:0.0:1789263678.316288:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898006912 00000100:00100000:0.0:1789263678.316297:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898006912 00000100:00100000:0.0:1789263678.316332:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789263678.316339:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd991564c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+12:8386:x1876178898006912:12345-0@lo:501: 00000100:00100000:0.0:1789263678.316502:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd991564c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+12:8386:x1876178898006912:12345-0@lo:501: Request processed in 162us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263678.316503:0:8386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:8386:1876178898006912:0@lo:501: 00000100:00100000:0.0:1789263678.316516:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789263678.316541:0:8386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:8386:1876178898007040:0@lo:503: 00000100:00100000:1.0:1789263678.316581:0:8386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263678.316605:0:8386:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9861e6540 going to sleep for 11 seconds 00000100:00100000:0.0:1789263678.316680:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898007040 00000100:00100000:0.0:1789263678.316685:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898007040 00000100:00100000:0.0:1789263678.316716:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789263678.316723:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd991567850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+12:8386:x1876178898007040:12345-0@lo:503: 00000100:00100000:0.0:1789263678.316792:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd991567850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+12:8386:x1876178898007040:12345-0@lo:503: Request processed in 70us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263678.316799:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789263678.316854:0:8386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:8386:1876178898007040:0@lo:503: 00000040:00080000:1.0:1789263678.317060:0:8386:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789263678.317239:0:8386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:8386:1876178898007168:0@lo:502: 00000100:00100000:1.0:1789263678.317283:0:8386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263678.317335:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898007168 00000100:00100000:1.0:1789263678.317336:0:8386:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9861e6540 going to sleep for 11 seconds 00000100:00100000:0.0:1789263678.317342:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898007168 00000100:00100000:0.0:1789263678.317378:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789263678.317388:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd991565050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+12:8386:x1876178898007168:12345-0@lo:502: 00000100:00100000:0.0:1789263678.317536:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd991565050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+12:8386:x1876178898007168:12345-0@lo:502: Request processed in 150us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263678.317543:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789263678.317567:0:8386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:8386:1876178898007168:0@lo:502: 00000040:00080000:1.0:1789263678.317720:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1789263678.317738:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1789263678.317746:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1789263678.317753:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1789263678.317760:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1789263678.317772:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1789263678.317796:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1789263678.317810:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1789263678.317822:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1789263678.317834:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1789263678.317847:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1789263678.317859:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1789263678.317871:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1789263678.317884:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1789263678.317896:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1789263678.317906:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1789263678.317913:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1789263678.317919:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1789263678.317933:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1789263678.317939:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1789263678.317946:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1789263678.317952:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1789263678.317965:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1789263678.317973:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1789263678.317983:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1789263678.317995:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1789263678.318007:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1789263678.318019:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:1.0:1789263678.318037:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1789263678.318047:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:1.0:1789263678.318057:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:1.0:1789263678.318069:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:1.0:1789263678.318133:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:1.0:1789263678.318149:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:1.0:1789263678.318159:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:1.0:1789263678.318170:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:1.0:1789263678.318181:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:1.0:1789263678.318200:0:8386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:8386:1876178898007296:0@lo:502: 00000100:00100000:1.0:1789263678.318232:0:8386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263678.318253:0:8386:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9861e6540 going to sleep for 11 seconds 00000100:00100000:3.0:1789263678.318270:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898007296 00000100:00100000:3.0:1789263678.318276:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898007296 00000100:00100000:3.0:1789263678.318304:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789263678.318313:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd991566450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+12:8386:x1876178898007296:12345-0@lo:502: 00000100:00100000:3.0:1789263678.318410:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd991566450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+12:8386:x1876178898007296:12345-0@lo:502: Request processed in 98us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263678.318417:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789263678.318435:0:8386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:8386:1876178898007296:0@lo:502: 00000040:00080000:1.0:1789263678.318472:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:1.0:1789263678.318480:0:8386:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1789263678.318793:0:8415:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1789263678.318804:0:8415:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9dd9c1bab370) 00000020:00000080:1.0:1789263678.318817:0:8415:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type lwp with refcount 2 00000020:01000004:1.0:1789263678.318886:0:8415:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dd9c1b57000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789263678.318890:0:8415:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dd9c1b57000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789263678.318892:0:8415:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dd9c1b57000 3 00010000:00080000:1.0:1789263678.318928:0:8415:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dd88269f000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.120@tcp at head 00010000:00010000:1.0:1789263678.320444:0:8415:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:1.0:1789263678.320634:0:8415:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1789263678.320667:0:8415:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789263678.320677:0:8415:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xce1582440fb1d672 00000100:00080000:1.0:1789263678.320685:0:8415:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789263678.320690:0:8415:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9dd88269f000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:1.0:1789263678.320718:0:8415:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd99f9a6300 x1876178898007424/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789263678.320747:0:8415:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789263678.320808:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3617:1876178898007424:0@lo:38: 00000100:00100000:1.0:1789263678.320849:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9907a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1876178898007552:0@lo:400: 00000100:00100000:0.0:1789263678.320870:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263678.320896:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263678.320934:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898007424 00000100:00100000:0.0:1789263678.320940:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898007424 00000100:00100000:1.0:1789263678.320951:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9907a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898007680:0@lo:400: 00000100:00100000:0.0:1789263678.320971:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898007552 00000100:00100000:2.0:1789263678.320980:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9907a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1876178898007808:0@lo:400: 00000100:00100000:1.0:1789263678.320988:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263678.320989:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898007552 00000100:00100000:2.0:1789263678.321025:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263678.321030:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898007808 00000100:00100000:0.0:1789263678.321035:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898007808 00000100:00100000:1.0:1789263678.321036:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789263678.321048:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1876178898007552:12345-0@lo:400: 00000100:00100000:0.0:1789263678.321071:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789263678.321104:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9907a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1876178898007808:12345-0@lo:400: 00000100:00100000:1.0:1789263678.321134:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1876178898007552:12345-0@lo:400: Request processed in 89us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263678.321135:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1789263678.321145:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:1.0:1789263678.321148:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789263678.321159:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9907a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1876178898007808:12345-0@lo:400: Request processed in 80us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263678.321169:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789263678.321178:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c09f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3617:x1876178898007424:12345-0@lo:38: 00000100:00100000:0.0:1789263678.321182:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789263678.321191:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898007680 00000100:00100000:1.0:1789263678.321196:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898007680 00010000:00080000:2.0:1789263678.321213:0:6489:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 120 last 0 00010000:00080000:0.0:1789263678.321224:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dd9907a7100 x1876178898007808/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263694 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789263678.321232:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789263678.321242:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9907a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1876178898007808:0@lo:400: 00000100:00100000:1.0:1789263678.321245:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898007680:12345-0@lo:400: 00000020:00000080:2.0:1789263678.321264:0:6489:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xce1582440fb1d679 00000004:00100000:2.0:1789263678.321281:0:6489:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:1.0:1789263678.321307:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898007680:12345-0@lo:400: Request processed in 66us (322us total) trans 0 rc 0/0 00000100:00080000:2.0:1789263678.321315:0:6489:0:(import.c:65:import_set_state_nolock()) ffff9dd9ba93e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789263678.321327:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789263678.321340:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9907a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898007680:0@lo:400: 00010000:00080000:0.0:1789263678.321390:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dd99f9a6300 x1876178898007424/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789263688 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789263678.321396:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c09f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1876178898007424:12345-0@lo:38: Request processed in 215us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263678.321406:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00100000:2.0:1789263678.321410:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1789263678.321415:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000020:01000004:1.0:1789263678.321421:0:8415:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000100:00080000:0.0:1789263678.321423:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789263678.321428:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789263678.321433:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd88269f000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789263678.321439:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3617:1876178898007424:0@lo:38: 00000020:00000080:1.0:1789263678.321443:0:8415:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9dd9c1ba8000) 00000020:00000080:1.0:1789263678.321457:0:8415:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00010000:00080000:2.0:1789263678.321514:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dd9907a7480 x1876178898007552/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263694 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789263678.321522:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9907a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1876178898007552:0@lo:400: 00000020:01000004:1.0:1789263678.321559:0:8415:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dd9c1b57000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789263678.321564:0:8415:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dd9c1b57000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789263678.321567:0:8415:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dd9c1b57000 3 00010000:00080000:1.0:1789263678.321611:0:8415:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dd88269d000@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.120@tcp at head 00010000:00010000:1.0:1789263678.323955:0:8415:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-5 is initialized 00000020:00000080:1.0:1789263678.324200:0:8415:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1789263678.324238:0:8415:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789263678.324249:0:8415:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xce1582440fb1d687 00000100:00080000:1.0:1789263678.324259:0:8415:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789263678.324266:0:8415:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9dd88269d000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:1.0:1789263678.324306:0:8415:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd99f9a7480 x1876178898007936/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789263678.324399:0:8415:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1789263678.324435:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3617:1876178898007936:0@lo:38: 00000100:00100000:0.0:1789263678.324502:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263678.324564:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898007936 00000040:00080000:1.0:1789263678.324569:0:8415:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:0.0:1789263678.324571:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898007936 00000100:00100000:0.0:1789263678.324608:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789263678.324616:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c09f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3617:x1876178898007936:12345-0@lo:38: 00000020:01000000:2.0:1789263678.324641:0:8386:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 00010000:00080000:0.0:1789263678.324654:0:7434:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 120 last 0 10000000:01000000:2.0:1789263678.324674:0:8386:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-client' succeeded (0). 00000020:00000080:0.0:1789263678.324693:0:7434:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xce1582440fb1d68e 00010000:00010000:2.0:1789263678.324695:0:8386:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd981682200/0xce1582440fb1d65d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d664 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263678.324710:0:8386:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd981682200/0xce1582440fb1d65d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d664 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00100000:0.0:1789263678.324718:0:7434:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000020:01000004:2.0:1789263678.324754:0:8386:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789263678.324760:0:8386:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789263678.324761:0:8386:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789263678.324763:0:8386:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789263678.324764:0:8386:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789263678.324765:0:8386:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789263678.324767:0:8386:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789263678.324768:0:8386:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789263678.324769:0:8386:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789263678.324771:0:8386:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789263678.324772:0:8386:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789263678.324776:0:8386:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1789263678.324778:0:8386:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789263678.324779:0:8386:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789263678.324781:0:8386:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789263678.324782:0:8386:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789263678.324783:0:8386:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789263678.324784:0:8386:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789263678.324785:0:8386:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789263678.324786:0:8386:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789263678.324787:0:8386:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789263678.324789:0:8386:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789263678.324790:0:8386:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789263678.324807:0:8386:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789263678.324819:0:8386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9907a7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:8386:1876178898008064:0@lo:253: 00000100:00100000:2.0:1789263678.324861:0:8386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263678.324888:0:8386:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd985565300 going to sleep for 11 seconds 00000100:00080000:0.0:1789263678.324900:0:7434:0:(import.c:65:import_set_state_nolock()) ffff9dd881fe9000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789263678.324958:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c09f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1876178898007936:12345-0@lo:38: Request processed in 342us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263678.324967:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1789263678.324993:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dd99f9a7480 x1876178898007936/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789263688 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789263678.325003:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789263678.325009:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1789263678.325016:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789263678.325019:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1789263678.325021:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd88269d000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789263678.325027:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3617:1876178898007936:0@lo:38: 00000100:00100000:1.0:1789263678.325138:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898008064 00000100:00100000:1.0:1789263678.325143:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898008064 00000100:00100000:1.0:1789263678.325178:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789263678.325187:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd988441050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+12:8386:x1876178898008064:12345-0@lo:253: 20000000:01000000:1.0:1789263678.325206:0:6481:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789263678.325221:0:6481:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789263678.330292:0:6481:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789263678.330307:0:6481:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1789263678.330569:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd988441050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+12:8386:x1876178898008064:12345-0@lo:253: Request processed in 5378us (5703us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263678.330581:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789263678.330613:0:8386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9907a7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:8386:1876178898008064:0@lo:253: 10000000:01000000:2.0:1789263678.330635:0:8386:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789263678.330639:0:8386:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789263678.330640:0:8386:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789263678.330642:0:8386:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789263678.330643:0:8386:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789263678.330644:0:8386:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789263678.330645:0:8386:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789263678.330646:0:8386:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789263678.330648:0:8386:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789263678.330649:0:8386:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789263678.330650:0:8386:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789263678.330652:0:8386:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789263678.330666:0:8386:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1789263678.330745:0:6503:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789263678.330751:0:6503:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789263678.330771:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dd990433600/0xce1582440fb1d695 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263678.330785:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd990433600/0xce1582440fb1d695 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789263678.330794:0:6503:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001475076s 00010000:00010000:0.0:1789263678.330799:0:6503:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd990433600/0xce1582440fb1d695 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263678.330806:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd990433600/0xce1582440fb1d695 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263678.330813:0:6503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dd990433600/0xce1582440fb1d695 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263678.330820:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dd990433600/0xce1582440fb1d695 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263678.330825:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd990433600 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:0.0:1789263678.330829:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dd990433600/0xce1582440fb1d695 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263678.330836:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dd990433600/0xce1582440fb1d695 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263678.330854:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dd990433600/0xce1582440fb1d695 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263678.330861:0:6503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dd990433600/0xce1582440fb1d695 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263678.330868:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd990433600/0xce1582440fb1d695 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:2.0:1789263678.334573:0:8386:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1789263678.334733:0:8386:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1789263678.334912:0:8386:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1789263678.335032:0:8386:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1789263678.335251:0:8386:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1789263678.335494:0:8386:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:0.0:1789263678.336308:0:8386:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1789263678.342145:0:8386:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1789263678.342161:0:8386:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1789263678.342195:0:8386:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789263678.342235:0:8386:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.120@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789263678.342253:0:8386:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1789263678.342269:0:8386:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1789263678.343182:0:8386:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789263678.343366:0:8386:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00000020:00000004:2.0:1789263678.705470:0:8472:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789263678.705677:0:8472:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:3.0:1789263678.893170:0:6484:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789263678.893176:0:6484:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9dd9c0889800 from 30 10000000:01000000:3.0:1789263678.893181:0:6484:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789263678.893222:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd981530200/0xce1582440fb1d69c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263678.893241:0:6484:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd981530200/0xce1582440fb1d69c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263678.893251:0:6484:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd981530200/0xce1582440fb1d69c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263678.893252:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789263678.893271:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9c08a9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898008192:0@lo:101: 00000100:00100000:3.0:1789263678.893339:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263678.893392:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd882684a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789263678.893392:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898008192 00000100:00100000:0.0:1789263678.893400:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898008192 00000100:00100000:0.0:1789263678.893452:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789263678.893462:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd988442050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+12:6484:x1876178898008192:12345-0@lo:101: 00010000:00010000:0.0:1789263678.893475:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263678.893488:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd990432200/0xce1582440fb1d6a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1d69c expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263678.893512:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd990432200/0xce1582440fb1d6a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1d69c expref: 13 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263678.893536:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd990432200/0xce1582440fb1d6a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d69c expref: 13 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263678.893546:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd990432200, rc 0) 00000100:00100000:0.0:1789263678.893599:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd988442050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+13:6484:x1876178898008192:12345-0@lo:101: Request processed in 138us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263678.893606:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789263678.893662:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9c08a9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898008192:0@lo:101: 00010000:00010000:3.0:1789263678.893678:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd981530200/0xce1582440fb1d69c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d6a3 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263678.893686:0:6484:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd981530200/0xce1582440fb1d69c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1d6a3 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263678.893754:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9c08a9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898008320:0@lo:501: 00000100:00100000:3.0:1789263678.893782:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263678.893813:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd882684a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789263678.893875:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898008320 00000100:00100000:0.0:1789263678.893880:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898008320 00000100:00100000:0.0:1789263678.893908:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789263678.893916:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd988442c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+13:6484:x1876178898008320:12345-0@lo:501: 00000100:00100000:0.0:1789263678.894020:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd988442c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+13:6484:x1876178898008320:12345-0@lo:501: Request processed in 106us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263678.894025:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789263678.894063:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9c08a9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898008320:0@lo:501: 00000100:00100000:3.0:1789263678.894121:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9c08a9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898008448:0@lo:503: 00000100:00100000:3.0:1789263678.894165:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263678.894193:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd882684a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789263678.894213:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898008448 00000100:00100000:2.0:1789263678.894218:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898008448 00000100:00100000:2.0:1789263678.894249:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789263678.894257:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a07450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+13:6484:x1876178898008448:12345-0@lo:503: 00000100:00100000:2.0:1789263678.894368:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a07450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+13:6484:x1876178898008448:12345-0@lo:503: Request processed in 111us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263678.894376:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789263678.894380:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9c08a9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898008448:0@lo:503: 00000100:00100000:3.0:1789263678.894624:0:8493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9c08a9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:8493:1876178898008576:0@lo:502: 00000100:00100000:3.0:1789263678.894658:0:8493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263678.894674:0:8493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd882684840 going to sleep for 11 seconds 00000100:00100000:0.0:1789263678.894722:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898008576 00000100:00100000:0.0:1789263678.894727:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898008576 00000100:00100000:0.0:1789263678.894755:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789263678.894764:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a07050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+13:8493:x1876178898008576:12345-0@lo:502: 00000100:00100000:0.0:1789263678.894865:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a07050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+13:8493:x1876178898008576:12345-0@lo:502: Request processed in 101us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263678.894872:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789263678.894877:0:8493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9c08a9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:8493:1876178898008576:0@lo:502: 00000100:00100000:3.0:1789263678.894912:0:8493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9c08a9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:8493:1876178898008704:0@lo:502: 00000100:00100000:3.0:1789263678.894936:0:8493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263678.894948:0:8493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd882684840 going to sleep for 11 seconds 00000100:00100000:2.0:1789263678.894973:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898008704 00000100:00100000:2.0:1789263678.894978:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898008704 00000100:00100000:2.0:1789263678.895008:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789263678.895015:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a05850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+13:8493:x1876178898008704:12345-0@lo:502: 00000100:00100000:2.0:1789263678.895189:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a05850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+13:8493:x1876178898008704:12345-0@lo:502: Request processed in 172us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263678.895197:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789263678.895202:0:8493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9c08a9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:8493:1876178898008704:0@lo:502: 00000040:00080000:3.0:1789263678.895220:0:8493:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1789263678.895285:0:6484:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1789263678.895307:0:6484:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789263678.895326:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd981530200/0xce1582440fb1d69c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d6a3 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263678.895335:0:6484:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd981530200/0xce1582440fb1d69c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d6a3 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789263678.895343:0:6484:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789263678.895345:0:6484:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9dd9c0889800 from 4 10000000:01000000:2.0:1789263678.895348:0:6484:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789263678.895369:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9813fd400/0xce1582440fb1d6aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263678.895386:0:6484:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd9813fd400/0xce1582440fb1d6aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263678.895394:0:6484:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd9813fd400/0xce1582440fb1d6aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263678.895407:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9907a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898008832:0@lo:101: 00000100:00100000:2.0:1789263678.895433:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263678.895459:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd986339240 going to sleep for 11 seconds 00000100:00100000:0.0:1789263678.895553:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898008832 00000100:00100000:0.0:1789263678.895557:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898008832 00000100:00100000:0.0:1789263678.895583:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789263678.895589:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a07850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+13:6484:x1876178898008832:12345-0@lo:101: 00010000:00010000:0.0:1789263678.895597:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263678.895614:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd990433e00/0xce1582440fb1d6b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1d6aa expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263678.895643:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd990433e00/0xce1582440fb1d6b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1d6aa expref: 14 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263678.895653:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd990433e00/0xce1582440fb1d6b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d6aa expref: 14 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263678.895662:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd990433e00, rc 0) 00000100:00100000:0.0:1789263678.895698:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a07850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+14:6484:x1876178898008832:12345-0@lo:101: Request processed in 109us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263678.895705:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789263678.895773:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9907a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898008832:0@lo:101: 00010000:00010000:2.0:1789263678.895785:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd9813fd400/0xce1582440fb1d6aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d6b1 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263678.895804:0:6484:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd9813fd400/0xce1582440fb1d6aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1d6b1 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263678.895851:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9907a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898008960:0@lo:256: 00000100:00100000:2.0:1789263678.895881:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263678.895901:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd986339240 going to sleep for 11 seconds 00000100:00100000:0.0:1789263678.895945:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898008960 00000100:00100000:0.0:1789263678.895949:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898008960 00000100:00100000:0.0:1789263678.895977:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789263678.895992:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a04050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+14:6484:x1876178898008960:12345-0@lo:256: 20000000:01000000:0.0:1789263678.896009:0:6482:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789263678.896026:0:6482:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789263678.896030:0:6482:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:0.0:1789263678.896034:0:6482:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 88, version 5 00000100:00100000:0.0:1789263678.896240:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a04050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+14:6484:x1876178898008960:12345-0@lo:256: Request processed in 249us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263678.896247:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789263678.896323:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9907a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898008960:0@lo:256: 10000000:01000000:2.0:1789263678.896461:0:6484:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789263678.896469:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9813fd400/0xce1582440fb1d6aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d6b1 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263678.896477:0:6484:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd9813fd400/0xce1582440fb1d6aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d6b1 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789263678.896485:0:6484:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1789263678.896487:0:6484:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:2.0:1789263678.896490:0:6484:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1789263678.896506:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9813fd800/0xce1582440fb1d6b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263678.896514:0:6484:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd9813fd800/0xce1582440fb1d6b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263678.896522:0:6484:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd9813fd800/0xce1582440fb1d6b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263678.896536:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9907a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898009088:0@lo:101: 00000100:00100000:2.0:1789263678.896573:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263678.896600:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd986339240 going to sleep for 11 seconds 00000100:00100000:0.0:1789263678.896648:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898009088 00000100:00100000:0.0:1789263678.896652:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898009088 00000100:00100000:0.0:1789263678.896681:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789263678.896689:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a04850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+14:6484:x1876178898009088:12345-0@lo:101: 00010000:00010000:0.0:1789263678.896697:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263678.896713:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd990433200/0xce1582440fb1d6bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1d6b8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263678.896728:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd990433200/0xce1582440fb1d6bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1d6b8 expref: 15 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263678.896737:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd990433200/0xce1582440fb1d6bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d6b8 expref: 15 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263678.896744:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd990433200, rc 0) 00000100:00100000:0.0:1789263678.896811:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a04850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+15:6484:x1876178898009088:12345-0@lo:101: Request processed in 123us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263678.896818:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789263678.896876:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9907a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898009088:0@lo:101: 00010000:00010000:2.0:1789263678.896886:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd9813fd800/0xce1582440fb1d6b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d6bf expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263678.896894:0:6484:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd9813fd800/0xce1582440fb1d6b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1d6bf expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263678.896941:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9907a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898009216:0@lo:501: 00000100:00100000:2.0:1789263678.896965:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263678.897020:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd986339240 going to sleep for 11 seconds 00000100:00100000:0.0:1789263678.897054:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898009216 00000100:00100000:0.0:1789263678.897060:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898009216 00000100:00100000:0.0:1789263678.897213:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789263678.897222:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a06850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+15:6484:x1876178898009216:12345-0@lo:501: 00000100:00100000:0.0:1789263678.897426:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a06850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+15:6484:x1876178898009216:12345-0@lo:501: Request processed in 206us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263678.897433:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789263678.897537:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9907a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898009216:0@lo:501: 00000100:00100000:2.0:1789263678.897562:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9907a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898009344:0@lo:503: 00000100:00100000:2.0:1789263678.897595:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263678.897654:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd986339240 going to sleep for 11 seconds 00000100:00100000:0.0:1789263678.897926:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898009344 00000100:00100000:0.0:1789263678.897931:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898009344 00000100:00100000:0.0:1789263678.897966:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789263678.897973:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a04450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+15:6484:x1876178898009344:12345-0@lo:503: 00000100:00100000:3.0:1789263678.898844:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9907a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898009344:0@lo:503: 00000100:00100000:0.0:1789263678.898844:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a04450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+15:6484:x1876178898009344:12345-0@lo:503: Request processed in 862us (1239us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263678.898863:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789263678.899427:0:8495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9c09f7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:8495:1876178898009472:0@lo:502: 00000100:00100000:0.0:1789263678.899610:0:8495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263678.899665:0:8495:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9c0b53b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789263678.899668:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898009472 00000100:00100000:1.0:1789263678.899679:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898009472 00000100:00100000:1.0:1789263678.899733:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789263678.899742:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a07c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+15:8495:x1876178898009472:12345-0@lo:502: 00000100:00100000:1.0:1789263678.899873:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a07c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+15:8495:x1876178898009472:12345-0@lo:502: Request processed in 132us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263678.899881:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789263678.901749:0:8495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9c09f7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:8495:1876178898009472:0@lo:502: 00000020:01000000:0.0:1789263678.901797:0:8495:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789263678.901809:0:8495:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1789263678.901820:0:8495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789263678.901822:0:8495:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1789263678.901830:0:8495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789263678.901835:0:8495:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.120@tcp to nid 0x20000c0a8cb78 (192.168.203.120@tcp) 00000020:01000000:0.0:1789263678.901872:0:8495:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1789263678.901876:0:8495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789263678.901907:0:8495:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9dd9c09c19b8) 00000020:00000080:0.0:1789263678.901938:0:8495:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osp with refcount 2 00000020:00000080:0.0:1789263678.901945:0:8495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789263678.902138:0:8495:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1789263678.902147:0:8495:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:0.0:1789263678.902160:0:8495:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xce1582440fb1d6cd 00010000:00080000:0.0:1789263678.902201:0:8495:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dd9b7a92800@lustre-OST0000-osc-MDT0001: add connection 192.168.203.120@tcp at head 00010000:00010000:0.0:1789263678.902610:0:8495:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000040:01000000:1.0:1789263678.909237:0:8495:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1789263678.909260:0:8495:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1789263678.909492:0:8495:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789263678.909705:0:8495:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789263678.909796:0:8495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1789263678.909881:0:8495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1789263678.910134:0:8497:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789263678.910138:0:8497:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1789263678.910667:0:8495:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789263678.910679:0:8495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789263678.910719:0:8495:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789263678.910743:0:8495:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xce1582440fb1d6d4 00000100:00080000:1.0:1789263678.910755:0:8495:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789263678.910762:0:8495:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9dd9b7a92800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:1.0:1789263678.910796:0:8495:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd99f9a4700 x1876178898009600/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789263678.910819:0:8495:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:2.0:1789263678.910851:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1876178898009600:0@lo:8: 00000020:01000000:1.0:1789263678.910878:0:8495:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789263678.910884:0:8495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789263678.910886:0:8495:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1789263678.910890:0:8495:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789263678.910895:0:8495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789263678.910897:0:8495:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789263678.910901:0:8495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789263678.910903:0:8495:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789263678.910932:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263678.910937:0:8495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:8495:1876178898009728:0@lo:502: 00000100:00100000:1.0:1789263678.910983:0:8495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263678.911004:0:8495:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9bb790300 going to sleep for 11 seconds 00000100:00100000:1.0:1789263678.911042:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9907a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876178898009856:0@lo:400: 00000100:00100000:1.0:1789263678.911098:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263678.911110:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9907a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898009984:0@lo:400: 00000100:00100000:3.0:1789263678.911128:0:8392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898009600 00000100:00100000:1.0:1789263678.911131:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9907a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1876178898010368:0@lo:400: 00000100:00100000:3.0:1789263678.911137:0:8392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898009600 00000100:00100000:2.0:1789263678.911161:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263678.911166:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263678.911196:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9907a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1876178898010112:0@lo:400: 00000100:00100000:2.0:1789263678.911227:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9907a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3621:1876178898010240:0@lo:400: 00000100:00100000:3.0:1789263678.911259:0:8392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789263678.911264:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263678.911273:0:8392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9907a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3617:x1876178898009600:12345-0@lo:8: 00010000:00080000:3.0:1789263678.911299:0:8392:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 121 last 0 00000100:00100000:2.0:1789263678.911300:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898009856 00000100:00100000:2.0:1789263678.911305:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898009856 00000020:00000080:3.0:1789263678.911340:0:8392:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xce1582440fb1d6db 00000100:00100000:2.0:1789263678.911364:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898010368 00000100:00100000:2.0:1789263678.911369:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898010368 00002000:00100000:3.0:1789263678.911372:0:8392:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9dd881f8e800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 1 00000100:00100000:1.0:1789263678.911373:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898010240 00002000:00080000:3.0:1789263678.911380:0:8392:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000100:00100000:1.0:1789263678.911381:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898010240 00000001:00000004:3.0:1789263678.911384:0:8392:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:2.0:1789263678.911420:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789263678.911428:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789263678.911432:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876178898009856:12345-0@lo:400: 00000100:00100000:1.0:1789263678.911441:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876178898010368:12345-0@lo:400: 00000100:00100000:2.0:1789263678.911493:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876178898009856:12345-0@lo:400: Request processed in 64us (417us total) trans 0 rc 0/0 00002000:00100000:3.0:1789263678.911495:0:8392:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1789263678.911496:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876178898010368:12345-0@lo:400: Request processed in 57us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263678.911509:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789263678.911516:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789263678.911531:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789263678.911541:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9907a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1876178898010240:12345-0@lo:400: 00000100:00100000:2.0:1789263678.911588:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9907a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1876178898010240:12345-0@lo:400: Request processed in 49us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263678.911595:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1789263678.911614:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd9907a4000 x1876178898010240/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263694 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789263678.911621:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898009984 00000100:00100000:2.0:1789263678.911626:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898009984 00000100:00100000:1.0:1789263678.911629:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9907a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3621:1876178898010240:0@lo:400: 00000100:00100000:2.0:1789263678.911671:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789263678.911677:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1789263678.911682:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9907a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1876178898009984:12345-0@lo:400: 00000100:00100000:1.0:1789263678.911688:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1789263678.911733:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9907a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1876178898009984:12345-0@lo:400: Request processed in 53us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263678.911741:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789263678.911748:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9907a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898009984:0@lo:400: 00000100:00080000:2.0:1789263678.911765:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789263678.911771:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00002000:00080000:3.0:1789263678.911778:0:8392:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00100000:2.0:1789263678.911788:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789263678.911803:0:8392:0:(import.c:65:import_set_state_nolock()) ffff9dd881f8d800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789263678.911810:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898010112 00000100:00100000:1.0:1789263678.911815:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898010112 00000100:00100000:1.0:1789263678.911848:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789263678.911858:0:8392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9907a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3617:x1876178898009600:12345-0@lo:8: Request processed in 586us (924us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263678.911859:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9907a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1876178898010112:12345-0@lo:400: 00000100:00100000:3.0:1789263678.911874:0:8392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789263678.911913:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9907a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1876178898010112:12345-0@lo:400: Request processed in 57us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263678.911931:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1789263678.911935:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd9907a4e00 x1876178898010112/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263694 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789263678.911948:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9907a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1876178898010112:0@lo:400: 00010000:00080000:2.0:1789263678.911976:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd99f9a4700 x1876178898009600/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789263688 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789263678.911996:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789263678.912003:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1789263678.912011:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789263678.912016:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1789263678.912019:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd9b7a92800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789263678.912029:0:3617:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789263678.912035:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1876178898009600:0@lo:8: 00000004:00080000:1.0:1789263678.912043:0:8497:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00010000:00080000:2.0:1789263678.912065:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd9907a4380 x1876178898010368/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263694 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789263678.912101:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9907a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1876178898010368:0@lo:400: 00010000:00080000:2.0:1789263678.912114:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd9907a7b80 x1876178898009856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263694 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789263678.912122:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9907a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876178898009856:0@lo:400: 00000004:00080000:1.0:1789263678.912128:0:8497:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 121202049620ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789263678.912136:0:8497:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1789263678.912445:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898009728 00000100:00100000:1.0:1789263678.912451:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898009728 00000100:00100000:1.0:1789263678.912493:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789263678.912503:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a05c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+15:8495:x1876178898009728:12345-0@lo:502: 00000100:00100000:1.0:1789263678.912631:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a05c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+15:8495:x1876178898009728:12345-0@lo:502: Request processed in 130us (1646us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263678.912639:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789263678.912704:0:8495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:8495:1876178898009728:0@lo:502: 00000100:00100000:1.0:1789263678.912705:0:8498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a5500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8498:1876178898010496:0@lo:700: 00000020:01000000:2.0:1789263678.912738:0:8495:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789263678.912746:0:8495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263678.912748:0:8495:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000100:00100000:1.0:1789263678.912754:0:8498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1789263678.912755:0:8495:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000100:00100000:1.0:1789263678.912777:0:8498:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9bb7903c0 going to sleep for 11 seconds 00000020:01000000:1.0:1789263678.912837:0:6484:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:1.0:1789263678.912872:0:6484:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1789263678.912883:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9813fd800/0xce1582440fb1d6b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d6bf expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263678.912895:0:6484:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd9813fd800/0xce1582440fb1d6b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d6bf expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789263678.912905:0:6484:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789263678.912908:0:6484:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dd9c0889800 from 1 10000000:01000000:1.0:1789263678.912911:0:6484:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789263678.912934:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd981682600/0xce1582440fb1d6e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263678.912943:0:6484:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd981682600/0xce1582440fb1d6e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263678.912961:0:6484:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd981682600/0xce1582440fb1d6e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263678.912973:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898010624:0@lo:101: 00000100:00100000:1.0:1789263678.913002:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263678.913036:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9bb7900c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789263678.913058:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898010624 00000100:00100000:2.0:1789263678.913064:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898010624 00000100:00100000:2.0:1789263678.913115:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789263678.913124:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a04c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+15:6484:x1876178898010624:12345-0@lo:101: 00010000:00010000:2.0:1789263678.913134:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263678.913146:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd9813fc400/0xce1582440fb1d6e9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1d6e2 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263678.913188:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd9813fc400/0xce1582440fb1d6e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1d6e2 expref: 16 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263678.913202:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd9813fc400/0xce1582440fb1d6e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d6e2 expref: 16 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263678.913211:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9813fc400, rc 0) 00000100:00100000:2.0:1789263678.913256:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a04c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+16:6484:x1876178898010624:12345-0@lo:101: Request processed in 133us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263678.913262:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789263678.913301:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898010624:0@lo:101: 00010000:00010000:2.0:1789263678.913324:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd981682600/0xce1582440fb1d6e2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d6e9 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263678.913333:0:6484:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd981682600/0xce1582440fb1d6e2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1d6e9 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263678.913391:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9907a7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898010752:0@lo:501: 00000100:00100000:2.0:1789263678.913424:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263678.913462:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9863393c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789263678.913484:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898010752 00000100:00100000:2.0:1789263678.913488:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898010752 00000100:00100000:0.0:1789263678.913498:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898010496 00000100:00100000:0.0:1789263678.913504:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898010496 00000100:00100000:2.0:1789263678.913522:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789263678.913531:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a05050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+16:6484:x1876178898010752:12345-0@lo:501: 00000100:00080000:1.0:1789263678.913540:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789263678.913552:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789263678.913561:0:8402:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 2 min 2 max 16 00000100:00100000:0.0:1789263678.913563:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8498:x1876178898010496:12345-0@lo:700: 00000100:00100000:1.0:1789263678.913586:0:8402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_002' 00000100:00100000:0.0:1789263678.913593:0:8401:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9c09f7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8401:1876178898010880:0@lo:700: 00000100:00100000:0.0:1789263678.913631:0:8401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263678.913658:0:8401:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9c0b53f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789263678.913663:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a05050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+16:6484:x1876178898010752:12345-0@lo:501: Request processed in 132us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263678.913671:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789263678.913689:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898010880 00000100:00100000:0.0:1789263678.913695:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898010880 00000100:00100000:0.0:1789263678.913740:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789263678.913749:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c09f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8401:x1876178898010880:12345-0@lo:700: 00000100:00100000:1.0:1789263678.913792:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9907a7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898010752:0@lo:501: 00000100:00100000:1.0:1789263678.913832:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898011008:0@lo:503: 00000100:00100000:1.0:1789263678.913872:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263678.913894:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9bb7900c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789263678.913917:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898011008 00000100:00100000:3.0:1789263678.913926:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898011008 00000100:00100000:3.0:1789263678.913955:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789263678.913962:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a06050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+16:6484:x1876178898011008:12345-0@lo:503: 00000100:00100000:3.0:1789263678.914042:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a06050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+16:6484:x1876178898011008:12345-0@lo:503: Request processed in 80us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263678.914103:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898011008:0@lo:503: 00000100:00100000:3.0:1789263678.914136:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000004:00080000:2.0:1789263678.914195:0:7417:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:2.0:1789263678.914876:0:8502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9907a4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:8502:1876178898011136:0@lo:502: 00000100:00100000:2.0:1789263678.914913:0:8502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263678.914940:0:8502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9c09e7f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789263678.914954:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898011136 00000100:00100000:3.0:1789263678.914960:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898011136 00000100:00100000:3.0:1789263678.915032:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789263678.915040:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a06c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+16:8502:x1876178898011136:12345-0@lo:502: 00000100:00100000:3.0:1789263678.915273:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a06c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+16:8502:x1876178898011136:12345-0@lo:502: Request processed in 234us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263678.915281:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789263678.915380:0:8502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9907a4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:8502:1876178898011136:0@lo:502: 00000020:01000000:1.0:1789263678.915407:0:8502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789263678.915415:0:8502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789263678.915418:0:8502:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789263678.915433:0:8502:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dd9c0889800 00000020:00000080:1.0:1789263678.915437:0:8502:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789263678.915461:0:8502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:8502:1876178898011264:0@lo:502: 00000100:00100000:1.0:1789263678.915498:0:8502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263678.915557:0:8502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9bb790300 going to sleep for 11 seconds 00000100:00100000:3.0:1789263678.915574:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898011264 00000100:00100000:3.0:1789263678.915579:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898011264 00000100:00100000:3.0:1789263678.915603:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789263678.915610:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a06450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+16:8502:x1876178898011264:12345-0@lo:502: 00000100:00100000:3.0:1789263678.915690:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a06450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+16:8502:x1876178898011264:12345-0@lo:502: Request processed in 79us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263678.915697:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789263678.915714:0:8502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:8502:1876178898011264:0@lo:502: 00000020:01000000:1.0:1789263678.915736:0:8502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789263678.915758:0:8502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789263678.915760:0:8502:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1789263678.915763:0:8502:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1789263678.915826:0:6484:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1789263678.915850:0:6484:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789263678.915859:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd981682600/0xce1582440fb1d6e2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d6e9 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263678.915869:0:6484:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd981682600/0xce1582440fb1d6e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d6e9 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789263678.915878:0:6484:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789263678.915880:0:6484:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9dd9896b8000 from 21 10000000:01000000:2.0:1789263678.915882:0:6484:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789263678.915902:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9813fc600/0xce1582440fb1d6f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263678.915910:0:6484:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd9813fc600/0xce1582440fb1d6f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263678.915918:0:6484:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd9813fc600/0xce1582440fb1d6f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263678.915929:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9907a4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898011392:0@lo:101: 00000100:00100000:2.0:1789263678.915954:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263678.915980:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9c09e73c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789263678.916018:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898011392 00000100:00100000:3.0:1789263678.916022:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898011392 00000100:00100000:3.0:1789263678.916046:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789263678.916053:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a05450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+16:6484:x1876178898011392:12345-0@lo:101: 00010000:00010000:3.0:1789263678.916061:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263678.916071:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd981530600/0xce1582440fb1d6f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1d6f0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263678.916174:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd981530600/0xce1582440fb1d6f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1d6f0 expref: 17 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263678.916184:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd981530600/0xce1582440fb1d6f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d6f0 expref: 17 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263678.916192:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981530600, rc 0) 00000100:00100000:3.0:1789263678.916227:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a05450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+17:6484:x1876178898011392:12345-0@lo:101: Request processed in 171us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263678.916233:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789263678.916258:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9907a4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898011392:0@lo:101: 00010000:00010000:2.0:1789263678.916273:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd9813fc600/0xce1582440fb1d6f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d6f7 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263678.916288:0:6484:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd9813fc600/0xce1582440fb1d6f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1d6f7 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263678.916345:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9907a4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898011520:0@lo:501: 00000100:00100000:2.0:1789263678.916387:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263678.916407:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9c09e73c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789263678.916562:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898011520 00000100:00100000:1.0:1789263678.916568:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898011520 00000100:00100000:1.0:1789263678.916600:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789263678.916608:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+17:6484:x1876178898011520:12345-0@lo:501: 00000100:00100000:1.0:1789263678.916702:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+17:6484:x1876178898011520:12345-0@lo:501: Request processed in 94us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263678.916709:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789263678.916716:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9907a4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898011520:0@lo:501: 00000100:00100000:2.0:1789263678.916747:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9907a4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898011648:0@lo:503: 00000100:00100000:2.0:1789263678.916788:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263678.916807:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9c09e73c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789263678.916825:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898011648 00000100:00100000:3.0:1789263678.916830:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898011648 00000100:00100000:3.0:1789263678.916858:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789263678.916865:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+17:6484:x1876178898011648:12345-0@lo:503: 00000100:00100000:3.0:1789263678.916937:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+17:6484:x1876178898011648:12345-0@lo:503: Request processed in 71us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263678.916944:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789263678.916948:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9907a4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898011648:0@lo:503: 00000100:00100000:2.0:1789263678.917252:0:8503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9907a4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:8503:1876178898011776:0@lo:502: 00000100:00100000:2.0:1789263678.917287:0:8503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263678.917527:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898011776 00000100:00100000:1.0:1789263678.917532:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898011776 00000100:00100000:2.0:1789263678.917552:0:8503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9c09e7f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789263678.917569:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789263678.917578:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+17:8503:x1876178898011776:12345-0@lo:502: 00000100:00100000:1.0:1789263678.917695:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+17:8503:x1876178898011776:12345-0@lo:502: Request processed in 117us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263678.917702:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789263678.917758:0:8503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9907a4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:8503:1876178898011776:0@lo:502: 00000100:00100000:2.0:1789263678.917798:0:8503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9907a4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:8503:1876178898011904:0@lo:502: 00000100:00100000:2.0:1789263678.917837:0:8503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263678.917887:0:8503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9c09e7f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789263678.917916:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898011904 00000100:00100000:1.0:1789263678.917920:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898011904 00000100:00100000:1.0:1789263678.917950:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789263678.917959:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+17:8503:x1876178898011904:12345-0@lo:502: 00000100:00100000:2.0:1789263678.918071:0:8503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9907a4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:8503:1876178898011904:0@lo:502: 00000100:00100000:1.0:1789263678.918072:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+17:8503:x1876178898011904:12345-0@lo:502: Request processed in 115us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263678.918112:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000040:00080000:2.0:1789263678.918161:0:8503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1789263678.918223:0:6484:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-38 (rc=0) 10000000:01000000:1.0:1789263678.918251:0:6484:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789263678.918258:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9813fc600/0xce1582440fb1d6f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d6f7 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263678.918284:0:6484:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd9813fc600/0xce1582440fb1d6f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d6f7 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789263678.918294:0:6484:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789263678.918296:0:6484:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9dd9896b8000 from 4 10000000:01000000:1.0:1789263678.918304:0:6484:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789263678.918335:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd981683400/0xce1582440fb1d6fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263678.918344:0:6484:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd981683400/0xce1582440fb1d6fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263678.918360:0:6484:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd981683400/0xce1582440fb1d6fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263678.918377:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898012032:0@lo:101: 00000100:00100000:1.0:1789263678.918408:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263678.918429:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898012032 00000100:00100000:2.0:1789263678.918433:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898012032 00000100:00100000:1.0:1789263678.918444:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9bb7786c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789263678.918467:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789263678.918477:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+17:6484:x1876178898012032:12345-0@lo:101: 00010000:00010000:2.0:1789263678.918492:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263678.918504:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd9813fda00/0xce1582440fb1d705 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1d6fe expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263678.918525:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd9813fda00/0xce1582440fb1d705 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1d6fe expref: 18 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263678.918536:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd9813fda00/0xce1582440fb1d705 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d6fe expref: 18 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263678.918545:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9813fda00, rc 0) 00000100:00100000:1.0:1789263678.918595:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898012032:0@lo:101: 00000100:00100000:2.0:1789263678.918596:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+18:6484:x1876178898012032:12345-0@lo:101: Request processed in 101us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263678.918605:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00010000:1.0:1789263678.918608:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd981683400/0xce1582440fb1d6fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d705 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263678.918623:0:6484:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd981683400/0xce1582440fb1d6fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1d705 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263678.918666:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898012160:0@lo:256: 00000100:00100000:1.0:1789263678.918696:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263678.918722:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9bb7786c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789263678.918737:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898012160 00000100:00100000:3.0:1789263678.918743:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898012160 00000100:00100000:3.0:1789263678.918775:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789263678.918785:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+18:6484:x1876178898012160:12345-0@lo:256: 20000000:01000000:3.0:1789263678.918800:0:6480:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789263678.918815:0:6480:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789263678.918819:0:6480:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1789263678.918822:0:6480:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 88, version 5 00000100:00100000:3.0:1789263678.918919:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+18:6484:x1876178898012160:12345-0@lo:256: Request processed in 135us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263678.918931:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898012160:0@lo:256: 00000100:00100000:3.0:1789263678.918944:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 10000000:01000000:1.0:1789263678.918977:0:6484:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789263678.918983:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd981683400/0xce1582440fb1d6fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d705 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263678.918997:0:6484:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd981683400/0xce1582440fb1d6fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d705 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789263678.919005:0:6484:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1789263678.919007:0:6484:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1789263678.919009:0:6484:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789263678.919025:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd981683600/0xce1582440fb1d70c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263678.919032:0:6484:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd981683600/0xce1582440fb1d70c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263678.919040:0:6484:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd981683600/0xce1582440fb1d70c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263678.919054:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898012288:0@lo:101: 40000000:02000000:3.0:1789263678.919070:0:6494:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:1.0:1789263678.919103:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263678.919121:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898012288 00000100:00100000:1.0:1789263678.919121:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9861e60c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789263678.919125:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898012288 00000100:00100000:2.0:1789263678.919150:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789263678.919158:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+18:6484:x1876178898012288:12345-0@lo:101: 00010000:00010000:2.0:1789263678.919165:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263678.919173:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd9813fde00/0xce1582440fb1d713 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1d70c expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263678.919187:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd9813fde00/0xce1582440fb1d713 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1d70c expref: 19 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263678.919196:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd9813fde00/0xce1582440fb1d713 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d70c expref: 19 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263678.919203:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9813fde00, rc 0) 00000100:00100000:2.0:1789263678.919238:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+19:6484:x1876178898012288:12345-0@lo:101: Request processed in 82us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263678.919245:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789263678.919247:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898012288:0@lo:101: 00010000:00010000:1.0:1789263678.919256:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd981683600/0xce1582440fb1d70c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d713 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263678.919265:0:6484:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd981683600/0xce1582440fb1d70c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1d713 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263678.919327:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898012416:0@lo:501: 00000100:00100000:1.0:1789263678.919352:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263678.919376:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9861e60c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789263678.919534:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898012416 00000100:00100000:2.0:1789263678.919539:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898012416 00000100:00100000:2.0:1789263678.919561:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789263678.919566:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+19:6484:x1876178898012416:12345-0@lo:501: 00000100:00100000:2.0:1789263678.919649:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+19:6484:x1876178898012416:12345-0@lo:501: Request processed in 82us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263678.919655:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789263678.919669:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898012416:0@lo:501: 00000100:00100000:0.0:1789263678.919701:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9c09f5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898012544:0@lo:503: 00000100:00100000:0.0:1789263678.919734:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263678.919748:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898012544 00000100:00100000:0.0:1789263678.919750:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9c0b53e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789263678.919755:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898012544 00000100:00100000:0.0:1789263678.919792:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789263678.919802:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+19:6484:x1876178898012544:12345-0@lo:503: 00000100:00100000:0.0:1789263678.919873:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+19:6484:x1876178898012544:12345-0@lo:503: Request processed in 74us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263678.919879:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789263678.919908:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9c09f5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898012544:0@lo:503: 00000100:00100000:1.0:1789263678.920763:0:8504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:8504:1876178898012672:0@lo:502: 00000100:00100000:1.0:1789263678.920802:0:8504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263678.920826:0:8504:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9861e6000 going to sleep for 11 seconds 00000100:00100000:2.0:1789263678.920844:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898012672 00000100:00100000:2.0:1789263678.920849:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898012672 00000100:00100000:2.0:1789263678.920874:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789263678.920882:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+19:8504:x1876178898012672:12345-0@lo:502: 00000100:00100000:2.0:1789263678.920955:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+19:8504:x1876178898012672:12345-0@lo:502: Request processed in 74us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263678.920962:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789263678.920964:0:8504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:8504:1876178898012672:0@lo:502: 00000020:01000000:1.0:1789263678.920985:0:8504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789263678.920993:0:8504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789263678.920995:0:8504:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1789263678.921000:0:8504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789263678.921004:0:8504:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.120@tcp to nid 0x20000c0a8cb78 (192.168.203.120@tcp) 00000020:00000080:1.0:1789263678.921024:0:8504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789263678.921047:0:8504:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9dd9bf8f19b8) 00000020:00000080:1.0:1789263678.921068:0:8504:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:1.0:1789263678.921116:0:8504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789263678.921204:0:8504:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1789263678.921210:0:8504:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:1.0:1789263678.921220:0:8504:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xce1582440fb1d721 00010000:00080000:1.0:1789263678.921255:0:8504:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dd984ce7000@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.120@tcp at head 00010000:00010000:1.0:1789263678.923074:0:8504:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-7 is initialized 00000100:00100000:3.0:1789263678.923915:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c09f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8401:x1876178898010880:12345-0@lo:700: Request processed in 10162us (10279us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263678.923928:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789263678.923942:0:8401:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd9c09f7b80 x1876178898010880/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789263694 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789263678.923958:0:8401:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9c09f7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8401:1876178898010880:0@lo:700: 40000000:02000000:2.0:1789263678.923972:0:8401:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000020:00000080:1.0:1789263678.924110:0:8504:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789263678.924124:0:8504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1789263678.924160:0:8504:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789263678.924184:0:8504:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xce1582440fb1d728 00000100:00080000:1.0:1789263678.924193:0:8504:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789263678.924205:0:8504:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9dd984ce7000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:1.0:1789263678.924238:0:8504:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd99f9a7480 x1876178898012800/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789263678.924270:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1876178898012800:0@lo:38: 00000100:00100000:1.0:1789263678.924330:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263678.924389:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898012800 00000100:00100000:1.0:1789263678.924395:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898012800 00000100:00100000:1.0:1789263678.924429:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789263678.924437:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3617:x1876178898012800:12345-0@lo:38: 00010000:00080000:1.0:1789263678.924458:0:6492:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 121 last 0 00000020:00000080:1.0:1789263678.924495:0:6492:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xce1582440fb1d72f 00000004:00100000:1.0:1789263678.924510:0:6492:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1789263678.924515:0:6492:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1789263678.924578:0:8504:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:1.0:1789263678.924623:0:8504:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000020:01000000:3.0:1789263678.924839:0:8504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789263678.924845:0:8504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789263678.924848:0:8504:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1789263678.924853:0:8504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000100:00080000:1.0:1789263678.924855:0:8507:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff9dd99f9a4700 x1876178898012928/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000020:01000000:3.0:1789263678.924857:0:8504:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:3.0:1789263678.924860:0:8504:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789263678.924864:0:8504:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789263678.924868:0:8504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000100:00100000:1.0:1789263678.924871:0:8507:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9861e6b40 going to sleep for 0 seconds 00000020:00000080:3.0:1789263678.924873:0:8504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789263678.924877:0:8504:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789263678.924881:0:8504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789263678.924885:0:8504:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1789263678.924890:0:8504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789263678.924892:0:8504:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1789263678.924897:0:8504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789263678.924901:0:8504:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.120@tcp to nid 0x20000c0a8cb78 (192.168.203.120@tcp) 00000020:01000000:3.0:1789263678.924925:0:8504:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789263678.924928:0:8504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789263678.924942:0:8504:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9dd9b7984d28) 00000020:00000080:3.0:1789263678.924959:0:8504:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:3.0:1789263678.924966:0:8504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789263678.925064:0:8504:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1789263678.925071:0:8504:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:3.0:1789263678.925154:0:8504:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xce1582440fb1d73d 00010000:00080000:3.0:1789263678.925274:0:8504:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dd9bb5f9800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.120@tcp at head 00010000:00010000:3.0:1789263678.925640:0:8504:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000100:00080000:1.0:1789263678.929961:0:6492:0:(import.c:65:import_set_state_nolock()) ffff9dd9bf99f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789263678.930160:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3617:x1876178898012800:12345-0@lo:38: Request processed in 5717us (5825us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263678.930176:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789263678.930191:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789263678.930207:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1789263678.930218:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1789263678.930225:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1789263678.930229:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd984ce7000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1789263678.930261:0:3617:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000005c0e8e6a): req@ffff9dd99f9a4700 x1876178898012928/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789263678.930285:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1876178898012800:0@lo:38: 00000100:00100000:1.0:1789263678.930576:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876178898013056:0@lo:41: 00000100:00100000:1.0:1789263678.930636:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263678.930674:0:8499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898013056 00000100:00100000:2.0:1789263678.930682:0:8499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898013056 00000100:00100000:3.0:1789263678.930792:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789263678.930807:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3619:x1876178898013056:12345-0@lo:41: 00000004:00000024:3.0:1789263678.930859:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1789263678.930940:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3619:x1876178898013056:12345-0@lo:41: Request processed in 137us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263678.930948:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789263678.931022:0:8507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263678.931054:0:8507:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9861e6b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789263678.931133:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876178898013056:0@lo:41: 00000100:00100000:3.0:1789263678.931266:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898012928 00000100:00100000:3.0:1789263678.931271:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898012928 00000100:00100000:3.0:1789263678.931330:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789263678.931337:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9907a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8507:x1876178898012928:12345-0@lo:1000: 00000100:00100000:3.0:1789263678.931401:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9907a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8507:x1876178898012928:12345-0@lo:1000: Request processed in 63us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263678.931408:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000040:01000000:3.0:1789263678.931470:0:8504:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1789263678.931485:0:8504:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789263678.931680:0:8504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789263678.931875:0:8504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789263678.931977:0:8504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1789263678.932100:0:8504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000100:00100000:3.0:1789263678.932241:0:8507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a4700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:8507:1876178898012928:0@lo:1000: 00000040:01000000:3.0:1789263678.932274:0:8507:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1789263678.932324:0:8507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9c08a9c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:8507:1876178898013184:0@lo:1000: 00000100:00100000:3.0:1789263678.932370:0:8507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263678.932389:0:8507:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd8826846c0 going to sleep for 11 seconds 00000001:00100000:1.0:1789263678.932481:0:8388:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1789263678.932484:0:8499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898013184 00000100:00100000:2.0:1789263678.932491:0:8499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898013184 00000100:00100000:2.0:1789263678.932530:0:8499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789263678.932538:0:8499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c08a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:8507:x1876178898013184:12345-0@lo:1000: 00000100:00100000:3.0:1789263678.932647:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8498:x1876178898010496:12345-0@lo:700: Request processed in 19085us (19894us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263678.932663:0:8499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c08a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:8507:x1876178898013184:12345-0@lo:1000: Request processed in 124us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263678.932670:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789263678.932674:0:8499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789263678.932713:0:8507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9c08a9c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:8507:1876178898013184:0@lo:1000: 00000100:00100000:3.0:1789263678.932753:0:8507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9c08a9c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:8507:1876178898013312:0@lo:700: 00000100:00100000:3.0:1789263678.932778:0:8507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263678.932801:0:8507:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd882684e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789263678.932826:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898013312 00000100:00100000:2.0:1789263678.932831:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898013312 00010000:00080000:1.0:1789263678.932851:0:8498:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd99f9a5500 x1876178898010496/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789263694 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789263678.932868:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789263678.932869:0:8498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a5500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8498:1876178898010496:0@lo:700: 00000100:00100000:2.0:1789263678.932880:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c08ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:8507:x1876178898013312:12345-0@lo:700: 00000100:00100000:2.0:1789263678.932929:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c08ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:8507:x1876178898013312:12345-0@lo:700: Request processed in 53us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263678.932941:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789263678.932949:0:8507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9c08a9c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:8507:1876178898013312:0@lo:700: 00000100:00100000:3.0:1789263678.933024:0:8507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9c08a9c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:8507:1876178898013440:0@lo:1000: 00000100:00100000:3.0:1789263678.933060:0:8507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263678.933117:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898013440 00000100:00100000:3.0:1789263678.933122:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898013440 00000100:00100000:3.0:1789263678.933155:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789263678.933169:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c08a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8507:x1876178898013440:12345-0@lo:1000: 00000040:00080000:0.0:1789263678.933179:0:8508:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789263678.933185:0:8508:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000100:00100000:3.0:1789263678.933224:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c08a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8507:x1876178898013440:12345-0@lo:1000: Request processed in 62us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263678.933232:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789263678.933253:0:8507:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9b7a9e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789263678.933269:0:8507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9c08a9c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:8507:1876178898013440:0@lo:1000: 00000004:00080000:3.0:1789263678.933331:0:8507:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9dd882684e40 with version 0 00000020:00100000:3.0:1789263678.933345:0:8507:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1789263678.933350:0:8507:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9dd9c08a9c00 x1876178898013696/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789263678.933364:0:8507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9c08a9c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:8507:1876178898013696:0@lo:1000: 00000100:00100000:3.0:1789263678.933402:0:8507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263678.933427:0:8507:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd983852cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789263678.933447:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898013696 00000100:00100000:0.0:1789263678.933454:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898013696 00000100:00100000:0.0:1789263678.933486:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789263678.933495:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c08a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8507:x1876178898013696:12345-0@lo:1000: 00000020:00000080:2.0:1789263678.934357:0:8504:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789263678.934373:0:8504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789263678.934415:0:8504:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789263678.934442:0:8504:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xce1582440fb1d744 00000100:00080000:2.0:1789263678.934453:0:8504:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789263678.934459:0:8504:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9dd9bb5f9800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:2.0:1789263678.934488:0:8504:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd9907a7100 x1876178898013824/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789263678.934529:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9907a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1876178898013824:0@lo:8: 00000100:00100000:2.0:1789263678.934579:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789263678.934630:0:8504:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:1.0:1789263678.934630:0:8395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898013824 00000100:00100000:1.0:1789263678.934638:0:8395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898013824 00000100:00100000:1.0:1789263678.934679:0:8395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789263678.934687:0:8395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9907a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3617:x1876178898013824:12345-0@lo:8: 00000100:00100000:3.0:1789263678.934690:0:8392:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000020:01000000:2.0:1789263678.934698:0:8504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:3.0:1789263678.934699:0:8392:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000020:00000080:2.0:1789263678.934706:0:8504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263678.934710:0:8504:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00010000:00080000:1.0:1789263678.934711:0:8395:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 121 last 0 00000020:01000000:2.0:1789263678.934717:0:8504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789263678.934723:0:8504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263678.934724:0:8504:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789263678.934729:0:8504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789263678.934731:0:8504:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:00000080:1.0:1789263678.934743:0:8395:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xce1582440fb1d74b 00002000:00100000:1.0:1789263678.934758:0:8395:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9dd9bf99d000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 0 00000100:00100000:2.0:1789263678.934763:0:8504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9907a7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:8504:1876178898013952:0@lo:502: 00002000:00080000:1.0:1789263678.934764:0:8395:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1789263678.934769:0:8395:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1789263678.934812:0:8504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263678.934830:0:8504:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9bf982300 going to sleep for 11 seconds 00002000:00080000:1.0:1789263678.934831:0:8395:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789263678.934853:0:8395:0:(import.c:65:import_set_state_nolock()) ffff9dd9bf99d800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789263678.934910:0:8395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9907a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3617:x1876178898013824:12345-0@lo:8: Request processed in 222us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263678.934918:0:8395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789263678.934931:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd9907a7100 x1876178898013824/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789263688 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789263678.934941:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789263678.934948:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1789263678.934956:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789263678.934961:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000001:00100000:1.0:1789263678.934963:0:7417:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00080000:2.0:1789263678.934964:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd9bb5f9800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789263678.934978:0:3617:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789263678.934985:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9907a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1876178898013824:0@lo:8: 00000004:00080000:1.0:1789263678.935024:0:8498:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1789263678.935040:0:8498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8498:1876178898014208:0@lo:7: 00000100:00100000:1.0:1789263678.935073:0:8498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263678.935098:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898014080:0@lo:13: 00000100:00100000:1.0:1789263678.935119:0:8498:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9861e6b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789263678.935134:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263678.935142:0:8394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898014208 00000100:00100000:1.0:1789263678.935146:0:8394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898014208 00000100:00100000:1.0:1789263678.935182:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789263678.935190:0:8394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8498:x1876178898014208:12345-0@lo:7: 00000100:00100000:3.0:1789263678.935488:0:8396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898014080 00000100:00100000:3.0:1789263678.935498:0:8396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898014080 00000100:00100000:0.0:1789263678.935531:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898013952 00000100:00100000:0.0:1789263678.935537:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898013952 00000100:00100000:3.0:1789263678.935541:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789263678.935546:0:8397:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1789263678.935553:0:8396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9907a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3620:x1876178898014080:12345-0@lo:13: 00000100:00100000:2.0:1789263678.935556:0:8397:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:0.0:1789263678.935571:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00002000:00000024:3.0:1789263678.935572:0:8396:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3924074496 avail 3692552192 00000100:00100000:0.0:1789263678.935581:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+19:8504:x1876178898013952:12345-0@lo:502: 00000100:00100000:3.0:1789263678.935623:0:8396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9907a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3620:x1876178898014080:12345-0@lo:13: Request processed in 74us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263678.935632:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789263678.935638:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd99f9a5500 x1876178898014080/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789263694 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789263678.935657:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898014080:0@lo:13: 00000100:00100000:0.0:1789263678.935693:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+19:8504:x1876178898013952:12345-0@lo:502: Request processed in 113us (880us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263678.935700:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789263678.935703:0:8504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9907a7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:8504:1876178898013952:0@lo:502: 00000020:01000000:2.0:1789263678.935733:0:8504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789263678.935738:0:8504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263678.935740:0:8504:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789263678.935745:0:8504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:2.0:1789263678.935798:0:6484:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-33 (rc=0) 10000000:01000000:2.0:1789263678.935821:0:6484:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789263678.935831:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd981683600/0xce1582440fb1d70c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d713 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263678.935842:0:6484:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd981683600/0xce1582440fb1d70c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d713 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789263678.935860:0:6484:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789263678.935862:0:6484:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dd9896b8000 from 1 10000000:01000000:2.0:1789263678.935865:0:6484:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789263678.935889:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9813fd600/0xce1582440fb1d752 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263678.935897:0:6484:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd9813fd600/0xce1582440fb1d752 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263678.935906:0:6484:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd9813fd600/0xce1582440fb1d752 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789263678.935917:0:8508:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1789263678.935921:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9907a7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898014336:0@lo:101: 00000100:00100000:2.0:1789263678.935965:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1789263678.935975:0:8508:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 121225897121ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789263678.935985:0:8508:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1789263678.935992:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9bf982300 going to sleep for 11 seconds 00000100:00100000:2.0:1789263678.936009:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898014336 00000100:00100000:2.0:1789263678.936012:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898014336 00000100:00100000:2.0:1789263678.936053:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789263678.936062:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+19:6484:x1876178898014336:12345-0@lo:101: 00010000:00010000:2.0:1789263678.936071:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263678.936231:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd9bfa23a00/0xce1582440fb1d759 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1d752 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263678.936253:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd9bfa23a00/0xce1582440fb1d759 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1d752 expref: 20 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263678.936264:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd9bfa23a00/0xce1582440fb1d759 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d752 expref: 20 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263678.936273:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bfa23a00, rc 0) 00000100:00100000:2.0:1789263678.936305:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+20:6484:x1876178898014336:12345-0@lo:101: Request processed in 246us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263678.936325:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789263678.936360:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9907a7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898014336:0@lo:101: 00010000:00010000:2.0:1789263678.936371:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd9813fd600/0xce1582440fb1d752 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d759 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263678.936381:0:6484:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd9813fd600/0xce1582440fb1d752 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1d759 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263678.936437:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9907a7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898014464:0@lo:501: 00000100:00100000:2.0:1789263678.936473:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263678.936499:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9bf982300 going to sleep for 11 seconds 00000100:00100000:0.0:1789263678.936513:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898014464 00000100:00100000:0.0:1789263678.936519:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898014464 00000100:00100000:0.0:1789263678.936550:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789263678.936559:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+20:6484:x1876178898014464:12345-0@lo:501: 00000100:00100000:0.0:1789263678.936654:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+20:6484:x1876178898014464:12345-0@lo:501: Request processed in 96us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263678.936663:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789263678.936677:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9907a7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898014464:0@lo:501: 00000100:00100000:2.0:1789263678.936706:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9907a7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898014592:0@lo:503: 00000100:00100000:2.0:1789263678.936747:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263678.936764:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9bf982300 going to sleep for 11 seconds 00000100:00100000:2.0:1789263678.936783:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898014592 00000100:00100000:2.0:1789263678.936787:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898014592 00000100:00100000:2.0:1789263678.936815:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789263678.936823:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+20:6484:x1876178898014592:12345-0@lo:503: 00000100:00100000:2.0:1789263678.936904:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+20:6484:x1876178898014592:12345-0@lo:503: Request processed in 82us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263678.936911:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789263678.936920:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9907a7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898014592:0@lo:503: 00000100:00100000:2.0:1789263678.937189:0:8513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9907a5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:8513:1876178898014720:0@lo:502: 00000100:00100000:2.0:1789263678.937230:0:8513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263678.937288:0:8513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9bf982f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789263678.937466:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898014720 00000100:00100000:0.0:1789263678.937472:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898014720 00000100:00100000:0.0:1789263678.937504:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789263678.937514:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+20:8513:x1876178898014720:12345-0@lo:502: 00000100:00100000:0.0:1789263678.937609:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+20:8513:x1876178898014720:12345-0@lo:502: Request processed in 97us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263678.937616:0:8513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9907a5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:8513:1876178898014720:0@lo:502: 00000100:00100000:0.0:1789263678.937620:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000020:01000000:2.0:1789263678.937644:0:8513:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789263678.937652:0:8513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263678.937654:0:8513:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789263678.937661:0:8513:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dd9896b8000 00000020:00000080:2.0:1789263678.937665:0:8513:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789263678.937686:0:8513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9907a5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:8513:1876178898014848:0@lo:502: 00000100:00100000:2.0:1789263678.937722:0:8513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263678.937740:0:8513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9bf982f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789263678.937746:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898014848 00000100:00100000:0.0:1789263678.937751:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898014848 00000100:00100000:0.0:1789263678.937785:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789263678.937794:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+20:8513:x1876178898014848:12345-0@lo:502: 00000100:00100000:0.0:1789263678.937871:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+20:8513:x1876178898014848:12345-0@lo:502: Request processed in 77us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263678.937879:0:8513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9907a5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:8513:1876178898014848:0@lo:502: 00000100:00100000:0.0:1789263678.937880:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000020:01000000:2.0:1789263678.937909:0:8513:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789263678.937914:0:8513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263678.937916:0:8513:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1789263678.937919:0:8513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1789263678.937971:0:6484:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1789263678.937998:0:6484:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789263678.938012:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9813fd600/0xce1582440fb1d752 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d759 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263678.938022:0:6484:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd9813fd600/0xce1582440fb1d752 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d759 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789263678.938121:0:6484:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789263678.938125:0:6484:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9dd9b7983370 from 1 10000000:01000000:0.0:1789263678.938127:0:6484:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789263678.938152:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd990432600/0xce1582440fb1d760 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263678.938160:0:6484:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd990432600/0xce1582440fb1d760 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263678.938169:0:6484:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd990432600/0xce1582440fb1d760 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263678.938183:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9c09f5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898014976:0@lo:101: 00000100:00100000:0.0:1789263678.938222:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263678.938245:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898014976 00000100:00100000:2.0:1789263678.938251:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898014976 00000100:00100000:0.0:1789263678.938307:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9c0b049c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789263678.938336:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789263678.938346:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+20:6484:x1876178898014976:12345-0@lo:101: 00010000:00010000:2.0:1789263678.938355:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263678.938366:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd9bfa23400/0xce1582440fb1d767 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1d760 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263678.938384:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd9bfa23400/0xce1582440fb1d767 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1d760 expref: 21 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263678.938395:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd9bfa23400/0xce1582440fb1d767 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d760 expref: 21 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263678.938403:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bfa23400, rc 0) 00000100:00100000:2.0:1789263678.938457:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+21:6484:x1876178898014976:12345-0@lo:101: Request processed in 113us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263678.938464:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789263678.938515:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9c09f5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898014976:0@lo:101: 00010000:00010000:0.0:1789263678.938529:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd990432600/0xce1582440fb1d760 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d767 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263678.938538:0:6484:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd990432600/0xce1582440fb1d760 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1d767 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263678.938609:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9c09f5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898015104:0@lo:501: 00000100:00100000:0.0:1789263678.938653:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263678.938675:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898015104 00000100:00100000:0.0:1789263678.938677:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9c0b049c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789263678.938680:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898015104 00000100:00100000:2.0:1789263678.938710:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789263678.938736:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+21:6484:x1876178898015104:12345-0@lo:501: 00000100:00100000:2.0:1789263678.938796:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+21:6484:x1876178898015104:12345-0@lo:501: Request processed in 80us (143us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789263678.938804:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789263678.938812:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9c09f5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898015104:0@lo:501: 10000000:01000000:0.0:1789263678.938845:0:6484:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789263678.938870:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd990432600/0xce1582440fb1d760 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d767 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263678.938879:0:6484:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd990432600/0xce1582440fb1d760 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d767 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789263678.938881:0:6466:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000001:00080000:0.0:1789263678.938999:0:7417:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000100:00100000:2.0:1789263678.939117:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c08a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8507:x1876178898013696:12345-0@lo:1000: Request processed in 5622us (5713us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1789263678.939126:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000004:00080000:0.0:1789263678.939132:0:8507:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:0.0:1789263678.939138:0:8507:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1789263678.939153:0:8507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9c08a9c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:8507:1876178898013696:0@lo:1000: 00000100:00100000:0.0:1789263678.939214:0:8507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9c09f5c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:8507:1876178898015232:0@lo:1000: 00000100:00100000:0.0:1789263678.939251:0:8507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263678.939275:0:8507:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9c0b04cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789263678.939287:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898015232 00000100:00100000:2.0:1789263678.939292:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898015232 00000100:00100000:2.0:1789263678.939335:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789263678.939344:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c09f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8507:x1876178898015232:12345-0@lo:1000: 00000100:00100000:2.0:1789263678.939410:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c09f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8507:x1876178898015232:12345-0@lo:1000: Request processed in 66us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263678.939417:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789263678.939423:0:8507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9c09f5c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:8507:1876178898015232:0@lo:1000: 00000040:00080000:0.0:1789263678.939447:0:8507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1789263678.939479:0:8507:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9dd9c0b049c0 with version 1 00000004:00080000:1.0:1789263678.939501:0:8505:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9dd9861e66c0 version 1 rpc_version 1 00000020:00100000:1.0:1789263678.939520:0:8505:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789263678.939528:0:8505:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9dd99f9a5500 x1876178898015488/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789263678.939543:0:8505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a5500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8505:1876178898015488:0@lo:1000: 00000100:00100000:1.0:1789263678.939585:0:8505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263678.939607:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898015488 00000100:00100000:1.0:1789263678.939608:0:8505:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd985565480 going to sleep for 11 seconds 00000100:00100000:2.0:1789263678.939613:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898015488 00000100:00100000:2.0:1789263678.939642:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789263678.939650:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8505:x1876178898015488:12345-0@lo:1000: 00002000:00080000:1.0:1789263678.940268:0:8394:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1789263678.940274:0:8394:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:1.0:1789263678.940330:0:8394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8498:x1876178898014208:12345-0@lo:7: Request processed in 5141us (5257us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263678.940338:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789263678.940374:0:8498:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd99f9a5880 x1876178898014208/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789263694 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789263678.940386:0:8498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8498:1876178898014208:0@lo:7: 00000004:00080000:1.0:1789263678.940397:0:8498:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:1.0:1789263678.940440:0:8498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88297c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8498:1876178898015616:0@lo:5: 00000100:00100000:1.0:1789263678.940471:0:8498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263678.940495:0:8498:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9861e6b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789263678.940561:0:8392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898015616 00000100:00100000:2.0:1789263678.940567:0:8392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898015616 00000100:00100000:2.0:1789263678.940597:0:8392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789263678.940605:0:8392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8498:x1876178898015616:12345-0@lo:5: 00002000:00080000:2.0:1789263678.940625:0:8392:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:2.0:1789263678.940662:0:8392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8498:x1876178898015616:12345-0@lo:5: Request processed in 58us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263678.940668:0:8392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789263678.940683:0:8498:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd88297c000 x1876178898015616/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789263694 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789263678.940694:0:8498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88297c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8498:1876178898015616:0@lo:5: 00000004:00080000:1.0:1789263678.940706:0:8498:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:1.0:1789263678.940734:0:8498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88297c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8498:1876178898015744:0@lo:5: 00000100:00100000:1.0:1789263678.940763:0:8498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263678.940797:0:8498:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd881f31000 going to sleep for 11 seconds 00000100:00100000:2.0:1789263678.940844:0:8395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898015744 00000100:00100000:2.0:1789263678.940849:0:8395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898015744 00000100:00100000:2.0:1789263678.940873:0:8395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789263678.940880:0:8395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8498:x1876178898015744:12345-0@lo:5: 00002000:00080000:2.0:1789263678.940904:0:8395:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000040:00080000:0.0:1789263678.941625:0:8507:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789263678.941675:0:8507:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1789263678.941678:0:8507:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000100:00100000:0.0:1789263678.941784:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789263678.941797:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9c09f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898015872:0@lo:13: 00000100:00100000:0.0:1789263678.941837:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1789263678.941873:0:8509:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1789263678.941890:0:8509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9c09f4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8509:1876178898016000:0@lo:7: 00000100:00100000:1.0:1789263678.941895:0:8396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898015872 00000100:00100000:1.0:1789263678.941901:0:8396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898015872 00000100:00100000:0.0:1789263678.941912:0:8509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263678.941940:0:8392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898016000 00000100:00100000:0.0:1789263678.941944:0:8392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898016000 00000100:00100000:1.0:1789263678.941955:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789263678.941967:0:8396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c09f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3620:x1876178898015872:12345-0@lo:13: 00000100:00100000:0.0:1789263678.941983:0:8392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00002000:00000024:1.0:1789263678.941984:0:8396:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 896 free 3923808256 avail 3692285952 00000100:00100000:0.0:1789263678.941997:0:8392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c09f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:8509:x1876178898016000:12345-0@lo:7: 00000100:00100000:1.0:1789263678.942038:0:8396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c09f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3620:x1876178898015872:12345-0@lo:13: Request processed in 73us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263678.942047:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1789263678.942104:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789263678.942854:0:8395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:8498:x1876178898015744:12345-0@lo:5: Request processed in 1972us (2088us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1789263678.942863:0:8395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000001:00080000:2.0:1789263678.942969:0:7417:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:2.0:1789263678.943032:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8505:x1876178898015488:12345-0@lo:1000: Request processed in 3384us (3447us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1789263678.943040:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:2.0:1789263678.943153:0:8505:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:2.0:1789263678.943158:0:8505:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1789263678.943174:0:8505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a5500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8505:1876178898015488:0@lo:1000: 00010000:00080000:1.0:1789263678.943265:0:8498:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd88297c000 x1876178898015744/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789263694 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789263678.943280:0:8498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88297c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8498:1876178898015744:0@lo:5: 00000004:00080000:1.0:1789263678.943290:0:8498:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:1.0:1789263678.943332:0:8498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88297f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8498:1876178898016128:0@lo:900: 00000100:00100000:1.0:1789263678.943365:0:8498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263678.943391:0:8498:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd881f31000 going to sleep for 11 seconds 00000100:00100000:2.0:1789263678.943437:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898016128 00000100:00100000:2.0:1789263678.943443:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898016128 00000100:00100000:2.0:1789263678.943507:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789263678.943516:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8498:x1876178898016128:12345-0@lo:900: 00000100:00100000:2.0:1789263678.943562:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8498:x1876178898016128:12345-0@lo:900: Request processed in 48us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263678.943568:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789263678.943652:0:8498:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd88297f800 x1876178898016128/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789263694 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789263678.943663:0:8498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88297f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8498:1876178898016128:0@lo:900: 00000100:00100000:1.0:1789263678.944135:0:8509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9c0b04000 going to sleep for 11 seconds 00010000:00080000:1.0:1789263678.946232:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd9c09f5c00 x1876178898015872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789263694 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789263678.946256:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9c09f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898015872:0@lo:13: 00002000:00080000:0.0:1789263678.946295:0:8392:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1789263678.946301:0:8392:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1789263678.946387:0:8392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c09f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8509:x1876178898016000:12345-0@lo:7: Request processed in 4392us (4472us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263678.946398:0:8392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1789263678.946405:0:8509:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd9c09f4700 x1876178898016000/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789263694 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789263678.946428:0:8509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9c09f4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8509:1876178898016000:0@lo:7: 00000004:00080000:1.0:1789263678.946440:0:8509:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1789263678.946469:0:8509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88297f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8509:1876178898016256:0@lo:5: 00000100:00100000:1.0:1789263678.946503:0:8509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263678.946527:0:8509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd881f31000 going to sleep for 11 seconds 00000100:00100000:0.0:1789263678.946530:0:8511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898016256 00000100:00100000:0.0:1789263678.946537:0:8511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898016256 00000100:00100000:0.0:1789263678.946585:0:8511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789263678.946595:0:8511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8509:x1876178898016256:12345-0@lo:5: 00002000:00080000:0.0:1789263678.946618:0:8511:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1789263678.946621:0:8511:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000001:00080000:2.0:1789263678.953727:0:8388:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:00080000:2.0:1789263678.953743:0:8388:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:2.0:1789263678.953751:0:8388:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1789263678.953940:0:8511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:8509:x1876178898016256:12345-0@lo:5: Request processed in 7342us (7431us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1789263678.953952:0:8511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789263678.954004:0:8509:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd88297f800 x1876178898016256/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789263694 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263678.954016:0:8509:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1789263678.954022:0:8509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88297f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8509:1876178898016256:0@lo:5: 00000004:00080000:0.0:1789263678.954038:0:8509:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1789263678.954126:0:8509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9c09f5500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8509:1876178898016384:0@lo:700: 00000100:00100000:0.0:1789263678.954172:0:8509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263678.954212:0:8509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9c0b04cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789263678.954262:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898016384 00000100:00100000:2.0:1789263678.954268:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898016384 00000100:00100000:2.0:1789263678.954301:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789263678.954309:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c09f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8509:x1876178898016384:12345-0@lo:700: 00000100:00100000:2.0:1789263678.961778:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c09f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8509:x1876178898016384:12345-0@lo:700: Request processed in 7463us (7599us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263678.961793:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789263678.961803:0:8509:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd9c09f5500 x1876178898016384/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789263694 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789263678.961821:0:8509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9c09f5500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8509:1876178898016384:0@lo:700: 00000004:02000040:2.0:1789263678.964324:0:8509:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:2.0:1789263678.968848:0:8509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9907a5c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8509:1876178898016512:0@lo:5: 00000100:00100000:2.0:1789263678.968920:0:8509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263678.968984:0:8509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9bf982000 going to sleep for 11 seconds 00000100:00100000:0.0:1789263678.969007:0:8394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898016512 00000100:00100000:0.0:1789263678.969015:0:8394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898016512 00000100:00100000:0.0:1789263678.969072:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789263678.969101:0:8394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9907a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8509:x1876178898016512:12345-0@lo:5: 00002000:00080000:0.0:1789263678.972517:0:8394:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1789263678.972537:0:8394:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:0.0:1789263678.973839:0:8394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9907a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8509:x1876178898016512:12345-0@lo:5: Request processed in 4739us (4919us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789263678.973849:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1789263678.973909:0:8509:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd9907a5c00 x1876178898016512/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789263694 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789263678.973921:0:8509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9907a5c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8509:1876178898016512:0@lo:5: 00000004:00080000:2.0:1789263678.973933:0:8509:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00010000:00010000:0.0:1789263679.917349:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789263680.557250:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9c09f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898016640:0@lo:41: 00000100:00100000:2.0:1789263680.557326:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263680.559364:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898016640 00000100:00100000:0.0:1789263680.559376:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898016640 00000100:00100000:0.0:1789263680.559434:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789263680.559449:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9907a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1876178898016640:12345-0@lo:41: 00000004:00000024:0.0:1789263680.559483:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1789263680.559553:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9907a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1876178898016640:12345-0@lo:41: Request processed in 109us (2227us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263680.559562:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789263680.559582:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9c09f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898016640:0@lo:41: 00000001:02000400:1.0:1789263680.781105:0:8778:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg320-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789263680.941238:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789263681.170539:0:8830:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789263681.170714:0:8830:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000001:00080000:1.0:1789263681.551502:0:8388:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:0.0:1789263681.967859:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789263682.963548:0:8932:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789263682.963693:0:8932:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789263682.989254:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789263683.346279:0:8980:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789263683.346315:0:8980:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:2.0:1789263684.013216:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789263684.141240:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9c09f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:66a76ccf-c64c-4b18-8369-a2861ec3956c:3619:1876178898016896:0@lo:400: 00000100:00100000:2.0:1789263684.141241:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898017152:0@lo:13: 00000100:00100000:1.0:1789263684.141242:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88297f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898016768:0@lo:13: 00000100:00100000:2.0:1789263684.141331:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263684.141332:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263684.141392:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9c09f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1876178898017664:0@lo:400: 00000100:00100000:1.0:1789263684.141400:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263684.141403:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9c09f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1876178898017280:0@lo:400: 00000100:00100000:1.0:1789263684.141433:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9c09f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898017408:0@lo:400: 00000100:00100000:2.0:1789263684.141442:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263684.141449:0:8512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898017152 00000100:00100000:3.0:1789263684.141450:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9c08a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898017024:0@lo:41: 00000100:00100000:0.0:1789263684.141459:0:8512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898017152 00000100:00100000:1.0:1789263684.141472:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263684.141478:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898018176:0@lo:400: 00000100:00100000:3.0:1789263684.141492:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263684.141500:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9c09f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898017920:0@lo:400: 00000100:00100000:0.0:1789263684.141516:0:8512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898016768 00000100:00100000:0.0:1789263684.141520:0:8512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898016768 00000100:00100000:2.0:1789263684.141521:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263684.141525:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9c09f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1876178898017536:0@lo:400: 00000100:00100000:1.0:1789263684.141549:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789263684.141557:0:8512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789263684.141564:0:8396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876178898017152:12345-0@lo:13: 00000100:00100000:0.0:1789263684.141569:0:8512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898016768:12345-0@lo:13: 00000100:00100000:3.0:1789263684.141577:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263684.141587:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898016896 00000100:00100000:2.0:1789263684.141592:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898016896 00002000:00000024:1.0:1789263684.141599:0:8396:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00002000:00000024:0.0:1789263684.141599:0:8512:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789263684.141605:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898018048:0@lo:400: 00000100:00100000:2.0:1789263684.141632:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789263684.141641:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+21:3619:x1876178898016896:12345-0@lo:400: 00000100:00100000:3.0:1789263684.141809:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263684.141823:0:8512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898016768:12345-0@lo:13: Request processed in 256us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263684.141835:0:8512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789263684.141836:0:8396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876178898017152:12345-0@lo:13: Request processed in 274us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263684.141837:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+21:3619:x1876178898016896:12345-0@lo:400: Request processed in 195us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263684.141849:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789263684.141851:0:8499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898017408 00000100:00100000:3.0:1789263684.141855:0:8499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898017408 00000100:00100000:2.0:1789263684.141856:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:0.0:1789263684.141864:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789263684.141883:0:8499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898017024 00000100:00100000:3.0:1789263684.141887:0:8499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898017024 00000100:00100000:3.0:1789263684.141907:0:8499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898018048 00000100:00100000:3.0:1789263684.141910:0:8499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898018048 00000100:00100000:1.0:1789263684.141911:0:8395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898018176 00000100:00100000:1.0:1789263684.141918:0:8395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898018176 00010000:00080000:2.0:1789263684.141921:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd9bfaaed80 x1876178898017152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789263700 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263684.141929:0:8499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789263684.141939:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:3.0:1789263684.141942:0:8499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898017408:12345-0@lo:400: 00000100:00100000:2.0:1789263684.141964:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898017152:0@lo:13: 00000100:00100000:1.0:1789263684.141970:0:8395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789263684.141981:0:8395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1876178898018176:12345-0@lo:400: 00000100:00100000:2.0:1789263684.142005:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898017664 00000100:00100000:2.0:1789263684.142010:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898017664 00000100:00100000:0.0:1789263684.142025:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263684.142032:0:8499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898017408:12345-0@lo:400: Request processed in 50us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263684.142033:0:8395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1876178898018176:12345-0@lo:400: Request processed in 54us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263684.142044:0:8395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789263684.142051:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898017536 00000100:00100000:3.0:1789263684.142053:0:8499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789263684.142056:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898017536 00000100:00100000:1.0:1789263684.142067:0:8395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898017920 00010000:00080000:0.0:1789263684.142070:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd88297f100 x1876178898016768/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789263700 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789263684.142073:0:8395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898017920 00000100:00100000:0.0:1789263684.142107:0:3620:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1789263684.142110:0:8499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789263684.142110:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789263684.142128:0:8499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c08a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3621:x1876178898017024:12345-0@lo:41: 00000100:00100000:0.0:1789263684.142129:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88297f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898016768:0@lo:13: 00000100:00100000:2.0:1789263684.142130:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876178898017664:12345-0@lo:400: 00000100:00100000:1.0:1789263684.142131:0:8395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789263684.142148:0:8395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaa7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898017920:12345-0@lo:400: 00000004:00000024:3.0:1789263684.142163:0:8499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1789263684.142169:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9c09f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898017408:0@lo:400: 00000100:00100000:2.0:1789263684.142189:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876178898017664:12345-0@lo:400: Request processed in 66us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263684.142198:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789263684.142207:0:8395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaa7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898017920:12345-0@lo:400: Request processed in 62us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263684.142208:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789263684.142220:0:8499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c08a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3621:x1876178898017024:12345-0@lo:41: Request processed in 98us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263684.142221:0:8395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789263684.142223:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c08a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1876178898017536:12345-0@lo:400: 00000100:00100000:3.0:1789263684.142236:0:8499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1789263684.142237:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789263684.142256:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263684.142262:0:8499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789263684.142273:0:8499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c08abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1876178898018048:12345-0@lo:400: 00000100:00100000:1.0:1789263684.142297:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898017280 00000100:00100000:2.0:1789263684.142301:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9c09f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3619:1876178898017792:0@lo:400: 00000100:00100000:1.0:1789263684.142302:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898017280 00000100:00100000:0.0:1789263684.142303:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c08a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1876178898017536:12345-0@lo:400: Request processed in 82us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263684.142315:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789263684.142325:0:8499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c08abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1876178898018048:12345-0@lo:400: Request processed in 53us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263684.142338:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789263684.142344:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263684.142353:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1876178898017280:12345-0@lo:400: 00000100:00100000:1.0:1789263684.142355:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898017792 00000100:00100000:1.0:1789263684.142361:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898017792 00000100:00100000:2.0:1789263684.142375:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9c09f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:66a76ccf-c64c-4b18-8369-a2861ec3956c:3619:1876178898016896:0@lo:400: 00000100:00100000:3.0:1789263684.142396:0:8499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789263684.142397:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1789263684.142409:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789263684.142411:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1876178898017792:12345-0@lo:400: 00000100:00100000:0.0:1789263684.142423:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1876178898017280:12345-0@lo:400: Request processed in 73us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263684.142433:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1789263684.142442:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd9c09f6300 x1876178898017280/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263700 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789263684.142454:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9c09f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1876178898017280:0@lo:400: 00000100:00100000:3.0:1789263684.142456:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9c08a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898017024:0@lo:41: 00000100:00100000:1.0:1789263684.142463:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1876178898017792:12345-0@lo:400: Request processed in 54us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263684.142472:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1789263684.142474:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd9c09f7b80 x1876178898017920/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789263700 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1789263684.142484:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd9c09f5500 x1876178898017536/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263700 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263684.142486:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9c09f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898017920:0@lo:400: 00010000:00080000:2.0:1789263684.142487:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd9c09f5c00 x1876178898017792/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263700 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263684.142508:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9c09f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1876178898017536:0@lo:400: 00000100:00100000:2.0:1789263684.142525:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9c09f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3619:1876178898017792:0@lo:400: 00000100:00100000:3.0:1789263684.142526:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898018048:0@lo:400: 00010000:00080000:2.0:1789263684.142573:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd9c09f4700 x1876178898017664/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263700 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789263684.142583:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9c09f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1876178898017664:0@lo:400: 00010000:00080000:2.0:1789263684.142593:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd9bfaa4700 x1876178898018176/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789263700 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789263684.142601:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898018176:0@lo:400: 00010000:00010000:0.0:1789263685.037170:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789263685.677707:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898018304:0@lo:41: 00000100:00100000:2.0:1789263685.677779:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263685.677847:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898018304 00000100:00100000:1.0:1789263685.677856:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898018304 00000100:00100000:1.0:1789263685.677908:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789263685.677916:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1876178898018304:12345-0@lo:41: 00000004:00000024:1.0:1789263685.677947:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1789263685.677994:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1876178898018304:12345-0@lo:41: Request processed in 80us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263685.678016:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789263685.678039:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898018304:0@lo:41: 00010000:00010000:0.0:1789263686.061212:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789263686.879485:0:9477:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789263686.879488:0:9477:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1789263686.879490:0:9477:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1789263686.879730:0:9477:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9dd882a29800 00000020:01000004:3.0:1789263686.879743:0:9477:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1789263686.879755:0:9477:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789263686.879768:0:9477:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9dd9b79819b8) 00000020:00000080:3.0:1789263686.879786:0:9477:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789263686.903788:0:9477:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1789263686.903855:0:9477:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:3.0:1789263686.915012:0:9477:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789263686.915313:0:9477:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1789263686.915328:0:9477:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789263686.915339:0:9477:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xce1582440fb1d775 00000020:01000004:3.0:1789263686.915346:0:9477:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1789263686.915367:0:9477:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.120@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789263686.915372:0:9477:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.120@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789263686.915378:0:9477:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1789263686.915407:0:9477:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1789263686.915411:0:9477:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.120@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1789263686.926939:0:9477:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.120@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789263686.926980:0:9477:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.120@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1789263686.926985:0:9477:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789263686.926986:0:9477:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789263686.926988:0:9477:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789263686.926989:0:9477:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789263686.926991:0:9477:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789263686.926992:0:9477:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789263686.926993:0:9477:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789263686.926995:0:9477:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789263686.926997:0:9477:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789263686.926998:0:9477:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789263686.926999:0:9477:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789263686.927003:0:9477:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1789263686.927005:0:9477:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789263686.927007:0:9477:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789263686.927008:0:9477:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789263686.927009:0:9477:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789263686.927010:0:9477:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789263686.927011:0:9477:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789263686.927012:0:9477:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789263686.927013:0:9477:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789263686.927014:0:9477:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789263686.927015:0:9477:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789263686.927016:0:9477:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789263686.927049:0:9477:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789263686.927072:0:9477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9c08a8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:9477:1876178898018432:0@lo:253: 00000100:00100000:3.0:1789263686.927166:0:9477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263686.927218:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898018432 00000100:00100000:3.0:1789263686.927225:0:9477:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9ba82ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1789263686.927229:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898018432 00000100:00100000:2.0:1789263686.927301:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789263686.927312:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+21:9477:x1876178898018432:12345-0@lo:253: 20000000:01000000:2.0:1789263686.927343:0:6481:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1789263686.927348:0:6481:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1789263686.927354:0:6481:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1789263686.927358:0:6481:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:2.0:1789263686.927554:0:6481:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789263686.927688:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:2.0:1789263686.927716:0:6481:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1789263686.927735:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:2.0:1789263686.927742:0:6481:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1789263686.927755:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:2.0:1789263686.927769:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:2.0:1789263686.927850:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:2.0:1789263686.927863:0:6481:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.120@tcp 20000000:01000000:2.0:1789263686.927865:0:6481:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.120@tcp (null) (null) (null) 00000040:00080000:2.0:1789263686.927878:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:2.0:1789263686.927883:0:6481:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1789263686.927895:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:2.0:1789263686.927900:0:6481:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.120@tcp (null) (null) 00000040:00080000:2.0:1789263686.927911:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:2.0:1789263686.927916:0:6481:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1789263686.927927:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:2.0:1789263686.927939:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:2.0:1789263686.927997:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:2.0:1789263686.928014:0:6481:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.120@tcp 20000000:01000000:2.0:1789263686.928016:0:6481:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.120@tcp (null) (null) (null) 00000040:00080000:2.0:1789263686.928042:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:2.0:1789263686.928049:0:6481:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1789263686.928062:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:2.0:1789263686.928068:0:6481:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.203.120@tcp (null) (null) 00000040:00080000:2.0:1789263686.928104:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:2.0:1789263686.928112:0:6481:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1789263686.928126:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:2.0:1789263686.928140:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:2.0:1789263686.928517:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:2.0:1789263686.928527:0:6481:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.120@tcp 20000000:01000000:2.0:1789263686.928529:0:6481:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.120@tcp (null) (null) (null) 00000040:00080000:2.0:1789263686.928541:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:2.0:1789263686.928546:0:6481:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1789263686.928558:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:2.0:1789263686.928563:0:6481:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.120@tcp (null) (null) 00000040:00080000:2.0:1789263686.928575:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:2.0:1789263686.928587:0:6481:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1789263686.928601:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:2.0:1789263686.928614:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:2.0:1789263686.928626:0:6481:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1789263686.928628:0:6481:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1789263686.928631:0:6481:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1789263686.928671:0:6481:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789263686.928674:0:6481:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789263686.929346:0:9483:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 25 1->4: lustre sys.timeout 20000000:01000000:2.0:1789263686.929369:0:9483:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 25 2->4: lustre sys.timeout 00000040:00080000:2.0:1789263686.929385:0:9483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:0.0:1789263686.929503:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:0.0:1789263686.929530:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:0.0:1789263686.929561:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:0.0:1789263686.929572:0:6481:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1789263686.929574:0:6481:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789263686.929809:0:9484:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 26 1->4: lustre sys.timeout 20000000:01000000:2.0:1789263686.929833:0:9484:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 26 2->4: lustre sys.timeout 00000040:00080000:2.0:1789263686.929849:0:9484:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:0.0:1789263686.929989:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:0.0:1789263686.930035:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:0.0:1789263686.930056:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:0.0:1789263686.930068:0:6481:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1789263686.930070:0:6481:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789263686.932200:0:9485:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 27 1->4: lustre sys.timeout 20000000:01000000:2.0:1789263686.932244:0:9485:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 27 2->4: lustre sys.timeout 00000040:00080000:2.0:1789263686.932252:0:9485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1789263686.932404:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1789263686.932423:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:1.0:1789263686.932431:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:1.0:1789263686.932438:0:6481:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1789263686.932440:0:6481:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789263686.932693:0:9486:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:0.0:1789263686.932844:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:0.0:1789263686.932871:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:0.0:1789263686.932887:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:0.0:1789263686.932896:0:6481:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789263686.932898:0:6481:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789263686.933201:0:9487:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 28 1->4: lustre sys.timeout 20000000:01000000:0.0:1789263686.933221:0:9487:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 28 2->4: lustre sys.timeout 00000040:00080000:0.0:1789263686.933235:0:9487:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:1.0:1789263686.933338:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:1.0:1789263686.933355:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:1.0:1789263686.933370:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 10000000:01000000:1.0:1789263686.933386:0:6481:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789263686.933405:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dd981683800/0xce1582440fb1d77c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263686.933422:0:6481:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd981682000/0xce1582440fb1d63a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d633 expref: 21 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263686.933430:0:6481:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd990433a00/0xce1582440fb1d664 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d65d expref: 21 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263686.933437:0:6481:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd990432200/0xce1582440fb1d6a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d69c expref: 21 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263686.933443:0:6481:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd990433200/0xce1582440fb1d6bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d6b8 expref: 21 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263686.933451:0:6481:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd981530600/0xce1582440fb1d6f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d6f0 expref: 21 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263686.933459:0:6481:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd9813fde00/0xce1582440fb1d713 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d70c expref: 21 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263686.933478:0:6481:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd9bfa23400/0xce1582440fb1d767 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d760 expref: 21 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263686.933486:0:6481:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dd981683800/0xce1582440fb1d77c lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263686.933524:0:6481:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd9bfa23400/0xce1582440fb1d767 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce1582440fb1d760 expref: 21 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263686.933548:0:6481:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dd9bfa23400/0xce1582440fb1d767 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce1582440fb1d760 expref: 21 pid: 6481 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263686.933569:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88297ea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6481:1876178898018560:0@lo:104: 00000100:00100000:1.0:1789263686.933637:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263686.933673:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898018560 00000100:00100000:2.0:1789263686.933681:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898018560 00010000:00010000:1.0:1789263686.933708:0:6481:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd9813fde00/0xce1582440fb1d713 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce1582440fb1d70c expref: 21 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263686.933718:0:6481:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dd9813fde00/0xce1582440fb1d713 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce1582440fb1d70c expref: 21 pid: 6482 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263686.933729:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88297ed80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6481:1876178898018688:0@lo:104: 00000100:00100000:2.0:1789263686.933735:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789263686.933747:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:66a76ccf-c64c-4b18-8369-a2861ec3956c+3:6481:x1876178898018560:12345-0@lo:104: 00000100:00100000:1.0:1789263686.933757:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789263686.933761:0:6471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff9dd990432600/0xce1582440fb1d760 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1d767 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263686.933770:0:6470:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1789263686.933780:0:6470:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:1.0:1789263686.933795:0:6481:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd981530600/0xce1582440fb1d6f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce1582440fb1d6f0 expref: 21 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263686.933810:0:6481:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dd981530600/0xce1582440fb1d6f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce1582440fb1d6f0 expref: 21 pid: 6482 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263686.933820:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88297d180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6481:1876178898018816:0@lo:104: 00010000:00010000:2.0:1789263686.933821:0:6471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789263686.933831:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:66a76ccf-c64c-4b18-8369-a2861ec3956c+3:6481:x1876178898018560:12345-0@lo:104: Request processed in 85us (191us total) trans 0 rc 0/0 00010000:00010000:3.0:1789263686.933840:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1789263686.933840:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1789263686.933850:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd990432600/0xce1582440fb1d760 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1d767 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263686.933860:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd990432600 already unused, calling callback (ffffffffc12b1c20) 10000000:00010000:3.0:1789263686.933866:0:6476:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd990432600/0xce1582440fb1d760 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xce1582440fb1d767 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263686.933868:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263686.933870:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898018688 00000100:00100000:2.0:1789263686.933876:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898018688 00010000:00010000:3.0:1789263686.933882:0:6476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd990432600/0xce1582440fb1d760 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xce1582440fb1d767 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789263686.933892:0:6476:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd990432600/0xce1582440fb1d760 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xce1582440fb1d767 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263686.933894:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898018816 00010000:00010000:1.0:1789263686.933899:0:6481:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd990433200/0xce1582440fb1d6bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce1582440fb1d6b8 expref: 21 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789263686.933900:0:6476:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1789263686.933906:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898018816 00010000:00010000:1.0:1789263686.933915:0:6481:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dd990433200/0xce1582440fb1d6bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce1582440fb1d6b8 expref: 21 pid: 6481 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263686.933931:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1789263686.933938:0:6476:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff9dd990432600/0xce1582440fb1d760 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d767 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263686.933938:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:66a76ccf-c64c-4b18-8369-a2861ec3956c+4:6481:x1876178898018688:12345-0@lo:104: 00000100:00100000:1.0:1789263686.933942:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88297f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6481:1876178898018944:0@lo:104: 00010000:00010000:2.0:1789263686.933952:0:6471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff9dd981683600/0xce1582440fb1d70c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1d713 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263686.933953:0:6476:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789263686.933981:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd990432600/0xce1582440fb1d760 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d767 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263686.933990:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd990432600/0xce1582440fb1d760 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d767 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263686.933995:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9c08aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:66a76ccf-c64c-4b18-8369-a2861ec3956c:3620:1876178898019072:0@lo:103: 00000100:00100000:1.0:1789263686.934004:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789263686.934006:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263686.934017:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789263686.934021:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd981683600/0xce1582440fb1d70c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1d713 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263686.934023:0:6471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00010000:00010000:1.0:1789263686.934033:0:6481:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd990432200/0xce1582440fb1d6a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce1582440fb1d69c expref: 21 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263686.934034:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981683600 already unused, calling callback (ffffffffc12b1c20) 00000100:00100000:2.0:1789263686.934035:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:66a76ccf-c64c-4b18-8369-a2861ec3956c+4:6481:x1876178898018688:12345-0@lo:104: Request processed in 95us (277us total) trans 0 rc 0/0 10000000:00010000:3.0:1789263686.934043:0:6476:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd981683600/0xce1582440fb1d70c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xce1582440fb1d713 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263686.934047:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263686.934058:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1789263686.934059:0:6481:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dd990432200/0xce1582440fb1d6a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce1582440fb1d69c expref: 21 pid: 6480 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263686.934060:0:6476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd981683600/0xce1582440fb1d70c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xce1582440fb1d713 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789263686.934110:0:6476:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd981683600/0xce1582440fb1d70c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xce1582440fb1d713 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263686.934118:0:6471:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789263686.934118:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88297d500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6481:1876178898019200:0@lo:104: 10000000:01000000:3.0:1789263686.934120:0:6476:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789263686.934132:0:7428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898019072 00000100:00100000:2.0:1789263686.934133:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898018944 00000100:00100000:0.0:1789263686.934138:0:7428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898019072 00000100:00100000:2.0:1789263686.934139:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898018944 00000100:00100000:1.0:1789263686.934153:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263686.934166:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898019200 00010000:00010000:0.0:1789263686.934168:0:7428:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd9bfa23400/0xce1582440fb1d767 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1d760 expref: 22 pid: 6481 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263686.934170:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898019200 00000100:00100000:2.0:1789263686.934189:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1789263686.934192:0:6481:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd990433a00/0xce1582440fb1d664 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce1582440fb1d65d expref: 22 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263686.934198:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:66a76ccf-c64c-4b18-8369-a2861ec3956c+5:6481:x1876178898018816:12345-0@lo:104: 00000100:00100000:0.0:1789263686.934202:0:7428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1789263686.934216:0:6481:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dd990433a00/0xce1582440fb1d664 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce1582440fb1d65d expref: 22 pid: 6482 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263686.934217:0:6476:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff9dd981683600/0xce1582440fb1d70c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d713 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263686.934217:0:7428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaa5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a76ccf-c64c-4b18-8369-a2861ec3956c+22:3620:x1876178898019072:12345-0@lo:103: 00010000:00010000:2.0:1789263686.934218:0:6471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff9dd9813fc600/0xce1582440fb1d6f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1d6f7 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263686.934235:0:7428:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789263686.934241:0:6476:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789263686.934246:0:7428:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd9bfa23400/0xce1582440fb1d767 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1d760 expref: 22 pid: 6481 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263686.934248:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88297c000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6481:1876178898019456:0@lo:104: 00010000:00010000:3.0:1789263686.934269:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd981683600/0xce1582440fb1d70c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d713 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263686.934281:0:6471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1789263686.934291:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd981683600/0xce1582440fb1d70c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d713 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263686.934292:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:66a76ccf-c64c-4b18-8369-a2861ec3956c+5:6481:x1876178898018816:12345-0@lo:104: Request processed in 95us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263686.934298:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789263686.934299:0:7428:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd9bfa23400/0xce1582440fb1d767 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce1582440fb1d760 expref: 22 pid: 6481 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263686.934311:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1789263686.934317:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789263686.934323:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd9813fc600/0xce1582440fb1d6f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1d6f7 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263686.934330:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9813fc600 already unused, calling callback (ffffffffc12b1c20) 10000000:00010000:3.0:1789263686.934334:0:6476:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd9813fc600/0xce1582440fb1d6f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xce1582440fb1d6f7 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263686.934334:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898019456 00010000:00010000:1.0:1789263686.934337:0:6481:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd981682000/0xce1582440fb1d63a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce1582440fb1d633 expref: 22 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263686.934339:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898019456 00000100:00100000:2.0:1789263686.934358:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00010000:00010000:1.0:1789263686.934362:0:6481:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dd981682000/0xce1582440fb1d63a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce1582440fb1d633 expref: 22 pid: 6482 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263686.934363:0:6476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd9813fc600/0xce1582440fb1d6f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xce1582440fb1d6f7 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263686.934369:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c0ae6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:66a76ccf-c64c-4b18-8369-a2861ec3956c+5:6481:x1876178898018944:12345-0@lo:104: 10000000:00010000:3.0:1789263686.934383:0:6476:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd9813fc600/0xce1582440fb1d6f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xce1582440fb1d6f7 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263686.934390:0:6471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff9dd9813fd800/0xce1582440fb1d6b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1d6bf expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789263686.934397:0:6476:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789263686.934413:0:7428:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789263686.934416:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a5500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6481:1876178898019584:0@lo:104: 00010000:00010000:3.0:1789263686.934422:0:6476:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff9dd9813fc600/0xce1582440fb1d6f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d6f7 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263686.934430:0:6476:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789263686.934447:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd9813fc600/0xce1582440fb1d6f0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d6f7 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263686.934454:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd9813fc600/0xce1582440fb1d6f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d6f7 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263686.934456:0:7428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaa5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a76ccf-c64c-4b18-8369-a2861ec3956c+22:3620:x1876178898019072:12345-0@lo:103: Request processed in 241us (413us total) trans 0 rc 0/0 00010000:00010000:2.0:1789263686.934463:0:6471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789263686.934468:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263686.934476:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c0ae6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:66a76ccf-c64c-4b18-8369-a2861ec3956c+5:6481:x1876178898018944:12345-0@lo:104: Request processed in 107us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263686.934476:0:7428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1789263686.934479:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789263686.934486:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd9813fd800/0xce1582440fb1d6b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1d6bf expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263686.934489:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd8838d1b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789263686.934490:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:3.0:1789263686.934502:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9813fd800 already unused, calling callback (ffffffffc12b1c20) 10000000:00010000:3.0:1789263686.934506:0:6476:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd9813fd800/0xce1582440fb1d6b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xce1582440fb1d6bf expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263686.934513:0:6476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd9813fd800/0xce1582440fb1d6b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xce1582440fb1d6bf expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263686.934516:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd9bfa23400/0xce1582440fb1d767 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce1582440fb1d760 expref: 21 pid: 6481 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263686.934525:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898019584 10000000:00010000:3.0:1789263686.934527:0:6476:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd9813fd800/0xce1582440fb1d6b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xce1582440fb1d6bf expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263686.934532:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898019584 00000100:00100000:1.0:1789263686.934537:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88297ea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6481:1876178898018560:0@lo:104: 10000000:01000000:3.0:1789263686.934544:0:6476:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1789263686.934554:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789263686.934558:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88297ed80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6481:1876178898018688:0@lo:104: 00000100:00100000:2.0:1789263686.934565:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:66a76ccf-c64c-4b18-8369-a2861ec3956c+5:6481:x1876178898019200:12345-0@lo:104: 00000100:00100000:1.0:1789263686.934572:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88297d180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6481:1876178898018816:0@lo:104: 00010000:00010000:2.0:1789263686.934574:0:6471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff9dd981530200/0xce1582440fb1d69c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1d6a3 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263686.934583:0:6476:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff9dd9813fd800/0xce1582440fb1d6b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d6bf expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263686.934587:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88297f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6481:1876178898018944:0@lo:104: 00010000:00010000:3.0:1789263686.934597:0:6476:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789263686.934606:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd9813fd800/0xce1582440fb1d6b8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d6bf expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263686.934611:0:6471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1789263686.934614:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd9813fd800/0xce1582440fb1d6b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d6bf expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263686.934620:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88297d500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6481:1876178898019200:0@lo:104: 00000100:00100000:2.0:1789263686.934621:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:66a76ccf-c64c-4b18-8369-a2861ec3956c+5:6481:x1876178898019200:12345-0@lo:104: Request processed in 57us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263686.934635:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:3.0:1789263686.934638:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789263686.934643:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd981530200/0xce1582440fb1d69c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1d6a3 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263686.934650:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981530200 already unused, calling callback (ffffffffc12b1c20) 00000100:00100000:2.0:1789263686.934651:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 10000000:00010000:3.0:1789263686.934656:0:6476:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd981530200/0xce1582440fb1d69c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xce1582440fb1d6a3 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263686.934661:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:66a76ccf-c64c-4b18-8369-a2861ec3956c+4:6481:x1876178898019456:12345-0@lo:104: 00010000:00010000:3.0:1789263686.934672:0:6476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd981530200/0xce1582440fb1d69c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xce1582440fb1d6a3 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263686.934672:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9c08a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:66a76ccf-c64c-4b18-8369-a2861ec3956c:3618:1876178898019712:0@lo:103: 00010000:00010000:2.0:1789263686.934674:0:6471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff9dd981682200/0xce1582440fb1d65d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1d664 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789263686.934693:0:6476:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd981530200/0xce1582440fb1d69c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xce1582440fb1d6a3 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789263686.934701:0:6476:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789263686.934708:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789263686.934725:0:6476:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff9dd981530200/0xce1582440fb1d69c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d6a3 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263686.934733:0:6476:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789263686.934735:0:6471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789263686.934743:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789263686.934744:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:66a76ccf-c64c-4b18-8369-a2861ec3956c+4:6481:x1876178898019456:12345-0@lo:104: Request processed in 82us (451us total) trans 0 rc 0/0 00010000:00010000:3.0:1789263686.934750:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd981530200/0xce1582440fb1d69c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d6a3 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263686.934754:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9c08aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:66a76ccf-c64c-4b18-8369-a2861ec3956c:3618:1876178898019840:0@lo:103: 00000100:00100000:2.0:1789263686.934757:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:3.0:1789263686.934766:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd981530200/0xce1582440fb1d69c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d6a3 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263686.934776:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00010000:00010000:3.0:1789263686.934779:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789263686.934785:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd981682200/0xce1582440fb1d65d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1d664 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263686.934789:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:66a76ccf-c64c-4b18-8369-a2861ec3956c+3:6481:x1876178898019584:12345-0@lo:104: 00000100:00100000:1.0:1789263686.934794:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789263686.934800:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981682200 already unused, calling callback (ffffffffc12b1c20) 10000000:00010000:3.0:1789263686.934806:0:6476:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd981682200/0xce1582440fb1d65d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xce1582440fb1d664 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263686.934812:0:6471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff9dd990432a00/0xce1582440fb1d633 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1d63a expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263686.934817:0:6476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd981682200/0xce1582440fb1d65d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xce1582440fb1d664 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263686.934822:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898019712 00000100:00100000:0.0:1789263686.934827:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898019712 10000000:00010000:3.0:1789263686.934831:0:6476:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd981682200/0xce1582440fb1d65d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xce1582440fb1d664 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789263686.934844:0:6476:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789263686.934846:0:6472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd981530600/0xce1582440fb1d6f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1d6f0 expref: 21 pid: 6482 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263686.934852:0:6471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789263686.934854:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9c08a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:66a76ccf-c64c-4b18-8369-a2861ec3956c:3621:1876178898019328:0@lo:103: 00000100:00100000:2.0:1789263686.934863:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:66a76ccf-c64c-4b18-8369-a2861ec3956c+3:6481:x1876178898019584:12345-0@lo:104: Request processed in 78us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263686.934871:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:3.0:1789263686.934882:0:6476:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff9dd981682200/0xce1582440fb1d65d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d664 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263686.934883:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898019840 00000100:00100000:0.0:1789263686.934888:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898019840 00010000:00010000:2.0:1789263686.934891:0:6475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789263686.934892:0:6476:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789263686.934896:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd990432a00/0xce1582440fb1d633 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1d63a expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263686.934902:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd990432a00 already unused, calling callback (ffffffffc12b1c20) 00010000:00010000:3.0:1789263686.934903:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd981682200/0xce1582440fb1d65d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d664 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263686.934904:0:6472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd990433200/0xce1582440fb1d6bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1d6b8 expref: 22 pid: 6481 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789263686.934908:0:6475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd990432a00/0xce1582440fb1d633 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xce1582440fb1d63a expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263686.934909:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789263686.934929:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd981682200/0xce1582440fb1d65d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d664 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263686.934931:0:6475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd990432a00/0xce1582440fb1d633 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xce1582440fb1d63a expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263686.934942:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:66a76ccf-c64c-4b18-8369-a2861ec3956c:3621:1876178898020096:0@lo:103: 00000100:00100000:0.0:1789263686.934942:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898019328 00000100:00100000:0.0:1789263686.934949:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898019328 10000000:00010000:2.0:1789263686.934953:0:6475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd990432a00/0xce1582440fb1d633 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xce1582440fb1d63a expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263686.934954:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789263686.934961:0:6475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789263686.934964:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263686.934969:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263686.934973:0:6472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd9813fde00/0xce1582440fb1d713 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1d70c expref: 23 pid: 6482 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263686.934982:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789263686.934984:0:6475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff9dd990432a00/0xce1582440fb1d633 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d63a expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263686.934989:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1789263686.934996:0:6475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789263686.934998:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789263686.935005:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd987242850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a76ccf-c64c-4b18-8369-a2861ec3956c+23:3618:x1876178898019712:12345-0@lo:103: 00000100:00100000:0.0:1789263686.935005:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898020096 00000100:00100000:1.0:1789263686.935009:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9c08a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:66a76ccf-c64c-4b18-8369-a2861ec3956c:3621:1876178898019968:0@lo:103: 00000100:00100000:0.0:1789263686.935011:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898020096 00010000:00010000:2.0:1789263686.935012:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd990432a00/0xce1582440fb1d633 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d63a expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263686.935019:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789263686.935026:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd990432a00/0xce1582440fb1d633 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d63a expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263686.935029:0:8409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd981530600/0xce1582440fb1d6f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1d6f0 expref: 24 pid: 6482 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263686.935045:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789263686.935045:0:6472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd990433a00/0xce1582440fb1d664 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1d65d expref: 24 pid: 6482 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263686.935052:0:8409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd981530600/0xce1582440fb1d6f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce1582440fb1d6f0 expref: 24 pid: 6482 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263686.935064:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789263686.935069:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789263686.935071:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263686.935103:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd981530600/0xce1582440fb1d6f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce1582440fb1d6f0 expref: 24 pid: 6482 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263686.935105:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898019968 00000100:00100000:0.0:1789263686.935111:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898019968 00000100:00100000:2.0:1789263686.935114:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1789263686.935118:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789263686.935128:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a76ccf-c64c-4b18-8369-a2861ec3956c+24:3618:x1876178898019840:12345-0@lo:103: 00010000:00010000:0.0:1789263686.935135:0:6472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd990432200/0xce1582440fb1d6a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1d69c expref: 24 pid: 6480 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263686.935139:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789263686.935140:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9c08aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:66a76ccf-c64c-4b18-8369-a2861ec3956c:3620:1876178898019072:0@lo:103: 00010000:00010000:2.0:1789263686.935149:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd990433200/0xce1582440fb1d6bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1d6b8 expref: 24 pid: 6481 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263686.935161:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd987242850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a76ccf-c64c-4b18-8369-a2861ec3956c+24:3618:x1876178898019712:12345-0@lo:103: Request processed in 159us (451us total) trans 0 rc 0/0 00010000:00010000:2.0:1789263686.935173:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd990433200/0xce1582440fb1d6bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce1582440fb1d6b8 expref: 24 pid: 6481 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263686.935175:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88297c000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6481:1876178898019456:0@lo:104: 00000100:00100000:3.0:1789263686.935179:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1789263686.935198:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd990433200/0xce1582440fb1d6bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce1582440fb1d6b8 expref: 23 pid: 6481 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263686.935198:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a5500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6481:1876178898019584:0@lo:104: 00000100:00100000:0.0:1789263686.935203:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00010000:00010000:2.0:1789263686.935214:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789263686.935226:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88396a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a76ccf-c64c-4b18-8369-a2861ec3956c+22:3621:x1876178898019328:12345-0@lo:103: 00010000:00010000:0.0:1789263686.935238:0:6472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789263686.935242:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00010000:00010000:0.0:1789263686.935244:0:6472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd9813fde00/0xce1582440fb1d713 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1d70c expref: 22 pid: 6482 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263686.935247:0:6481:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dd981683800/0xce1582440fb1d77c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263686.935248:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a76ccf-c64c-4b18-8369-a2861ec3956c+22:3618:x1876178898019840:12345-0@lo:103: Request processed in 124us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263686.935256:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883969180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a76ccf-c64c-4b18-8369-a2861ec3956c+22:3621:x1876178898020096:12345-0@lo:103: 00000100:00100000:2.0:1789263686.935279:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1789263686.935283:0:6472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd9813fde00/0xce1582440fb1d713 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce1582440fb1d70c expref: 22 pid: 6482 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263686.935286:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789263686.935295:0:8409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd990433a00/0xce1582440fb1d664 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1d65d expref: 21 pid: 6482 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263686.935299:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00010000:00010000:0.0:1789263686.935302:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd9813fde00/0xce1582440fb1d713 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce1582440fb1d70c expref: 21 pid: 6482 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263686.935313:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883969f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a76ccf-c64c-4b18-8369-a2861ec3956c+21:3621:x1876178898019968:12345-0@lo:103: 00010000:00010000:3.0:1789263686.935320:0:8409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd990433a00/0xce1582440fb1d664 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce1582440fb1d65d expref: 20 pid: 6482 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263686.935327:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789263686.935329:0:6472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789263686.935335:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd990432200/0xce1582440fb1d6a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1d69c expref: 20 pid: 6480 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263686.935337:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd990433a00/0xce1582440fb1d664 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce1582440fb1d65d expref: 20 pid: 6482 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263686.935357:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd990432200/0xce1582440fb1d6a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce1582440fb1d69c expref: 20 pid: 6480 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263686.935375:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88396a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a76ccf-c64c-4b18-8369-a2861ec3956c+20:3621:x1876178898019328:12345-0@lo:103: Request processed in 146us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263686.935390:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:3.0:1789263686.935393:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789263686.935401:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd990432200/0xce1582440fb1d6a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce1582440fb1d69c expref: 19 pid: 6480 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263686.935404:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9c08a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:66a76ccf-c64c-4b18-8369-a2861ec3956c:3621:1876178898019328:0@lo:103: 00010000:00010000:2.0:1789263686.935421:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789263686.935427:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883969180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a76ccf-c64c-4b18-8369-a2861ec3956c+17:3621:x1876178898020096:12345-0@lo:103: Request processed in 175us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263686.935436:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:66a76ccf-c64c-4b18-8369-a2861ec3956c:3621:1876178898020096:0@lo:103: 00000100:00100000:3.0:1789263686.935437:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789263686.935455:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883969f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a76ccf-c64c-4b18-8369-a2861ec3956c+16:3621:x1876178898019968:12345-0@lo:103: Request processed in 146us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263686.935461:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789263686.935464:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9c08a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:66a76ccf-c64c-4b18-8369-a2861ec3956c:3621:1876178898019968:0@lo:103: 00010000:00010000:2.0:1789263686.935483:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789263686.935498:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:66a76ccf-c64c-4b18-8369-a2861ec3956c:3618:1876178898020224:0@lo:103: 00000100:00100000:2.0:1789263686.935514:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263686.935544:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9c08aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:66a76ccf-c64c-4b18-8369-a2861ec3956c:3618:1876178898019840:0@lo:103: 00000100:00100000:2.0:1789263686.935548:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9c08a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:66a76ccf-c64c-4b18-8369-a2861ec3956c:3618:1876178898019712:0@lo:103: 00000100:00100000:1.0:1789263686.936235:0:7428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898020224 00000100:00100000:1.0:1789263686.936241:0:7428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898020224 00010000:00010000:1.0:1789263686.936401:0:7428:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd981682000/0xce1582440fb1d63a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1d633 expref: 16 pid: 6482 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263686.936440:0:7428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789263686.936449:0:7428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a76ccf-c64c-4b18-8369-a2861ec3956c+16:3618:x1876178898020224:12345-0@lo:103: 00010000:00010000:1.0:1789263686.936458:0:7428:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789263686.936463:0:7428:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd981682000/0xce1582440fb1d63a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1d633 expref: 16 pid: 6482 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263686.936474:0:7428:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd981682000/0xce1582440fb1d63a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce1582440fb1d633 expref: 16 pid: 6482 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263686.936485:0:7428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd981682000/0xce1582440fb1d63a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce1582440fb1d633 expref: 16 pid: 6482 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263686.936496:0:7428:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dd981683800/0xce1582440fb1d77c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263686.936514:0:7428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd981683800/0xce1582440fb1d77c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263686.936526:0:7428:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd981683800/0xce1582440fb1d77c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263686.936532:0:7428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd981683800/0xce1582440fb1d77c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263686.936538:0:7428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dd981683800/0xce1582440fb1d77c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263686.936544:0:7428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dd981683800/0xce1582440fb1d77c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263686.936549:0:7428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981683800 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263686.936552:0:7428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dd981683800/0xce1582440fb1d77c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263686.936563:0:7428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dd981683800/0xce1582440fb1d77c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263686.936578:0:7428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dd981683800/0xce1582440fb1d77c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263686.936587:0:7428:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789263686.936613:0:6481:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dd981683800/0xce1582440fb1d77c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263686.936623:0:6481:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dd981683800/0xce1582440fb1d77c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263686.936631:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd981683800/0xce1582440fb1d77c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263686.936633:0:7428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a76ccf-c64c-4b18-8369-a2861ec3956c+15:3618:x1876178898020224:12345-0@lo:103: Request processed in 184us (1115us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263686.936649:0:7428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 20000000:01000000:2.0:1789263686.936655:0:6481:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1789263686.936660:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:66a76ccf-c64c-4b18-8369-a2861ec3956c:3618:1876178898020224:0@lo:103: 00000100:00100000:2.0:1789263686.938599:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+14:9477:x1876178898018432:12345-0@lo:253: Request processed in 11285us (11428us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263686.938608:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789263686.938635:0:9477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9c08a8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:9477:1876178898018432:0@lo:253: 10000000:01000000:3.0:1789263686.938649:0:9477:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789263686.938652:0:9477:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789263686.938653:0:9477:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789263686.938654:0:9477:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789263686.938655:0:9477:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1789263686.938655:0:9477:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789263686.938656:0:9477:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789263686.938657:0:9477:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789263686.938658:0:9477:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1789263686.938659:0:9477:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789263686.938660:0:9477:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789263686.938676:0:9477:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9dd882a29800 from lustre-OST0001 10000000:01000000:3.0:1789263686.938697:0:9477:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1789263686.938699:0:9477:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789263686.938706:0:9477:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9dd9b7983370 local copy 10000000:01000000:3.0:1789263686.938708:0:9477:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789263686.938734:0:9477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd981530a00/0xce1582440fb1d783 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263686.938741:0:9477:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.120@tcp lock: ffff9dd981530a00/0xce1582440fb1d783 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263686.938747:0:9477:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd981530a00/0xce1582440fb1d783 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263686.938769:0:9477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:9477:1876178898020352:0@lo:101: 00000100:00100000:3.0:1789263686.938800:0:9477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263686.938832:0:9477:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9ba82e900 going to sleep for 11 seconds 00000100:00100000:1.0:1789263686.938837:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898020352 00000100:00100000:1.0:1789263686.938850:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898020352 00000100:00100000:1.0:1789263686.938890:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789263686.938899:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+14:9477:x1876178898020352:12345-0@lo:101: 00010000:00010000:1.0:1789263686.938910:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263686.938923:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd981683a00/0xce1582440fb1d78a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1d783 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263686.938943:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd981683a00/0xce1582440fb1d78a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1d783 expref: 15 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263686.938951:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd981683a00/0xce1582440fb1d78a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d783 expref: 15 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263686.938957:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981683a00, rc 0) 00000100:00100000:1.0:1789263686.938987:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+15:9477:x1876178898020352:12345-0@lo:101: Request processed in 92us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263686.938992:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789263686.939036:0:9477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:9477:1876178898020352:0@lo:101: 00010000:00010000:3.0:1789263686.939050:0:9477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd981530a00/0xce1582440fb1d783 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xce1582440fb1d78a expref: -99 pid: 9477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263686.939060:0:9477:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd981530a00/0xce1582440fb1d783 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xce1582440fb1d78a expref: -99 pid: 9477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263686.939177:0:9477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:9477:1876178898020480:0@lo:501: 00000100:00100000:3.0:1789263686.939206:0:9477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263686.939230:0:9477:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9ba82e900 going to sleep for 11 seconds 00000100:00100000:2.0:1789263686.939240:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898020480 00000100:00100000:2.0:1789263686.939247:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898020480 00000100:00100000:2.0:1789263686.939307:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789263686.939315:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+15:9477:x1876178898020480:12345-0@lo:501: 00000100:00100000:2.0:1789263686.939378:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+15:9477:x1876178898020480:12345-0@lo:501: Request processed in 64us (171us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789263686.939385:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789263686.939409:0:9477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:9477:1876178898020480:0@lo:501: 10000000:01000000:3.0:1789263686.939424:0:9477:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.120@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789263686.939440:0:9477:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.120@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789263686.939445:0:9477:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd981530a00/0xce1582440fb1d783 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xce1582440fb1d78a expref: -99 pid: 9477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263686.939454:0:9477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd981530a00/0xce1582440fb1d783 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xce1582440fb1d78a expref: -99 pid: 9477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263686.939461:0:9477:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff9dd981530a00/0xce1582440fb1d783 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xce1582440fb1d78a expref: -99 pid: 9477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263686.939482:0:9477:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789263686.939503:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789263686.939510:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd981530a00/0xce1582440fb1d783 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xce1582440fb1d78a expref: -99 pid: 9477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789263686.939512:0:9477:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9dd882a29800 10000000:01000000:3.0:1789263686.939519:0:9477:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789263686.939521:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981530a00 already unused, calling callback (ffffffffc12b1c20) 10000000:01000000:3.0:1789263686.939526:0:9477:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:00010000:2.0:1789263686.939527:0:6476:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd981530a00/0xce1582440fb1d783 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xce1582440fb1d78a expref: -99 pid: 9477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789263686.939532:0:9477:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789263686.939538:0:9477:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1789263686.939540:0:9477:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789263686.939550:0:6476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd981530a00/0xce1582440fb1d783 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xce1582440fb1d78a expref: -99 pid: 9477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263686.939557:0:9477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd981530e00/0xce1582440fb1d791 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263686.939566:0:9477:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd981530e00/0xce1582440fb1d791 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789263686.939567:0:6476:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd981530a00/0xce1582440fb1d783 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x9400000000 nid: local remote: 0xce1582440fb1d78a expref: -99 pid: 9477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263686.939581:0:9477:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd981530e00/0xce1582440fb1d791 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789263686.939581:0:6476:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789263686.939598:0:9477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:9477:1876178898020608:0@lo:101: 00010000:00010000:2.0:1789263686.939603:0:6476:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff9dd981530a00/0xce1582440fb1d783 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xce1582440fb1d78a expref: -99 pid: 9477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263686.939610:0:6476:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789263686.939629:0:9477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789263686.939641:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd981530a00/0xce1582440fb1d783 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xce1582440fb1d78a expref: -99 pid: 9477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263686.939649:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd981530a00/0xce1582440fb1d783 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xce1582440fb1d78a expref: -99 pid: 9477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263686.939659:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898020608 00000100:00100000:1.0:1789263686.939661:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:66a76ccf-c64c-4b18-8369-a2861ec3956c:3619:1876178898020736:0@lo:103: 00000100:00100000:3.0:1789263686.939665:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898020608 00010000:00010000:2.0:1789263686.939677:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789263686.939681:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789263686.939683:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789263686.939698:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789263686.939706:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263686.939707:0:9477:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9ba82e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789263686.939710:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+15:9477:x1876178898020608:12345-0@lo:101: 00010000:00010000:3.0:1789263686.939719:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263686.939729:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd981530400/0xce1582440fb1d798 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1d791 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263686.939746:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd981530400/0xce1582440fb1d798 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1d791 expref: 16 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263686.939755:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd981530400/0xce1582440fb1d798 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d791 expref: 16 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263686.939760:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898020736 00000100:00100000:1.0:1789263686.939766:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898020736 00010000:00010000:3.0:1789263686.939777:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981530400, rc 0) 00000100:00100000:1.0:1789263686.939809:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789263686.939818:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88396b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a76ccf-c64c-4b18-8369-a2861ec3956c+17:3619:x1876178898020736:12345-0@lo:103: 00000100:00100000:3.0:1789263686.939822:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+17:9477:x1876178898020608:12345-0@lo:101: Request processed in 114us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263686.939831:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00010000:00010000:1.0:1789263686.939831:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789263686.939849:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd981683a00/0xce1582440fb1d78a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xce1582440fb1d783 expref: 16 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263686.939855:0:9477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:9477:1876178898020608:0@lo:101: 00010000:00010000:1.0:1789263686.939867:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789263686.939873:0:9477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd981530e00/0xce1582440fb1d791 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d798 expref: -99 pid: 9477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263686.939884:0:9477:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd981530e00/0xce1582440fb1d791 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1d798 expref: -99 pid: 9477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263686.939906:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88396b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a76ccf-c64c-4b18-8369-a2861ec3956c+15:3619:x1876178898020736:12345-0@lo:103: Request processed in 89us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263686.939922:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789263686.939927:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:66a76ccf-c64c-4b18-8369-a2861ec3956c:3619:1876178898020736:0@lo:103: 00000100:00100000:0.0:1789263686.939950:0:9477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:9477:1876178898020864:0@lo:501: 00000100:00100000:0.0:1789263686.939977:0:9477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263686.939994:0:9477:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9863253c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789263686.940002:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898020864 00000100:00100000:2.0:1789263686.940007:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898020864 00000100:00100000:2.0:1789263686.940030:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789263686.940036:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+15:9477:x1876178898020864:12345-0@lo:501: 00000100:00100000:2.0:1789263686.940199:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+15:9477:x1876178898020864:12345-0@lo:501: Request processed in 162us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263686.940206:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789263686.940250:0:9477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:9477:1876178898020864:0@lo:501: 00000100:00100000:1.0:1789263686.940290:0:9477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883969500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:9477:1876178898020992:0@lo:503: 00000100:00100000:1.0:1789263686.940326:0:9477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263686.940349:0:9477:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd8838d1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789263686.940360:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898020992 00000100:00100000:3.0:1789263686.940365:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898020992 00000100:00100000:3.0:1789263686.940396:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789263686.940402:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+15:9477:x1876178898020992:12345-0@lo:503: 00000100:00100000:3.0:1789263686.940484:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+15:9477:x1876178898020992:12345-0@lo:503: Request processed in 82us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263686.940492:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789263686.940516:0:9477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883969500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:9477:1876178898020992:0@lo:503: 00000040:00080000:1.0:1789263686.940756:0:9477:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789263686.940884:0:9477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883969500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:9477:1876178898021120:0@lo:502: 00000100:00100000:1.0:1789263686.940918:0:9477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263686.940936:0:9477:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd8838d1b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789263686.940957:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898021120 00000100:00100000:2.0:1789263686.940963:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898021120 00000100:00100000:2.0:1789263686.940997:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789263686.941003:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+15:9477:x1876178898021120:12345-0@lo:502: 00000100:00100000:2.0:1789263686.941105:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+15:9477:x1876178898021120:12345-0@lo:502: Request processed in 101us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263686.941112:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789263686.941126:0:9477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883969500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:9477:1876178898021120:0@lo:502: 00000040:00080000:1.0:1789263686.941387:0:9477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1789263686.941412:0:9477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1789263686.941426:0:9477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1789263686.941439:0:9477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1789263686.941452:0:9477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1789263686.941501:0:9477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1789263686.941521:0:9477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883969500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:9477:1876178898021248:0@lo:502: 00000100:00100000:1.0:1789263686.941552:0:9477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263686.941580:0:9477:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd8838d1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789263686.941621:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898021248 00000100:00100000:3.0:1789263686.941625:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898021248 00000100:00100000:3.0:1789263686.941648:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789263686.941654:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+15:9477:x1876178898021248:12345-0@lo:502: 00000100:00100000:3.0:1789263686.941759:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+15:9477:x1876178898021248:12345-0@lo:502: Request processed in 104us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263686.941766:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789263686.941821:0:9477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883969500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:9477:1876178898021248:0@lo:502: 00000040:00080000:1.0:1789263686.941851:0:9477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1789263686.941857:0:9477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:3.0:1789263686.942241:0:9489:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789263686.942248:0:9489:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1789263686.942253:0:9489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789263686.942256:0:9489:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1789263686.942273:0:9489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789263686.942293:0:9489:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9dd883898000) 00000020:00000080:3.0:1789263686.942313:0:9489:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789263686.942320:0:9489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789263686.942387:0:9489:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dd882a29800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1789263686.942400:0:9489:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789263686.942406:0:9489:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xce1582440fb1d7a6 00010000:00010000:3.0:1789263686.945777:0:9489:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:3.0:1789263686.946017:0:9489:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1789263686.948574:0:9489:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1789263686.948849:0:9489:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1789263686.953286:0:9489:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:3.0:1789263686.953469:0:9489:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:2.0:1789263686.958943:0:9489:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:2.0:1789263686.959871:0:9489:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1789263686.959882:0:9489:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789263686.959887:0:9489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263686.959889:0:9489:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1789263686.959892:0:9489:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789263686.959895:0:9489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263686.959896:0:9489:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789263686.959904:0:9489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789263686.959906:0:9489:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789263686.959921:0:9489:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789263686.959924:0:9489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263686.959925:0:9489:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789263686.959928:0:9489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1789263686.960010:0:9477:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1789263686.960045:0:9477:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789263686.960070:0:9477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd981530e00/0xce1582440fb1d791 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d798 expref: -99 pid: 9477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263686.960110:0:9477:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd981530e00/0xce1582440fb1d791 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d798 expref: -99 pid: 9477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789263686.960120:0:9477:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dd882a29800 from 1 10000000:01000000:1.0:1789263686.960123:0:9477:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789263686.960160:0:9477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd981683a00/0xce1582440fb1d7ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263686.960173:0:9477:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd981683a00/0xce1582440fb1d7ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263686.960184:0:9477:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd981683a00/0xce1582440fb1d7ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263686.960209:0:9477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883969500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:9477:1876178898021376:0@lo:101: 00000100:00100000:1.0:1789263686.960285:0:9477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263686.960344:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898021376 00000100:00100000:1.0:1789263686.960350:0:9477:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd8838d1b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789263686.960352:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898021376 00000100:00100000:2.0:1789263686.960415:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789263686.960426:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+15:9477:x1876178898021376:12345-0@lo:101: 00010000:00010000:2.0:1789263686.960440:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263686.960453:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd9bfa22e00/0xce1582440fb1d7b4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1d7ad expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263686.960476:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd9bfa22e00/0xce1582440fb1d7b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1d7ad expref: 16 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263686.960487:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd9bfa22e00/0xce1582440fb1d7b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d7ad expref: 16 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263686.960496:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bfa22e00, rc 0) 00000100:00100000:2.0:1789263686.960555:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+16:9477:x1876178898021376:12345-0@lo:101: Request processed in 132us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263686.960562:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789263686.960668:0:9477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883969500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:9477:1876178898021376:0@lo:101: 00010000:00010000:1.0:1789263686.960683:0:9477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd981683a00/0xce1582440fb1d7ad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d7b4 expref: -99 pid: 9477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263686.960693:0:9477:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd981683a00/0xce1582440fb1d7ad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1d7b4 expref: -99 pid: 9477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263686.960780:0:9477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883969500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:9477:1876178898021504:0@lo:501: 00000100:00100000:1.0:1789263686.960813:0:9477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263686.960835:0:9477:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd8838d1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789263686.960852:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898021504 00000100:00100000:3.0:1789263686.960858:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898021504 00000100:00100000:3.0:1789263686.960889:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789263686.960898:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+16:9477:x1876178898021504:12345-0@lo:501: 00000100:00100000:3.0:1789263686.961007:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+16:9477:x1876178898021504:12345-0@lo:501: Request processed in 110us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263686.961014:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789263686.961110:0:9477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883969500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:9477:1876178898021504:0@lo:501: 00000100:00100000:2.0:1789263686.961140:0:9477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:9477:1876178898021632:0@lo:503: 00000100:00100000:2.0:1789263686.961184:0:9477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263686.961202:0:9477:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9c0b04a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789263686.961270:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898021632 00000100:00100000:3.0:1789263686.961275:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898021632 00000100:00100000:3.0:1789263686.961303:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789263686.961309:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+16:9477:x1876178898021632:12345-0@lo:503: 00000100:00100000:3.0:1789263686.961490:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+16:9477:x1876178898021632:12345-0@lo:503: Request processed in 179us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263686.961498:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789263686.961509:0:9477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:9477:1876178898021632:0@lo:503: 00000040:00080000:2.0:1789263686.961704:0:9477:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789263686.961761:0:9477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:9477:1876178898021760:0@lo:502: 00000100:00100000:2.0:1789263686.961797:0:9477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263686.961817:0:9477:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9c0b533c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789263686.961833:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898021760 00000100:00100000:3.0:1789263686.961839:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898021760 00000100:00100000:3.0:1789263686.961867:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789263686.961876:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+16:9477:x1876178898021760:12345-0@lo:502: 00000100:00100000:3.0:1789263686.961957:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+16:9477:x1876178898021760:12345-0@lo:502: Request processed in 83us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263686.961976:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789263686.961982:0:9477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:9477:1876178898021760:0@lo:502: 00000040:00080000:2.0:1789263686.962193:0:9477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1789263686.962223:0:9477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1789263686.962248:0:9477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:9477:1876178898021888:0@lo:502: 00000100:00100000:2.0:1789263686.962298:0:9477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263686.962315:0:9477:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9c0b533c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789263686.962353:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898021888 00000100:00100000:3.0:1789263686.962359:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898021888 00000100:00100000:2.0:1789263686.962400:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789263686.962410:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+16:9477:x1876178898021888:12345-0@lo:502: 00000100:00100000:2.0:1789263686.962506:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+16:9477:x1876178898021888:12345-0@lo:502: Request processed in 99us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263686.962515:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789263686.962534:0:9477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:9477:1876178898021888:0@lo:502: 00000040:00080000:3.0:1789263686.962585:0:9477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1789263686.962595:0:9477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1789263686.962846:0:9493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789263686.962854:0:9493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789263686.962856:0:9493:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789263686.962862:0:9493:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dd882a29800 00000020:00000080:3.0:1789263686.962865:0:9493:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789263686.962877:0:9493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789263686.962880:0:9493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789263686.962881:0:9493:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789263686.962884:0:9493:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1789263686.962933:0:9477:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1789263686.962966:0:9477:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789263686.962982:0:9477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd981683a00/0xce1582440fb1d7ad lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d7b4 expref: -99 pid: 9477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263686.962993:0:9477:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd981683a00/0xce1582440fb1d7ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d7b4 expref: -99 pid: 9477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789263686.963037:0:9477:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789263686.963041:0:9477:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9dd882a29800 10000000:01000000:2.0:1789263686.963044:0:9477:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9dd882a29800 10000000:01000000:2.0:1789263686.963048:0:9477:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789263686.963058:0:9477:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9dd882a29800 from 1 10000000:01000000:2.0:1789263686.963061:0:9477:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789263686.963103:0:9477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22800/0xce1582440fb1d7bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263686.963112:0:9477:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22800/0xce1582440fb1d7bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263686.963120:0:9477:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22800/0xce1582440fb1d7bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263686.963133:0:9477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:9477:1876178898022016:0@lo:101: 00000100:00100000:2.0:1789263686.963161:0:9477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263686.963186:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898022016 00000100:00100000:2.0:1789263686.963189:0:9477:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9c0b04a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789263686.963192:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898022016 00000100:00100000:3.0:1789263686.963226:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789263686.963236:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c2072c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+16:9477:x1876178898022016:12345-0@lo:101: 00010000:00010000:3.0:1789263686.963245:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263686.963257:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd981530600/0xce1582440fb1d7c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1d7bb expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263686.963289:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd981530600/0xce1582440fb1d7c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1d7bb expref: 17 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263686.963300:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd981530600/0xce1582440fb1d7c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d7bb expref: 17 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263686.963308:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981530600, rc 0) 00000100:00100000:3.0:1789263686.963357:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c2072c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+17:9477:x1876178898022016:12345-0@lo:101: Request processed in 123us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263686.963366:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789263686.963373:0:9477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:9477:1876178898022016:0@lo:101: 00010000:00010000:2.0:1789263686.963388:0:9477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22800/0xce1582440fb1d7bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d7c2 expref: -99 pid: 9477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263686.963397:0:9477:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22800/0xce1582440fb1d7bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1d7c2 expref: -99 pid: 9477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263686.963452:0:9477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:9477:1876178898022144:0@lo:501: 00000100:00100000:2.0:1789263686.963481:0:9477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263686.963499:0:9477:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9c0b04a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789263686.963506:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898022144 00000100:00100000:3.0:1789263686.963512:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898022144 00000100:00100000:2.0:1789263686.963549:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789263686.963559:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd991565c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+17:9477:x1876178898022144:12345-0@lo:501: 00000100:00100000:2.0:1789263686.963645:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd991565c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+17:9477:x1876178898022144:12345-0@lo:501: Request processed in 88us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263686.963661:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789263686.963706:0:9477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:9477:1876178898022144:0@lo:501: 00000100:00100000:3.0:1789263686.963752:0:9477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:9477:1876178898022272:0@lo:503: 00000100:00100000:3.0:1789263686.963804:0:9477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263686.963823:0:9477:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9c09d76c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789263686.963839:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898022272 00000100:00100000:2.0:1789263686.963846:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898022272 00000100:00100000:2.0:1789263686.963877:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789263686.963885:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd991566050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+17:9477:x1876178898022272:12345-0@lo:503: 00000100:00100000:2.0:1789263686.963973:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd991566050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+17:9477:x1876178898022272:12345-0@lo:503: Request processed in 89us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263686.963978:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789263686.964057:0:9477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:9477:1876178898022272:0@lo:503: 00000040:00080000:0.0:1789263686.964245:0:9477:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789263686.964299:0:9477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:9477:1876178898022400:0@lo:502: 00000100:00100000:0.0:1789263686.964325:0:9477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263686.964350:0:9477:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd986325f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789263686.964362:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898022400 00000100:00100000:3.0:1789263686.964366:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898022400 00000100:00100000:3.0:1789263686.964402:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789263686.964410:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd991565850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+17:9477:x1876178898022400:12345-0@lo:502: 00000100:00100000:3.0:1789263686.964493:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd991565850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+17:9477:x1876178898022400:12345-0@lo:502: Request processed in 84us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263686.964499:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789263686.964535:0:9477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:9477:1876178898022400:0@lo:502: 00000040:00080000:1.0:1789263686.964697:0:9477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1789263686.964722:0:9477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1789263686.964738:0:9477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1789263686.964750:0:9477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1789263686.964760:0:9477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1789263686.964771:0:9477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1789263686.964782:0:9477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1789263686.964795:0:9477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1789263686.964810:0:9477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1789263686.964826:0:9477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1789263686.964839:0:9477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1789263686.964853:0:9477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1789263686.964868:0:9477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1789263686.964882:0:9477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1789263686.964896:0:9477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1789263686.964911:0:9477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1789263686.964926:0:9477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1789263686.964941:0:9477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1789263686.964955:0:9477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1789263686.964969:0:9477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1789263686.964985:0:9477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1789263686.965000:0:9477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1789263686.965014:0:9477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1789263686.965043:0:9477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1789263686.965059:0:9477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1789263686.965073:0:9477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1789263686.965113:0:9477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1789263686.965130:0:9477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:1.0:1789263686.965148:0:9477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1789263686.965163:0:9477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:1.0:1789263686.965176:0:9477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:1.0:1789263686.965200:0:9477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:1.0:1789263686.965215:0:9477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:1.0:1789263686.965229:0:9477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:1.0:1789263686.965243:0:9477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:1.0:1789263686.965272:0:9477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:1.0:1789263686.965290:0:9477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:1.0:1789263686.965304:0:9477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:1.0:1789263686.965318:0:9477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:1.0:1789263686.965341:0:9477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:1.0:1789263686.965354:0:9477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:1.0:1789263686.965366:0:9477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:1.0:1789263686.965377:0:9477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:1.0:1789263686.965388:0:9477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:1.0:1789263686.965399:0:9477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:1.0:1789263686.965409:0:9477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:1.0:1789263686.965430:0:9477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883968380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:9477:1876178898022528:0@lo:502: 00000100:00100000:1.0:1789263686.965467:0:9477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263686.965496:0:9477:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd8838d1e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789263686.965504:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898022528 00000100:00100000:3.0:1789263686.965509:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898022528 00000100:00100000:3.0:1789263686.965544:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789263686.965556:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd991567050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+17:9477:x1876178898022528:12345-0@lo:502: 00000100:00100000:3.0:1789263686.965627:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd991567050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+17:9477:x1876178898022528:12345-0@lo:502: Request processed in 76us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263686.965632:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789263686.965657:0:9477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883968380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:9477:1876178898022528:0@lo:502: 00000040:00080000:1.0:1789263686.965694:0:9477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:1.0:1789263686.965701:0:9477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:1.0:1789263686.965976:0:9494:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1789263686.965990:0:9494:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9dd9bf8f3370) 00000020:00000080:1.0:1789263686.966008:0:9494:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:1.0:1789263686.966103:0:9494:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dd882a29800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789263686.966108:0:9494:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dd882a29800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789263686.966110:0:9494:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dd882a29800 3 00010000:00080000:1.0:1789263686.966136:0:9494:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dd883880800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.120@tcp at head 00010000:00010000:1.0:1789263686.968068:0:9494:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:1.0:1789263686.968268:0:9494:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1789263686.968314:0:9494:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789263686.968324:0:9494:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xce1582440fb1d7d0 00000100:00080000:1.0:1789263686.968332:0:9494:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789263686.968337:0:9494:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9dd883880800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:1.0:1789263686.968368:0:9494:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd883968380 x1876178898022656/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789263686.968395:0:9494:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789263686.968431:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883968380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3617:1876178898022656:0@lo:38: 00000100:00100000:1.0:1789263686.968481:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1876178898022784:0@lo:400: 00000100:00100000:3.0:1789263686.968500:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263686.968530:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263686.968558:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898022912:0@lo:400: 00000100:00100000:1.0:1789263686.968568:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1876178898023296:0@lo:400: 00000100:00100000:3.0:1789263686.968588:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898022656 00000100:00100000:3.0:1789263686.968596:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898022656 00000100:00100000:0.0:1789263686.968616:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263686.968618:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263686.968644:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898022784 00000100:00100000:0.0:1789263686.968648:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898023424:0@lo:400: 00000100:00100000:3.0:1789263686.968649:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898022784 00000100:00100000:3.0:1789263686.968680:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898023296 00000100:00100000:3.0:1789263686.968684:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898023296 00000100:00100000:0.0:1789263686.968685:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263686.968729:0:8511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898023424 00000100:00100000:1.0:1789263686.968736:0:8511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898023424 00000100:00100000:3.0:1789263686.968743:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789263686.968750:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876178898023040:0@lo:400: 00000100:00100000:3.0:1789263686.968760:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883968000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1876178898022784:12345-0@lo:400: 00000100:00100000:1.0:1789263686.968783:0:8511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789263686.968784:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263686.968798:0:8511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaa4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1876178898023424:12345-0@lo:400: 00000100:00100000:0.0:1789263686.968808:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898023552:0@lo:400: 00000100:00100000:3.0:1789263686.968836:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883968000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1876178898022784:12345-0@lo:400: Request processed in 83us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263686.968843:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789263686.968854:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263686.968859:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898023040 00000100:00100000:1.0:1789263686.968860:0:8511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaa4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1876178898023424:12345-0@lo:400: Request processed in 66us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263686.968863:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898023040 00000100:00100000:1.0:1789263686.968871:0:8511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789263686.968883:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789263686.968886:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789263686.968893:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1876178898023168:0@lo:400: 00000100:00100000:3.0:1789263686.968895:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883969880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1876178898023296:12345-0@lo:400: 00000100:00100000:0.0:1789263686.968932:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263686.968937:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883969880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1876178898023296:12345-0@lo:400: Request processed in 44us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263686.968944:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789263686.968952:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898023680:0@lo:400: 00000100:00100000:3.0:1789263686.968954:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898023168 00000100:00100000:3.0:1789263686.968958:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898023168 00000100:00100000:3.0:1789263686.968986:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789263686.968992:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263686.968996:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaa4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876178898023040:12345-0@lo:400: 00000100:00100000:1.0:1789263686.969030:0:8395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898023680 00000100:00100000:1.0:1789263686.969035:0:8395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898023680 00000100:00100000:0.0:1789263686.969038:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789263686.969052:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaa4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876178898023040:12345-0@lo:400: Request processed in 53us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263686.969052:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88397c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3617:x1876178898022656:12345-0@lo:38: 00000100:00100000:1.0:1789263686.969071:0:8395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789263686.969110:0:8395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaa5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1876178898023680:12345-0@lo:400: 00000100:00100000:3.0:1789263686.969112:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1789263686.969123:0:8417:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 129 last 0 00000100:00100000:3.0:1789263686.969132:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789263686.969143:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaa7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876178898023168:12345-0@lo:400: 00000100:00100000:1.0:1789263686.969147:0:8395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaa5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1876178898023680:12345-0@lo:400: Request processed in 39us (154us total) trans 0 rc 0/0 00000020:00000080:0.0:1789263686.969152:0:8417:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xce1582440fb1d7d7 00000100:00100000:1.0:1789263686.969157:0:8395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000004:00100000:0.0:1789263686.969167:0:8417:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:3.0:1789263686.969195:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaa7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876178898023168:12345-0@lo:400: Request processed in 49us (259us total) trans 0 rc 0/0 00000100:00080000:0.0:1789263686.969197:0:8417:0:(import.c:65:import_set_state_nolock()) ffff9dd9bfa35000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789263686.969205:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789263686.969243:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88397c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1876178898022656:12345-0@lo:38: Request processed in 191us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263686.969244:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898022912 00000100:00100000:3.0:1789263686.969250:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898022912 00000100:00100000:0.0:1789263686.969275:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1789263686.969282:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd883968380 x1876178898022656/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789263696 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263686.969298:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898023552 00000100:00100000:1.0:1789263686.969307:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00100000:3.0:1789263686.969308:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898023552 00000100:00080000:1.0:1789263686.969319:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00010000:00080000:0.0:1789263686.969327:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd9bfaa5180 x1876178898023424/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789263702 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789263686.969328:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789263686.969335:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789263686.969339:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd883880800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789263686.969342:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789263686.969345:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898023424:0@lo:400: 00000100:00100000:1.0:1789263686.969352:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883968380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3617:1876178898022656:0@lo:38: 00000100:00100000:3.0:1789263686.969355:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaa5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1876178898022912:12345-0@lo:400: 00000100:00100000:3.0:1789263686.969412:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaa5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1876178898022912:12345-0@lo:400: Request processed in 60us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263686.969416:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789263686.969426:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789263686.969431:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaa4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1876178898023552:12345-0@lo:400: 00000100:00100000:3.0:1789263686.969451:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaa4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1876178898023552:12345-0@lo:400: Request processed in 22us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263686.969455:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1789263686.969472:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789263686.969477:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789263686.969479:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1789263686.969511:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd9bfaa6680 x1876178898023296/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263702 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263686.969520:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1876178898023296:0@lo:400: 00010000:00080000:3.0:1789263686.969527:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd9bfaa7b80 x1876178898022784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263702 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263686.969534:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1876178898022784:0@lo:400: 00010000:00080000:3.0:1789263686.969554:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd9bfaa6d80 x1876178898023168/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263702 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263686.969559:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1876178898023168:0@lo:400: 00010000:00080000:3.0:1789263686.969585:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd9bfaa7480 x1876178898023680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789263702 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263686.969594:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898023680:0@lo:400: 00010000:00080000:3.0:1789263686.969605:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd9bfaa6300 x1876178898023040/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263702 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263686.969614:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876178898023040:0@lo:400: 00000100:00100000:3.0:1789263686.969624:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898023552:0@lo:400: 00000100:00100000:0.0:1789263686.969798:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898022912:0@lo:400: 00000020:01000004:1.0:1789263686.970828:0:9494:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1789263686.970845:0:9494:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9dd9bf8f0000) 00000020:00000080:1.0:1789263686.970866:0:9494:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000100:00100000:2.0:1789263686.970903:0:9496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaaf800 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9496:1876178898023808:0@lo:901: 00000020:01000004:1.0:1789263686.970960:0:9494:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dd882a29800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789263686.970966:0:9494:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dd882a29800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789263686.970969:0:9494:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dd882a29800 3 00000100:00100000:2.0:1789263686.970976:0:9496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789263686.971011:0:9494:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dd883886000@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.120@tcp at head 00000100:00100000:2.0:1789263686.971025:0:9496:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9c09d3000 going to sleep for 11 seconds 00000100:00100000:3.0:1789263686.971045:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898023808 00000100:00100000:3.0:1789263686.971052:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898023808 00000100:00100000:3.0:1789263686.971130:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789263686.971139:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9496:x1876178898023808:12345-0@lo:901: 00000100:00100000:3.0:1789263686.971225:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9496:x1876178898023808:12345-0@lo:901: Request processed in 87us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263686.971232:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1789263686.971328:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789263686.971356:0:9496:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd9bfaaf800 x1876178898023808/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789263702 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789263686.971369:0:9496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaaf800 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9496:1876178898023808:0@lo:901: 00010000:00010000:1.0:1789263686.972545:0:9494:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:1.0:1789263686.972681:0:9494:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1789263686.972713:0:9494:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789263686.972724:0:9494:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xce1582440fb1d7e5 00000100:00080000:1.0:1789263686.972732:0:9494:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789263686.972737:0:9494:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9dd883886000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:1.0:1789263686.972768:0:9494:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd883968380 x1876178898023936/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789263686.972787:0:9494:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1789263686.972858:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883968380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3617:1876178898023936:0@lo:38: 00000100:00100000:3.0:1789263686.972904:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1789263686.972905:0:9494:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000100:00100000:3.0:1789263686.972958:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898023936 00000100:00100000:3.0:1789263686.972964:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898023936 00000100:00100000:3.0:1789263686.973007:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789263686.973014:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88397f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3617:x1876178898023936:12345-0@lo:38: 00010000:00080000:3.0:1789263686.973035:0:6489:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 129 last 0 00000020:00000080:3.0:1789263686.973064:0:6489:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xce1582440fb1d7ec 00000004:00100000:3.0:1789263686.973119:0:6489:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789263686.973145:0:6489:0:(import.c:65:import_set_state_nolock()) ffff9dd883897800 : changing import state from RECOVER to FULL 00000020:01000000:0.0:1789263686.973194:0:9477:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 00000100:00100000:3.0:1789263686.973206:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88397f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1876178898023936:12345-0@lo:38: Request processed in 191us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263686.973212:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 10000000:01000000:0.0:1789263686.973250:0:9477:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00080000:2.0:1789263686.973256:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd883968380 x1876178898023936/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789263696 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789263686.973277:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00010000:00010000:0.0:1789263686.973282:0:9477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22800/0xce1582440fb1d7bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d7c2 expref: -99 pid: 9477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789263686.973284:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1789263686.973293:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00010000:00010000:0.0:1789263686.973297:0:9477:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22800/0xce1582440fb1d7bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d7c2 expref: -99 pid: 9477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789263686.973299:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1789263686.973304:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd883886000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789263686.973317:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883968380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3617:1876178898023936:0@lo:38: 00000020:01000004:0.0:1789263686.973412:0:9477:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789263686.973415:0:9477:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789263686.973416:0:9477:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789263686.973417:0:9477:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789263686.973419:0:9477:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789263686.973421:0:9477:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789263686.973422:0:9477:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789263686.973424:0:9477:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789263686.973426:0:9477:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789263686.973427:0:9477:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789263686.973429:0:9477:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789263686.973433:0:9477:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1789263686.973435:0:9477:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789263686.973436:0:9477:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789263686.973438:0:9477:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789263686.973440:0:9477:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789263686.973441:0:9477:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789263686.973443:0:9477:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789263686.973444:0:9477:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789263686.973450:0:9477:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789263686.973452:0:9477:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789263686.973453:0:9477:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789263686.973454:0:9477:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789263686.973468:0:9477:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1789263686.973481:0:9477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:9477:1876178898024064:0@lo:253: 00000100:00100000:0.0:1789263686.973523:0:9477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263686.973561:0:9477:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd986325000 going to sleep for 11 seconds 00000100:00100000:2.0:1789263686.973613:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898024064 00000100:00100000:2.0:1789263686.973618:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898024064 00000100:00100000:3.0:1789263686.973717:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789263686.973726:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd991566850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+17:9477:x1876178898024064:12345-0@lo:253: 20000000:01000000:3.0:1789263686.973765:0:6482:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1789263686.973789:0:6482:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789263686.978882:0:6482:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789263686.978899:0:6482:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1789263686.979130:0:6503:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789263686.979134:0:6503:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789263686.979153:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dd990432e00/0xce1582440fb1d7f3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263686.979172:0:6503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd990433e00/0xce1582440fb1d6b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d6aa expref: 17 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263686.979181:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd991566850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+17:9477:x1876178898024064:12345-0@lo:253: Request processed in 5452us (5653us total) trans 0 rc 0/0 00010000:00010000:0.0:1789263686.979184:0:6503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd9813fda00/0xce1582440fb1d705 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d6fe expref: 17 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263686.979197:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dd990432e00/0xce1582440fb1d7f3 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263686.979198:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1789263686.979220:0:9477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66a76ccf-c64c-4b18-8369-a2861ec3956c:9477:1876178898024064:0@lo:253: 10000000:01000000:1.0:1789263686.979236:0:9477:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00010000:00010000:0.0:1789263686.979238:0:6503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd9813fda00/0xce1582440fb1d705 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce1582440fb1d6fe expref: 16 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789263686.979241:0:9477:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789263686.979251:0:9477:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789263686.979252:0:9477:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00010000:00010000:0.0:1789263686.979255:0:6503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dd9813fda00/0xce1582440fb1d705 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce1582440fb1d6fe expref: 16 pid: 6481 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789263686.979269:0:9477:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789263686.979272:0:9477:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789263686.979275:0:9477:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789263686.979277:0:9477:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789263686.979279:0:9477:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789263686.979280:0:9477:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789263686.979282:0:9477:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789263686.979283:0:9477:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1789263686.979286:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa5180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6503:1876178898024192:0@lo:104: 00000020:02000000:1.0:1789263686.979299:0:9477:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1789263686.979324:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789263686.979371:0:6503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd990433e00/0xce1582440fb1d6b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce1582440fb1d6aa expref: 16 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263686.979388:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898024192 00010000:00010000:0.0:1789263686.979391:0:6503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dd990433e00/0xce1582440fb1d6b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce1582440fb1d6aa expref: 16 pid: 6481 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263686.979401:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa4700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6503:1876178898024320:0@lo:104: 00000100:00100000:2.0:1789263686.979407:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898024192 00000100:00100000:0.0:1789263686.979436:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263686.979455:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898024320 00000100:00100000:2.0:1789263686.979460:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898024320 00000100:00100000:0.0:1789263686.979464:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9863253c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789263686.979481:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789263686.979492:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaa4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:66a76ccf-c64c-4b18-8369-a2861ec3956c+4:6503:x1876178898024192:12345-0@lo:104: 00000100:00100000:0.0:1789263686.979495:0:9488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1789263686.979505:0:6471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff9dd981683400/0xce1582440fb1d6fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1d705 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263686.979510:0:9488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaa5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:66a76ccf-c64c-4b18-8369-a2861ec3956c+4:6503:x1876178898024320:12345-0@lo:104: 00010000:00010000:0.0:1789263686.979524:0:9488:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff9dd9813fd400/0xce1582440fb1d6aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1d6b1 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263686.979575:0:6471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789263686.979581:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaa4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:66a76ccf-c64c-4b18-8369-a2861ec3956c+4:6503:x1876178898024192:12345-0@lo:104: Request processed in 92us (257us total) trans 0 rc 0/0 00010000:00010000:0.0:1789263686.979582:0:9488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789263686.979592:0:9488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaa5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:66a76ccf-c64c-4b18-8369-a2861ec3956c+4:6503:x1876178898024320:12345-0@lo:104: Request processed in 87us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263686.979593:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789263686.979603:0:9488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1789263686.979615:0:6475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789263686.979621:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd981683400/0xce1582440fb1d6fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1d705 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263686.979630:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981683400 already unused, calling callback (ffffffffc12b1c20) 10000000:00010000:2.0:1789263686.979634:0:6475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd981683400/0xce1582440fb1d6fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xce1582440fb1d705 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263686.979642:0:6475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd981683400/0xce1582440fb1d6fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xce1582440fb1d705 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789263686.979650:0:6475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd981683400/0xce1582440fb1d6fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xce1582440fb1d705 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263686.979657:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa5180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6503:1876178898024192:0@lo:104: 10000000:01000000:2.0:1789263686.979658:0:6475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:3.0:1789263686.979673:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa4700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6503:1876178898024320:0@lo:104: 00010000:00010000:2.0:1789263686.979689:0:6475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff9dd981683400/0xce1582440fb1d6fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d705 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263686.979692:0:6503:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dd990432e00/0xce1582440fb1d7f3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263686.979711:0:6475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789263686.979728:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd981683400/0xce1582440fb1d6fe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d705 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263686.979735:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd981683400/0xce1582440fb1d6fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d705 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263686.979741:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:66a76ccf-c64c-4b18-8369-a2861ec3956c:3620:1876178898024448:0@lo:103: 00010000:00010000:2.0:1789263686.979749:0:6475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789263686.979754:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd9813fd400/0xce1582440fb1d6aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1d6b1 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263686.979761:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9813fd400 already unused, calling callback (ffffffffc12b1c20) 10000000:00010000:2.0:1789263686.979764:0:6475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd9813fd400/0xce1582440fb1d6aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xce1582440fb1d6b1 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263686.979772:0:6475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd9813fd400/0xce1582440fb1d6aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xce1582440fb1d6b1 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263686.979779:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:2.0:1789263686.979785:0:6475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd9813fd400/0xce1582440fb1d6aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xce1582440fb1d6b1 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789263686.979791:0:6475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789263686.979812:0:6475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff9dd9813fd400/0xce1582440fb1d6aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d6b1 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263686.979818:0:6475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789263686.979821:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898024448 00000100:00100000:0.0:1789263686.979826:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898024448 00010000:00010000:2.0:1789263686.979828:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd9813fd400/0xce1582440fb1d6aa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d6b1 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263686.979837:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd9813fd400/0xce1582440fb1d6aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d6b1 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263686.979845:0:6473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd9813fda00/0xce1582440fb1d705 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1d6fe expref: 17 pid: 6481 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263686.979846:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:66a76ccf-c64c-4b18-8369-a2861ec3956c:3621:1876178898024576:0@lo:103: 00010000:00010000:2.0:1789263686.979869:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789263686.979873:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789263686.979876:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00010000:00010000:2.0:1789263686.979877:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789263686.979884:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263686.979886:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd987240450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a76ccf-c64c-4b18-8369-a2861ec3956c+17:3620:x1876178898024448:12345-0@lo:103: 00010000:00010000:2.0:1789263686.979887:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263686.979897:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789263686.979901:0:6473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd9813fda00/0xce1582440fb1d705 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1d6fe expref: 17 pid: 6481 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263686.979908:0:6473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd9813fda00/0xce1582440fb1d705 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce1582440fb1d6fe expref: 17 pid: 6481 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263686.979924:0:7428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898024576 00010000:00010000:0.0:1789263686.979929:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd9813fda00/0xce1582440fb1d705 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce1582440fb1d6fe expref: 17 pid: 6481 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263686.979930:0:7428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898024576 00010000:00010000:0.0:1789263686.979943:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789263686.979949:0:7428:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd990433e00/0xce1582440fb1d6b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1d6aa expref: 17 pid: 6481 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263686.979971:0:7428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789263686.979976:0:7428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88397ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a76ccf-c64c-4b18-8369-a2861ec3956c+17:3621:x1876178898024576:12345-0@lo:103: 00010000:00010000:3.0:1789263686.979988:0:7428:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789263686.979989:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd987240450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a76ccf-c64c-4b18-8369-a2861ec3956c+17:3620:x1876178898024448:12345-0@lo:103: Request processed in 104us (213us total) trans 0 rc 0/0 00010000:00010000:3.0:1789263686.979994:0:7428:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd990433e00/0xce1582440fb1d6b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1d6aa expref: 17 pid: 6481 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263686.980000:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:3.0:1789263686.980009:0:7428:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd990433e00/0xce1582440fb1d6b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce1582440fb1d6aa expref: 17 pid: 6481 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263686.980019:0:7428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd990433e00/0xce1582440fb1d6b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce1582440fb1d6aa expref: 16 pid: 6481 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263686.980021:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:66a76ccf-c64c-4b18-8369-a2861ec3956c:3620:1876178898024448:0@lo:103: 00010000:00010000:3.0:1789263686.980034:0:7428:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dd990432e00/0xce1582440fb1d7f3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263686.980044:0:7428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd990432e00/0xce1582440fb1d7f3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789263686.980056:0:7428:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001475076s 00010000:00010000:3.0:1789263686.980060:0:7428:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd990432e00/0xce1582440fb1d7f3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263686.980067:0:7428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd990432e00/0xce1582440fb1d7f3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263686.980090:0:7428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dd990432e00/0xce1582440fb1d7f3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263686.980096:0:7428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dd990432e00/0xce1582440fb1d7f3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263686.980100:0:7428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd990432e00 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:3.0:1789263686.980104:0:7428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dd990432e00/0xce1582440fb1d7f3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263686.980114:0:7428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dd990432e00/0xce1582440fb1d7f3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263686.980126:0:7428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dd990432e00/0xce1582440fb1d7f3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263686.980134:0:6503:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dd990432e00/0xce1582440fb1d7f3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263686.980135:0:7428:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789263686.980143:0:6503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dd990432e00/0xce1582440fb1d7f3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263686.980147:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd990432e00/0xce1582440fb1d7f3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263686.980169:0:7428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88397ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a76ccf-c64c-4b18-8369-a2861ec3956c+15:3621:x1876178898024576:12345-0@lo:103: Request processed in 191us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263686.980176:0:7428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789263686.980202:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:66a76ccf-c64c-4b18-8369-a2861ec3956c:3621:1876178898024576:0@lo:103: 00080000:10000000:1.0:1789263686.982880:0:9477:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1789263686.983037:0:9477:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1789263686.983239:0:9477:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1789263686.983398:0:9477:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1789263686.984301:0:9477:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1789263686.984493:0:9477:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:0.0:1789263686.985314:0:9477:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1789263686.989565:0:9477:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1789263686.989574:0:9477:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1789263686.989612:0:9477:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789263686.989668:0:9477:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.120@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789263686.989702:0:9477:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1789263686.989721:0:9477:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1789263686.990682:0:9477:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789263686.990925:0:9477:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1789263687.085372:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789263687.365769:0:9550:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789263687.365972:0:9550:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789263688.110021:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789263688.365128:0:6484:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789263688.365136:0:6484:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9dd9c1b57000 from 39 10000000:01000000:2.0:1789263688.365142:0:6484:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789263688.365182:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23600/0xce1582440fb1d7fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263688.365194:0:6484:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23600/0xce1582440fb1d7fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263688.365204:0:6484:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23600/0xce1582440fb1d7fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263688.365224:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaadc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898024704:0@lo:101: 00000100:00100000:2.0:1789263688.365293:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263688.365343:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9bb778f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789263688.365383:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898024704 00000100:00100000:3.0:1789263688.365391:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898024704 00000100:00100000:3.0:1789263688.365448:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789263688.365460:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd991567c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+15:6484:x1876178898024704:12345-0@lo:101: 00010000:00010000:3.0:1789263688.365475:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263688.365489:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd981531600/0xce1582440fb1d801 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1d7fa expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263688.365508:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd981531600/0xce1582440fb1d801 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1d7fa expref: 16 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263688.365518:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd981531600/0xce1582440fb1d801 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d7fa expref: 16 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263688.365528:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981531600, rc 0) 00000100:00100000:3.0:1789263688.365582:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd991567c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+16:6484:x1876178898024704:12345-0@lo:101: Request processed in 125us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263688.365589:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789263688.365882:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaadc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898024704:0@lo:101: 00010000:00010000:1.0:1789263688.365899:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23600/0xce1582440fb1d7fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d801 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263688.365909:0:6484:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23600/0xce1582440fb1d7fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1d801 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263688.365970:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883968700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898024832:0@lo:501: 00000100:00100000:1.0:1789263688.365997:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263688.366022:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd882684240 going to sleep for 11 seconds 00000100:00100000:3.0:1789263688.366070:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898024832 00000100:00100000:3.0:1789263688.366207:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898024832 00000100:00100000:3.0:1789263688.366244:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789263688.366262:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd991564050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+16:6484:x1876178898024832:12345-0@lo:501: 00000100:00100000:3.0:1789263688.366421:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd991564050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+16:6484:x1876178898024832:12345-0@lo:501: Request processed in 170us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263688.366429:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789263688.366496:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883968700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898024832:0@lo:501: 00000100:00100000:1.0:1789263688.366525:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883968700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898024960:0@lo:503: 00000100:00100000:1.0:1789263688.366575:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263688.366603:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd882684240 going to sleep for 11 seconds 00000100:00100000:2.0:1789263688.366616:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898024960 00000100:00100000:2.0:1789263688.366621:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898024960 00000100:00100000:2.0:1789263688.366650:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789263688.366658:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd991564850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+16:6484:x1876178898024960:12345-0@lo:503: 00000100:00100000:2.0:1789263688.366741:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd991564850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+16:6484:x1876178898024960:12345-0@lo:503: Request processed in 83us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263688.366754:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789263688.366767:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883968700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898024960:0@lo:503: 00000100:00100000:3.0:1789263688.367070:0:9670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:9670:1876178898025088:0@lo:502: 00000100:00100000:3.0:1789263688.367176:0:9670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263688.367212:0:9670:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9862b6a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789263688.367225:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898025088 00000100:00100000:2.0:1789263688.367231:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898025088 00000100:00100000:2.0:1789263688.367348:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1789263688.367359:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd991564c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+16:9670:x1876178898025088:12345-0@lo:502: 00000100:00100000:2.0:1789263688.367593:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd991564c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+16:9670:x1876178898025088:12345-0@lo:502: Request processed in 236us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263688.367600:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789263688.367995:0:9670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:9670:1876178898025088:0@lo:502: 00000100:00100000:1.0:1789263688.368048:0:9670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883968700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:9670:1876178898025216:0@lo:502: 00000100:00100000:1.0:1789263688.368124:0:9670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263688.368156:0:9670:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd882684240 going to sleep for 11 seconds 00000100:00100000:2.0:1789263688.368291:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898025216 00000100:00100000:2.0:1789263688.368296:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898025216 00000100:00100000:2.0:1789263688.368332:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1789263688.368340:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd991567850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+16:9670:x1876178898025216:12345-0@lo:502: 00000100:00100000:2.0:1789263688.368417:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd991567850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+16:9670:x1876178898025216:12345-0@lo:502: Request processed in 78us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263688.368426:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1789263688.368443:0:9670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883968700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:9670:1876178898025216:0@lo:502: 00000040:00080000:1.0:1789263688.368468:0:9670:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1789263688.368561:0:6484:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1789263688.368644:0:6484:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789263688.368652:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23600/0xce1582440fb1d7fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d801 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263688.368662:0:6484:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23600/0xce1582440fb1d7fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d801 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789263688.368670:0:6484:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1789263688.368673:0:6484:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1789263688.368675:0:6484:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789263688.368695:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22200/0xce1582440fb1d808 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263688.368712:0:6484:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22200/0xce1582440fb1d808 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263688.368721:0:6484:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22200/0xce1582440fb1d808 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263688.368734:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaaf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898025344:0@lo:101: 00000100:00100000:2.0:1789263688.368759:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263688.368780:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd98de43a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789263688.369782:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898025344 00000100:00100000:3.0:1789263688.369788:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898025344 00000100:00100000:3.0:1789263688.369821:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789263688.369829:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd991565050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+16:6484:x1876178898025344:12345-0@lo:101: 00010000:00010000:3.0:1789263688.369839:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263688.369851:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd981530200/0xce1582440fb1d80f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1d808 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263688.369871:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd981530200/0xce1582440fb1d80f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1d808 expref: 17 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263688.369882:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd981530200/0xce1582440fb1d80f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d808 expref: 17 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263688.369891:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981530200, rc 0) 00000100:00100000:3.0:1789263688.369931:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd991565050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+17:6484:x1876178898025344:12345-0@lo:101: Request processed in 103us (1170us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263688.369938:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789263688.369944:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaaf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898025344:0@lo:101: 00010000:00010000:2.0:1789263688.369958:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22200/0xce1582440fb1d808 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d80f expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263688.369972:0:6484:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22200/0xce1582440fb1d808 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1d80f expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263688.370022:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaaf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898025472:0@lo:501: 00000100:00100000:2.0:1789263688.370047:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263688.370092:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd98de43a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789263688.370147:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898025472 00000100:00100000:3.0:1789263688.370152:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898025472 00000100:00100000:3.0:1789263688.370181:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789263688.370190:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd991566450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+17:6484:x1876178898025472:12345-0@lo:501: 00000100:00100000:3.0:1789263688.370312:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd991566450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+17:6484:x1876178898025472:12345-0@lo:501: Request processed in 124us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263688.370319:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789263688.370351:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaaf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898025472:0@lo:501: 00000100:00100000:2.0:1789263688.370376:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaaf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898025600:0@lo:503: 00000100:00100000:2.0:1789263688.370412:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263688.370434:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd98de43a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789263688.370454:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898025600 00000100:00100000:3.0:1789263688.370460:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898025600 00000100:00100000:3.0:1789263688.370487:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789263688.370494:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd988441050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+17:6484:x1876178898025600:12345-0@lo:503: 00000100:00100000:3.0:1789263688.370569:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd988441050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+17:6484:x1876178898025600:12345-0@lo:503: Request processed in 75us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263688.370576:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789263688.370613:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaaf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898025600:0@lo:503: 00000100:00100000:2.0:1789263688.370964:0:9671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaaf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:9671:1876178898025728:0@lo:502: 00000100:00100000:2.0:1789263688.371002:0:9671:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263688.371023:0:9671:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd98de439c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789263688.373033:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898025728 00000100:00100000:3.0:1789263688.373043:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898025728 00000100:00100000:3.0:1789263688.373110:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789263688.373122:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd988442050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+17:9671:x1876178898025728:12345-0@lo:502: 00000100:00100000:3.0:1789263688.373246:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd988442050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+17:9671:x1876178898025728:12345-0@lo:502: Request processed in 128us (2244us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263688.373269:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789263688.373281:0:9671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaaf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:9671:1876178898025728:0@lo:502: 00000020:01000000:2.0:1789263688.373327:0:9671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789263688.373336:0:9671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263688.373338:0:9671:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789263688.373344:0:9671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789263688.373346:0:9671:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789263688.373368:0:9671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaaf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:9671:1876178898025856:0@lo:502: 00000100:00100000:2.0:1789263688.373405:0:9671:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263688.373436:0:9671:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9c09d3cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789263688.373444:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898025856 00000100:00100000:3.0:1789263688.373449:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898025856 00000100:00100000:3.0:1789263688.373481:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789263688.373489:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd988442c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+17:9671:x1876178898025856:12345-0@lo:502: 00000100:00100000:3.0:1789263688.373554:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd988442c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+17:9671:x1876178898025856:12345-0@lo:502: Request processed in 64us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263688.373564:0:9671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaaf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:9671:1876178898025856:0@lo:502: 00000100:00100000:3.0:1789263688.373580:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000020:01000000:2.0:1789263688.373584:0:9671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789263688.373589:0:9671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263688.373592:0:9671:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789263688.373596:0:9671:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1789263688.373697:0:6484:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1789263688.373719:0:6484:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789263688.373728:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22200/0xce1582440fb1d808 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d80f expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263688.373739:0:6484:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22200/0xce1582440fb1d808 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d80f expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789263688.373749:0:6484:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789263688.373752:0:6484:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9dd9c0889800 from 39 10000000:01000000:3.0:1789263688.373755:0:6484:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789263688.373777:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd981531a00/0xce1582440fb1d816 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263688.373799:0:6484:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd981531a00/0xce1582440fb1d816 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263688.373808:0:6484:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd981531a00/0xce1582440fb1d816 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263688.373822:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898025984:0@lo:101: 00000100:00100000:3.0:1789263688.373848:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263688.373868:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9908ecb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789263688.373881:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898025984 00000100:00100000:3.0:1789263688.373885:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898025984 00000100:00100000:3.0:1789263688.373916:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789263688.373925:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a07450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+17:6484:x1876178898025984:12345-0@lo:101: 00010000:00010000:3.0:1789263688.373934:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263688.373953:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd981530c00/0xce1582440fb1d81d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1d816 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263688.373973:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd981530c00/0xce1582440fb1d81d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1d816 expref: 18 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263688.373983:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd981530c00/0xce1582440fb1d81d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d816 expref: 18 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263688.373991:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981530c00, rc 0) 00000100:00100000:3.0:1789263688.374025:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a07450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+18:6484:x1876178898025984:12345-0@lo:101: Request processed in 102us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263688.374032:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789263688.374054:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898025984:0@lo:101: 00010000:00010000:0.0:1789263688.374339:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd981531a00/0xce1582440fb1d816 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d81d expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263688.374352:0:6484:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd981531a00/0xce1582440fb1d816 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1d81d expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263688.374420:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898026112:0@lo:501: 00000100:00100000:0.0:1789263688.374452:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263688.374482:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd881f31b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789263688.375137:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898026112 00000100:00100000:2.0:1789263688.375144:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898026112 00000100:00100000:2.0:1789263688.375186:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789263688.375195:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a07050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+18:6484:x1876178898026112:12345-0@lo:501: 00000100:00100000:2.0:1789263688.375664:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a07050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+18:6484:x1876178898026112:12345-0@lo:501: Request processed in 470us (1212us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263688.375674:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789263688.375718:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898026112:0@lo:501: 00000100:00100000:2.0:1789263688.375754:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaaf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898026240:0@lo:503: 00000100:00100000:2.0:1789263688.375793:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263688.375823:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9c09d39c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789263688.375838:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898026240 00000100:00100000:2.0:1789263688.375841:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898026240 00000100:00100000:2.0:1789263688.375878:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789263688.375887:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a05850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+18:6484:x1876178898026240:12345-0@lo:503: 00000100:00100000:2.0:1789263688.375959:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a05850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+18:6484:x1876178898026240:12345-0@lo:503: Request processed in 73us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263688.375966:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789263688.376000:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaaf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898026240:0@lo:503: 00000100:00100000:3.0:1789263688.376276:0:9673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:9673:1876178898026368:0@lo:502: 00000100:00100000:3.0:1789263688.376327:0:9673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263688.376356:0:9673:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9908ecb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789263688.376391:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898026368 00000100:00100000:2.0:1789263688.376396:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898026368 00000100:00100000:2.0:1789263688.376424:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789263688.376432:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a07850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+18:9673:x1876178898026368:12345-0@lo:502: 00000100:00100000:2.0:1789263688.376504:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a07850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+18:9673:x1876178898026368:12345-0@lo:502: Request processed in 72us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263688.376511:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789263688.376517:0:9673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:9673:1876178898026368:0@lo:502: 00000100:00100000:3.0:1789263688.376569:0:9673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:9673:1876178898026496:0@lo:502: 00000100:00100000:3.0:1789263688.376606:0:9673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263688.376622:0:9673:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9c0be3900 going to sleep for 11 seconds 00000100:00100000:2.0:1789263688.376626:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898026496 00000100:00100000:2.0:1789263688.376631:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898026496 00000100:00100000:2.0:1789263688.376656:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789263688.376663:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a04050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+18:9673:x1876178898026496:12345-0@lo:502: 00000100:00100000:2.0:1789263688.376731:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a04050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+18:9673:x1876178898026496:12345-0@lo:502: Request processed in 68us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263688.376739:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789263688.376742:0:9673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:9673:1876178898026496:0@lo:502: 00000040:00080000:3.0:1789263688.376769:0:9673:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1789263688.376894:0:6484:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1789263688.376913:0:6484:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789263688.376921:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd981531a00/0xce1582440fb1d816 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d81d expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263688.376931:0:6484:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd981531a00/0xce1582440fb1d816 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d81d expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789263688.376940:0:6484:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789263688.376942:0:6484:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9dd9c0889800 from 6 10000000:01000000:0.0:1789263688.376945:0:6484:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789263688.376969:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd990432000/0xce1582440fb1d824 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263688.376977:0:6484:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd990432000/0xce1582440fb1d824 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263688.376997:0:6484:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd990432000/0xce1582440fb1d824 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263688.377010:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898026624:0@lo:101: 00000100:00100000:0.0:1789263688.377039:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263688.377058:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd881f31b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789263688.377073:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898026624 00000100:00100000:2.0:1789263688.377102:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898026624 00000100:00100000:2.0:1789263688.377132:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1789263688.377141:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a04850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+18:6484:x1876178898026624:12345-0@lo:101: 00010000:00010000:2.0:1789263688.377151:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263688.377166:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd9bfa23c00/0xce1582440fb1d82b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1d824 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263688.377186:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd9bfa23c00/0xce1582440fb1d82b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1d824 expref: 19 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263688.377204:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd9bfa23c00/0xce1582440fb1d82b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d824 expref: 19 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263688.377213:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bfa23c00, rc 0) 00000100:00100000:2.0:1789263688.377262:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a04850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+19:6484:x1876178898026624:12345-0@lo:101: Request processed in 123us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263688.377269:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789263688.377318:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898026624:0@lo:101: 00010000:00010000:0.0:1789263688.377330:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd990432000/0xce1582440fb1d824 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d82b expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263688.377339:0:6484:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd990432000/0xce1582440fb1d824 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1d82b expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263688.377382:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898026752:0@lo:256: 00000100:00100000:0.0:1789263688.377410:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263688.377438:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd881f31b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789263688.377899:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898026752 00000100:00100000:2.0:1789263688.377904:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898026752 00000100:00100000:2.0:1789263688.378036:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789263688.378045:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a06850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+19:6484:x1876178898026752:12345-0@lo:256: 20000000:01000000:2.0:1789263688.378060:0:6481:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789263688.378074:0:6481:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789263688.378094:0:6481:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1789263688.378177:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a06850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+19:6484:x1876178898026752:12345-0@lo:256: Request processed in 133us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263688.378186:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789263688.378200:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898026752:0@lo:256: 10000000:01000000:0.0:1789263688.378259:0:6484:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789263688.378265:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd990432000/0xce1582440fb1d824 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d82b expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263688.378274:0:6484:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd990432000/0xce1582440fb1d824 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d82b expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789263688.378282:0:6484:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1789263688.378284:0:6484:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:0.0:1789263688.378286:0:6484:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1789263688.378306:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd990432400/0xce1582440fb1d832 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263688.378314:0:6484:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd990432400/0xce1582440fb1d832 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263688.378323:0:6484:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd990432400/0xce1582440fb1d832 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263688.378349:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898026880:0@lo:101: 00000100:00100000:0.0:1789263688.378378:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263688.378732:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898026880 00000100:00100000:3.0:1789263688.378738:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898026880 00000100:00100000:0.0:1789263688.378744:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd881f31b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789263688.378781:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789263688.378788:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a04450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+19:6484:x1876178898026880:12345-0@lo:101: 00010000:00010000:2.0:1789263688.378796:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263688.378805:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd9bfa22c00/0xce1582440fb1d839 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1d832 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263688.378821:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd9bfa22c00/0xce1582440fb1d839 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1d832 expref: 20 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263688.378830:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd9bfa22c00/0xce1582440fb1d839 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d832 expref: 20 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263688.378842:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bfa22c00, rc 0) 00000100:00100000:2.0:1789263688.378874:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a04450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+20:6484:x1876178898026880:12345-0@lo:101: Request processed in 87us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263688.378881:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789263688.378904:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898026880:0@lo:101: 00010000:00010000:0.0:1789263688.378916:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd990432400/0xce1582440fb1d832 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d839 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263688.378922:0:6484:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd990432400/0xce1582440fb1d832 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1d839 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263688.378959:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898027008:0@lo:501: 00000100:00100000:0.0:1789263688.378980:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263688.378999:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd881f31b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789263688.379000:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898027008 00000100:00100000:2.0:1789263688.379006:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898027008 00000100:00100000:2.0:1789263688.379038:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789263688.379046:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a07c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+20:6484:x1876178898027008:12345-0@lo:501: 00000100:00100000:2.0:1789263688.379179:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a07c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+20:6484:x1876178898027008:12345-0@lo:501: Request processed in 133us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263688.379187:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789263688.379194:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898027008:0@lo:501: 00000100:00100000:0.0:1789263688.379223:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898027136:0@lo:503: 00000100:00100000:0.0:1789263688.379331:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263688.379354:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd881f31b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789263688.379467:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898027136 00000100:00100000:2.0:1789263688.379472:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898027136 00000100:00100000:2.0:1789263688.379505:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789263688.379513:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a05c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+20:6484:x1876178898027136:12345-0@lo:503: 00000100:00100000:2.0:1789263688.379592:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a05c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+20:6484:x1876178898027136:12345-0@lo:503: Request processed in 81us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263688.379601:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789263688.379621:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898027136:0@lo:503: 00000100:00100000:0.0:1789263688.380364:0:9674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:9674:1876178898027264:0@lo:502: 00000100:00100000:0.0:1789263688.380405:0:9674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263688.380441:0:9674:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd881f31840 going to sleep for 11 seconds 00000100:00100000:2.0:1789263688.380465:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898027264 00000100:00100000:2.0:1789263688.380471:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898027264 00000100:00100000:2.0:1789263688.380506:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789263688.380513:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a04c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+20:9674:x1876178898027264:12345-0@lo:502: 00000100:00100000:2.0:1789263688.380660:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a04c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+20:9674:x1876178898027264:12345-0@lo:502: Request processed in 146us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263688.380668:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789263688.380763:0:9674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:9674:1876178898027264:0@lo:502: 00000020:01000000:0.0:1789263688.380792:0:9674:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789263688.380799:0:9674:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1789263688.380809:0:9674:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789263688.380811:0:9674:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1789263688.380888:0:9674:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789263688.380893:0:9674:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.120@tcp to nid 0x20000c0a8cb78 (192.168.203.120@tcp) 00000020:01000000:0.0:1789263688.380975:0:9674:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1789263688.380978:0:9674:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789263688.380990:0:9674:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9dd9c09c3370) 00000020:00000080:0.0:1789263688.381012:0:9674:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:0.0:1789263688.381017:0:9674:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789263688.381119:0:9674:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:0.0:1789263688.381126:0:9674:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:0.0:1789263688.381135:0:9674:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xce1582440fb1d847 00010000:00080000:0.0:1789263688.381168:0:9674:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dd882a36800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.120@tcp at head 00010000:00010000:0.0:1789263688.381553:0:9674:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:0.0:1789263688.381700:0:9674:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1789263688.381712:0:9674:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1789263688.381885:0:9674:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789263688.382068:0:9674:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789263688.382207:0:9674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1789263688.382325:0:9674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1789263688.383696:0:9677:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789263688.383701:0:9677:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1789263688.384416:0:9674:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789263688.384427:0:9674:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789263688.384465:0:9674:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789263688.384495:0:9674:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xce1582440fb1d84e 00000100:00080000:1.0:1789263688.384503:0:9674:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789263688.384507:0:9674:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9dd882a36800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:1.0:1789263688.384533:0:9674:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd883968700 x1876178898027392/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789263688.384576:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883968700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1876178898027392:0@lo:8: 00000100:00100000:2.0:1789263688.384634:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263688.384687:0:8511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898027392 00000100:00100000:3.0:1789263688.384695:0:8511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898027392 00000100:00080000:1.0:1789263688.384697:0:9674:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:3.0:1789263688.384732:0:8511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789263688.384740:0:8511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3617:x1876178898027392:12345-0@lo:8: 00010000:00080000:3.0:1789263688.384770:0:8511:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 130 last 0 00000020:00000080:3.0:1789263688.384799:0:8511:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xce1582440fb1d855 00002000:00100000:3.0:1789263688.384813:0:8511:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9dd883897000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1789263688.384817:0:8511:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:3.0:1789263688.384821:0:8511:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1789263688.384826:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883968e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898027648:0@lo:400: 00000100:00100000:1.0:1789263688.384862:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00100000:3.0:1789263688.384873:0:8511:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1789263688.384885:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88396bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898028160:0@lo:400: 00000100:00100000:1.0:1789263688.384913:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263688.384943:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88396a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1876178898028672:0@lo:400: 00000100:00100000:0.0:1789263688.384944:0:8394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898028160 00000100:00100000:0.0:1789263688.384951:0:8394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898028160 00000100:00100000:1.0:1789263688.384981:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263688.384996:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789263688.385007:0:8394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883969f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1876178898028160:12345-0@lo:400: 00000100:00100000:1.0:1789263688.385018:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789263688.385028:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88396b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1876178898027520:0@lo:400: 00000100:00100000:1.0:1789263688.385070:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263688.385070:0:8394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883969f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1876178898028160:12345-0@lo:400: Request processed in 64us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263688.385098:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789263688.385118:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883968a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3619:1876178898028032:0@lo:400: 00000100:00080000:0.0:1789263688.385121:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789263688.385147:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:3.0:1789263688.385165:0:8511:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00100000:1.0:1789263688.385168:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88396ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3619:1876178898028544:0@lo:400: 00000100:00080000:3.0:1789263688.385190:0:8511:0:(import.c:65:import_set_state_nolock()) ffff9dd883896800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789263688.385190:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789263688.385214:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd88396bb80 x1876178898028160/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789263704 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789263688.385226:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88396bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898028160:0@lo:400: 00000100:00100000:1.0:1789263688.385266:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883969c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1876178898027776:0@lo:400: 00000100:00100000:1.0:1789263688.385296:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263688.385315:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88396aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898028288:0@lo:400: 00000100:00100000:1.0:1789263688.385336:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263688.385355:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789263688.385360:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88396b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1876178898027904:0@lo:400: 00000100:00100000:1.0:1789263688.385380:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263688.385392:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88396a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898028416:0@lo:400: 00000100:00100000:1.0:1789263688.385420:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263688.385444:0:8394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898028416 00000100:00100000:0.0:1789263688.385450:0:8394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898028416 00000100:00100000:1.0:1789263688.385465:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898028672 00000100:00100000:1.0:1789263688.385471:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898028672 00000100:00100000:0.0:1789263688.385481:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789263688.385494:0:8394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c08a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1876178898028416:12345-0@lo:400: 00000100:00100000:1.0:1789263688.385504:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898027520 00000100:00100000:1.0:1789263688.385508:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898027520 00000100:00100000:1.0:1789263688.385529:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898028032 00000100:00100000:0.0:1789263688.385530:0:8394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c08a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1876178898028416:12345-0@lo:400: Request processed in 38us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263688.385533:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898028032 00000100:00100000:0.0:1789263688.385538:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1789263688.385553:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789263688.385558:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789263688.385563:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898028544 00000100:00100000:3.0:1789263688.385564:0:8511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3617:x1876178898027392:12345-0@lo:8: Request processed in 821us (927us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263688.385567:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898028544 00000100:00100000:3.0:1789263688.385574:0:8511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1789263688.385586:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd88396a300 x1876178898028416/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789263704 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1789263688.385595:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd883968700 x1876178898027392/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789263698 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263688.385600:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88396a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898028416:0@lo:400: 00000100:00100000:1.0:1789263688.385601:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898027776 00000100:00100000:1.0:1789263688.385605:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898027776 00000100:00100000:2.0:1789263688.385610:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00100000:3.0:1789263688.385618:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898027648 00000100:00080000:2.0:1789263688.385618:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00100000:1.0:1789263688.385624:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898027904 00000100:00100000:3.0:1789263688.385625:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898027648 00000100:00080000:2.0:1789263688.385627:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00100000:1.0:1789263688.385628:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898027904 00000100:00080000:2.0:1789263688.385633:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1789263688.385634:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789263688.385636:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd882a36800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789263688.385648:0:3617:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789263688.385654:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883968700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1876178898027392:0@lo:8: 00000100:00100000:1.0:1789263688.385655:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789263688.385662:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88396b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1876178898028672:12345-0@lo:400: 00000100:00100000:3.0:1789263688.385667:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898028288 00000100:00100000:3.0:1789263688.385672:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898028288 00000004:00080000:2.0:1789263688.385686:0:9677:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1789263688.385696:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789263688.385706:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883969180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1876178898027648:12345-0@lo:400: 00000100:00100000:1.0:1789263688.385710:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88396b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1876178898028672:12345-0@lo:400: Request processed in 46us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263688.385719:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789263688.385733:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789263688.385742:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883968380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1876178898027520:12345-0@lo:400: 00000004:00080000:2.0:1789263688.385743:0:9677:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 130675665520ns, next at 0ns, rc = 0 00080000:00080000:2.0:1789263688.385751:0:9677:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1789263688.385752:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883969180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1876178898027648:12345-0@lo:400: Request processed in 46us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263688.385760:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789263688.385781:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883968380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1876178898027520:12345-0@lo:400: Request processed in 39us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263688.385782:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789263688.385792:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789263688.385797:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c08aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1876178898028288:12345-0@lo:400: 00000100:00100000:1.0:1789263688.385812:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789263688.385820:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883969500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1876178898028032:12345-0@lo:400: 00000100:00100000:3.0:1789263688.385854:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c08aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1876178898028288:12345-0@lo:400: Request processed in 60us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263688.385859:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883969500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1876178898028032:12345-0@lo:400: Request processed in 39us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263688.385866:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789263688.385871:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789263688.385887:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789263688.385893:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c08a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1876178898028544:12345-0@lo:400: 00000100:00100000:3.0:1789263688.385897:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789263688.385909:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c08a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1876178898027776:12345-0@lo:400: 00000100:00100000:1.0:1789263688.385924:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c08a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1876178898028544:12345-0@lo:400: Request processed in 31us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263688.385931:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789263688.385944:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789263688.385951:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c08a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1876178898027904:12345-0@lo:400: 00000100:00100000:3.0:1789263688.385977:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c08a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1876178898027776:12345-0@lo:400: Request processed in 69us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263688.385986:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789263688.385991:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c08a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1876178898027904:12345-0@lo:400: Request processed in 40us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263688.386004:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1789263688.386042:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd88396b800 x1876178898027520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263704 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789263688.386053:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88396b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1876178898027520:0@lo:400: 00010000:00080000:3.0:1789263688.386063:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd88396b100 x1876178898027904/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263704 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1789263688.386070:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd883968a80 x1876178898028032/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263704 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263688.386107:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88396b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1876178898027904:0@lo:400: 00000100:00100000:1.0:1789263688.386111:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883968a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3619:1876178898028032:0@lo:400: 00010000:00080000:3.0:1789263688.386129:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd883969c00 x1876178898027776/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263704 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1789263688.386133:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd88396ad80 x1876178898028544/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263704 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263688.386153:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883969c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1876178898027776:0@lo:400: 00000100:00100000:1.0:1789263688.386155:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88396ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3619:1876178898028544:0@lo:400: 00000100:00100000:3.0:1789263688.386178:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88396aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898028288:0@lo:400: 00000100:00100000:1.0:1789263688.386181:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883968e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898027648:0@lo:400: 00010000:00080000:1.0:1789263688.386200:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd88396a680 x1876178898028672/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263704 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789263688.386208:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88396a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1876178898028672:0@lo:400: 00000100:00100000:1.0:1789263688.386268:0:9678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9c08ab800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9678:1876178898028800:0@lo:700: 00000100:00100000:1.0:1789263688.386293:0:9678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263688.386320:0:9678:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd882684240 going to sleep for 11 seconds 00000100:00100000:2.0:1789263688.386369:0:8500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898028800 00000100:00100000:2.0:1789263688.386374:0:8500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898028800 00000020:01000000:1.0:1789263688.386374:0:9674:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789263688.386379:0:9674:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789263688.386381:0:9674:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1789263688.386384:0:9674:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789263688.386388:0:9674:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789263688.386389:0:9674:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789263688.386393:0:9674:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789263688.386401:0:9674:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789263688.386419:0:8500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1789263688.386420:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789263688.386424:0:9674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88396a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:9674:1876178898028928:0@lo:502: 00000100:00100000:2.0:1789263688.386428:0:8500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c08aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9678:x1876178898028800:12345-0@lo:700: 00000100:00100000:2.0:1789263688.386456:0:8500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaafb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8500:1876178898029056:0@lo:700: 00000100:00100000:1.0:1789263688.386470:0:9674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263688.386483:0:8500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263688.386505:0:8500:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9bb790000 going to sleep for 11 seconds 00000100:00100000:1.0:1789263688.386505:0:9674:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd882684900 going to sleep for 11 seconds 00000100:00100000:3.0:1789263688.386554:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898029056 00000100:00100000:3.0:1789263688.386559:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898029056 00000100:00100000:3.0:1789263688.386593:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789263688.386599:0:6495:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 2 min 2 max 256 00000100:00100000:3.0:1789263688.386604:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8500:x1876178898029056:12345-0@lo:700: 00000100:00100000:1.0:1789263688.386607:0:6495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0002' 00000100:00100000:3.0:1789263688.386694:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898028928 00000100:00100000:3.0:1789263688.386699:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898028928 00000100:00100000:3.0:1789263688.386739:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789263688.386750:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a05050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+20:9674:x1876178898028928:12345-0@lo:502: 00000100:00100000:3.0:1789263688.386867:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a05050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+20:9674:x1876178898028928:12345-0@lo:502: Request processed in 120us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263688.386875:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789263688.386879:0:9674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88396a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:9674:1876178898028928:0@lo:502: 00000020:01000000:1.0:1789263688.386907:0:9674:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789263688.386913:0:9674:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789263688.386914:0:9674:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789263688.386919:0:9674:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000020:01000000:2.0:1789263688.387000:0:6484:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:2.0:1789263688.387020:0:6484:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1789263688.387030:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd990432400/0xce1582440fb1d832 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d839 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263688.387052:0:6484:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd990432400/0xce1582440fb1d832 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d839 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789263688.387062:0:6484:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789263688.387065:0:6484:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9dd9896b8000 from 39 10000000:01000000:2.0:1789263688.387068:0:6484:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789263688.387115:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22a00/0xce1582440fb1d85c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263688.387124:0:6484:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22a00/0xce1582440fb1d85c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263688.387133:0:6484:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22a00/0xce1582440fb1d85c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263688.387145:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898029184:0@lo:101: 00000100:00100000:2.0:1789263688.387172:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263688.387204:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9bb7909c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789263688.387213:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898029184 00000100:00100000:3.0:1789263688.387219:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898029184 00000100:00100000:3.0:1789263688.387275:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789263688.387292:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a06050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+20:6484:x1876178898029184:12345-0@lo:101: 00010000:00010000:3.0:1789263688.387314:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263688.387328:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd981531200/0xce1582440fb1d863 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1d85c expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263688.387355:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd981531200/0xce1582440fb1d863 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1d85c expref: 21 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263688.387368:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd981531200/0xce1582440fb1d863 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d85c expref: 21 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263688.387376:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981531200, rc 0) 00000100:00100000:3.0:1789263688.387413:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a06050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+21:6484:x1876178898029184:12345-0@lo:101: Request processed in 123us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263688.387420:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789263688.387436:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898029184:0@lo:101: 00010000:00010000:2.0:1789263688.387452:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22a00/0xce1582440fb1d85c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d863 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263688.387462:0:6484:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22a00/0xce1582440fb1d85c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1d863 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263688.387510:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898029312:0@lo:501: 00000100:00100000:2.0:1789263688.387537:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263688.387568:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9bb7909c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789263688.387588:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898029312 00000100:00100000:3.0:1789263688.387594:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898029312 00000100:00100000:3.0:1789263688.387633:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789263688.387642:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a06c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+21:6484:x1876178898029312:12345-0@lo:501: 00000100:00100000:3.0:1789263688.387758:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a06c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+21:6484:x1876178898029312:12345-0@lo:501: Request processed in 117us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263688.387765:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789263688.387789:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898029312:0@lo:501: 00000100:00100000:2.0:1789263688.387816:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898029440:0@lo:503: 00000100:00100000:2.0:1789263688.387859:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263688.387883:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9bb7909c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789263688.387908:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898029440 00000100:00100000:0.0:1789263688.387914:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898029440 00000100:00100000:0.0:1789263688.387946:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789263688.387955:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a06450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+21:6484:x1876178898029440:12345-0@lo:503: 00000100:00100000:0.0:1789263688.388030:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a06450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+21:6484:x1876178898029440:12345-0@lo:503: Request processed in 76us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263688.388036:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789263688.388053:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898029440:0@lo:503: 00000100:00100000:0.0:1789263688.388287:0:9680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:9680:1876178898029568:0@lo:502: 00000100:00100000:0.0:1789263688.388328:0:9680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263688.388367:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898029568 00000100:00100000:0.0:1789263688.388370:0:9680:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd881f31240 going to sleep for 11 seconds 00000100:00100000:3.0:1789263688.388372:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898029568 00000004:00080000:2.0:1789263688.388391:0:7417:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:3.0:1789263688.388410:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789263688.388421:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a05450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+21:9680:x1876178898029568:12345-0@lo:502: 00000100:00100000:3.0:1789263688.388503:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a05450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+21:9680:x1876178898029568:12345-0@lo:502: Request processed in 84us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263688.388517:0:9680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:9680:1876178898029568:0@lo:502: 00000100:00100000:3.0:1789263688.388524:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789263688.388561:0:9680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:9680:1876178898029696:0@lo:502: 00000100:00100000:0.0:1789263688.388595:0:9680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263688.388612:0:9680:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd881f31240 going to sleep for 11 seconds 00000100:00100000:3.0:1789263688.388619:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898029696 00000100:00100000:3.0:1789263688.388625:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898029696 00000100:00100000:3.0:1789263688.388655:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789263688.388663:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+21:9680:x1876178898029696:12345-0@lo:502: 00000100:00100000:3.0:1789263688.388739:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+21:9680:x1876178898029696:12345-0@lo:502: Request processed in 76us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263688.388744:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789263688.388750:0:9680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:9680:1876178898029696:0@lo:502: 00000040:00080000:0.0:1789263688.388774:0:9680:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1789263688.388839:0:6484:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1789263688.388863:0:6484:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789263688.388869:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22a00/0xce1582440fb1d85c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d863 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263688.388878:0:6484:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22a00/0xce1582440fb1d85c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d863 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789263688.388886:0:6484:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789263688.388889:0:6484:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9dd9896b8000 from 6 10000000:01000000:2.0:1789263688.388891:0:6484:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789263688.388910:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23400/0xce1582440fb1d86a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263688.388917:0:6484:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23400/0xce1582440fb1d86a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263688.388926:0:6484:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23400/0xce1582440fb1d86a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263688.388938:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898029824:0@lo:101: 00000100:00100000:2.0:1789263688.388968:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263688.388994:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9bb7909c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789263688.388998:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898029824 00000100:00100000:3.0:1789263688.389005:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898029824 00000100:00100000:3.0:1789263688.389035:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789263688.389043:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+21:6484:x1876178898029824:12345-0@lo:101: 00010000:00010000:3.0:1789263688.389051:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263688.389063:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd981531000/0xce1582440fb1d871 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1d86a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263688.389118:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd981531000/0xce1582440fb1d871 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1d86a expref: 22 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263688.389129:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd981531000/0xce1582440fb1d871 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d86a expref: 22 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263688.389138:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981531000, rc 0) 00000100:00100000:3.0:1789263688.389169:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+22:6484:x1876178898029824:12345-0@lo:101: Request processed in 128us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263688.389175:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789263688.389188:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898029824:0@lo:101: 00010000:00010000:2.0:1789263688.389203:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23400/0xce1582440fb1d86a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d871 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263688.389212:0:6484:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23400/0xce1582440fb1d86a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1d871 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263688.389279:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898029952:0@lo:256: 00000100:00100000:2.0:1789263688.389329:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263688.389353:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898029952 00000100:00100000:3.0:1789263688.389359:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898029952 00000100:00100000:2.0:1789263688.389363:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9bb7909c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789263688.389392:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789263688.389398:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+22:6484:x1876178898029952:12345-0@lo:256: 20000000:01000000:3.0:1789263688.389409:0:6480:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789263688.389423:0:6480:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789263688.389425:0:6480:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1789263688.389515:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+22:6484:x1876178898029952:12345-0@lo:256: Request processed in 116us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263688.389524:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789263688.389533:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898029952:0@lo:256: 10000000:01000000:2.0:1789263688.389605:0:6484:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789263688.389611:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23400/0xce1582440fb1d86a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d871 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263688.389619:0:6484:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23400/0xce1582440fb1d86a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d871 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789263688.389626:0:6484:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789263688.389628:0:6484:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1789263688.389630:0:6484:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789263688.389648:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23800/0xce1582440fb1d878 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263688.389655:0:6484:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23800/0xce1582440fb1d878 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263688.389663:0:6484:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23800/0xce1582440fb1d878 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263688.389681:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898030080:0@lo:101: 00000100:00100000:2.0:1789263688.389708:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263688.389723:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9bb7909c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789263688.389732:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898030080 00000100:00100000:3.0:1789263688.389738:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898030080 00000100:00100000:3.0:1789263688.389767:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789263688.389775:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+22:6484:x1876178898030080:12345-0@lo:101: 00010000:00010000:3.0:1789263688.389781:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263688.389790:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd981530800/0xce1582440fb1d87f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1d878 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263688.389803:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd981530800/0xce1582440fb1d87f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1d878 expref: 23 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263688.389811:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd981530800/0xce1582440fb1d87f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d878 expref: 23 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263688.389817:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981530800, rc 0) 00000100:00100000:3.0:1789263688.389848:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+23:6484:x1876178898030080:12345-0@lo:101: Request processed in 75us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263688.389856:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789263688.389868:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898030080:0@lo:101: 00010000:00010000:2.0:1789263688.389882:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23800/0xce1582440fb1d878 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d87f expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263688.389890:0:6484:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23800/0xce1582440fb1d878 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1d87f expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263688.389935:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898030208:0@lo:501: 00000100:00100000:2.0:1789263688.389963:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263688.389977:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9bb7909c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789263688.389985:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898030208 00000100:00100000:3.0:1789263688.389990:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898030208 00000100:00100000:3.0:1789263688.390015:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789263688.390030:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+23:6484:x1876178898030208:12345-0@lo:501: 00000100:00100000:3.0:1789263688.390140:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+23:6484:x1876178898030208:12345-0@lo:501: Request processed in 111us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263688.390146:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789263688.390164:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898030208:0@lo:501: 00000100:00100000:2.0:1789263688.390192:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898030336:0@lo:503: 00000100:00100000:2.0:1789263688.390230:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263688.390262:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898030336 00000100:00100000:3.0:1789263688.390267:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898030336 00000100:00100000:2.0:1789263688.390267:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9bb7909c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789263688.390291:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789263688.390298:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+23:6484:x1876178898030336:12345-0@lo:503: 00000100:00100000:3.0:1789263688.390386:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+23:6484:x1876178898030336:12345-0@lo:503: Request processed in 87us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263688.390392:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789263688.390437:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898030336:0@lo:503: 00000100:00100000:3.0:1789263688.390792:0:9682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:9682:1876178898030464:0@lo:502: 00000100:00100000:3.0:1789263688.390827:0:9682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263688.390849:0:9682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9c0be3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789263688.390874:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898030464 00000100:00100000:0.0:1789263688.390880:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898030464 00000100:00100000:0.0:1789263688.390911:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789263688.390919:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+23:9682:x1876178898030464:12345-0@lo:502: 00000100:00100000:0.0:1789263688.391002:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+23:9682:x1876178898030464:12345-0@lo:502: Request processed in 84us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263688.391010:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789263688.391018:0:9682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:9682:1876178898030464:0@lo:502: 00000020:01000000:3.0:1789263688.391048:0:9682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789263688.391055:0:9682:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1789263688.391061:0:9682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789263688.391064:0:9682:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1789263688.391071:0:9682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789263688.391099:0:9682:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.120@tcp to nid 0x20000c0a8cb78 (192.168.203.120@tcp) 00000020:01000000:3.0:1789263688.391123:0:9682:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789263688.391127:0:9682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789263688.391141:0:9682:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9dd88389cd28) 00000020:00000080:3.0:1789263688.391157:0:9682:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:3.0:1789263688.391162:0:9682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789263688.391225:0:9682:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1789263688.391231:0:9682:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:3.0:1789263688.391241:0:9682:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xce1582440fb1d88d 00010000:00080000:3.0:1789263688.391288:0:9682:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dd9bf8ed800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.120@tcp at head 40000000:02000000:0.0:1789263688.391316:0:6494:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00010000:00010000:3.0:1789263688.391592:0:9682:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:3.0:1789263688.391726:0:9682:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1789263688.391738:0:9682:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789263688.391915:0:9682:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789263688.392049:0:9682:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789263688.392235:0:9682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1789263688.392358:0:9682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1789263688.392652:0:9683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789263688.392657:0:9683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1789263688.393104:0:9682:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789263688.393112:0:9682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789263688.393142:0:9682:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789263688.393165:0:9682:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xce1582440fb1d894 00000100:00080000:3.0:1789263688.393172:0:9682:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789263688.393177:0:9682:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9dd9bf8ed800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:3.0:1789263688.393209:0:9682:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd88397ca80 x1876178898030592/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789263688.393241:0:9682:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1789263688.393323:0:9682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789263688.393327:0:9682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789263688.393328:0:9682:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1789263688.393331:0:9682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789263688.393335:0:9682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789263688.393336:0:9682:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789263688.393339:0:9682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789263688.393341:0:9682:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789263688.393364:0:9682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:9682:1876178898030720:0@lo:502: 00000100:00100000:3.0:1789263688.393437:0:9682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263688.393469:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898030720 00000100:00100000:3.0:1789263688.393474:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898030720 00000100:00100000:3.0:1789263688.393507:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789263688.393514:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+23:9682:x1876178898030720:12345-0@lo:502: 00000100:00100000:3.0:1789263688.393599:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+23:9682:x1876178898030720:12345-0@lo:502: Request processed in 85us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263688.393604:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789263688.393651:0:9682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9c0be3600 going to sleep for 11 seconds 00000100:00100000:3.0:1789263688.393667:0:9682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:9682:1876178898030720:0@lo:502: 00000020:01000000:3.0:1789263688.393689:0:9682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789263688.393694:0:9682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789263688.393695:0:9682:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789263688.393698:0:9682:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000100:00100000:1.0:1789263688.393801:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1876178898030592:0@lo:8: 00000100:00100000:1.0:1789263688.393838:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263688.395523:0:8394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898030592 00000100:00100000:0.0:1789263688.395532:0:8394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898030592 00000100:00100000:0.0:1789263688.395573:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789263688.395580:0:8394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88396a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3617:x1876178898030592:12345-0@lo:8: 00010000:00080000:0.0:1789263688.395609:0:8394:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 130 last 0 00000020:00000080:0.0:1789263688.395732:0:8394:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xce1582440fb1d89b 00002000:00100000:0.0:1789263688.395748:0:8394:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9dd882a34800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1789263688.395752:0:8394:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1789263688.395755:0:8394:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789263688.395818:0:8394:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789263688.395841:0:8394:0:(import.c:65:import_set_state_nolock()) ffff9dd882a35800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789263688.395902:0:8394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88396a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3617:x1876178898030592:12345-0@lo:8: Request processed in 321us (2062us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263688.395910:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1789263688.395939:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd88397ca80 x1876178898030592/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789263698 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000020:01000000:0.0:1789263688.395942:0:6484:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 00000100:00100000:1.0:1789263688.395956:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789263688.395965:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1789263688.395972:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 10000000:01000000:0.0:1789263688.395974:0:6484:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00000100:00080000:1.0:1789263688.395978:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00010000:00010000:0.0:1789263688.395985:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23800/0xce1582440fb1d878 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d87f expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789263688.395997:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd9bf8ed800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00010000:00010000:0.0:1789263688.396011:0:6484:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23800/0xce1582440fb1d878 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d87f expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789263688.396022:0:6484:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789263688.396025:0:6484:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9dd9b7983370 from 1 00000004:00080000:1.0:1789263688.396026:0:3617:0:(osp_dev.c:1648:osp_import_event()) got connected 10000000:01000000:0.0:1789263688.396028:0:6484:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00000100:00100000:1.0:1789263688.396035:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1876178898030592:0@lo:8: 00000004:00080000:3.0:1789263688.396050:0:9683:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00010000:00010000:0.0:1789263688.396058:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd990433000/0xce1582440fb1d8a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263688.396068:0:6484:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd990433000/0xce1582440fb1d8a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263688.396109:0:6484:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd990433000/0xce1582440fb1d8a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263688.396127:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898030848:0@lo:101: 00000004:00080000:3.0:1789263688.396147:0:9683:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 130686068741ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789263688.396155:0:9683:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1789263688.396169:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263688.396202:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd881f31900 going to sleep for 11 seconds 00000100:00100000:0.0:1789263688.396221:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898030848 00000100:00100000:0.0:1789263688.396225:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898030848 00000100:00100000:0.0:1789263688.396271:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789263688.396281:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+23:6484:x1876178898030848:12345-0@lo:101: 00010000:00010000:0.0:1789263688.396290:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263688.396303:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd990432e00/0xce1582440fb1d8a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1d8a2 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263688.396326:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd990432e00/0xce1582440fb1d8a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1d8a2 expref: 24 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263688.396350:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd990432e00/0xce1582440fb1d8a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d8a2 expref: 24 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263688.396358:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd990432e00, rc 0) 00000100:00100000:0.0:1789263688.396383:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+24:6484:x1876178898030848:12345-0@lo:101: Request processed in 106us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263688.396387:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789263688.396414:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898030848:0@lo:101: 00010000:00010000:0.0:1789263688.396424:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd990433000/0xce1582440fb1d8a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d8a9 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263688.396430:0:6484:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd990433000/0xce1582440fb1d8a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1d8a9 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263688.396476:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898030976:0@lo:501: 00000100:00100000:0.0:1789263688.396509:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263688.396530:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd881f31900 going to sleep for 11 seconds 00000100:00100000:3.0:1789263688.396541:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898030976 00000100:00100000:3.0:1789263688.396547:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898030976 00000100:00100000:0.0:1789263688.396575:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8500:x1876178898029056:12345-0@lo:700: Request processed in 9974us (10091us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263688.396585:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789263688.396587:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789263688.396596:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+24:6484:x1876178898030976:12345-0@lo:501: 00010000:00080000:0.0:1789263688.396630:0:8500:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd9bfaafb80 x1876178898029056/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789263704 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263688.396643:0:8500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaafb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8500:1876178898029056:0@lo:700: 40000000:02000000:0.0:1789263688.396653:0:8500:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000100:00100000:3.0:1789263688.396671:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+24:6484:x1876178898030976:12345-0@lo:501: Request processed in 77us (161us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789263688.396678:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000004:00080000:2.0:1789263688.397886:0:6466:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:3.0:1789263688.400747:0:9684:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1789263688.400762:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789263688.400783:0:9684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9684:1876178898031232:0@lo:7: 00000100:00100000:2.0:1789263688.400783:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898031104:0@lo:13: 00000100:00100000:3.0:1789263688.400843:0:9684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263688.400843:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263688.400882:0:8511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898031232 00000100:00100000:3.0:1789263688.400888:0:8511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898031232 00000100:00100000:1.0:1789263688.400913:0:8512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898031104 00000100:00080000:2.0:1789263688.400919:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789263688.400934:0:8512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898031104 00000100:00100000:3.0:1789263688.400939:0:8511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789263688.400949:0:8511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88397e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:9684:x1876178898031232:12345-0@lo:7: 00000100:00100000:1.0:1789263688.401025:0:8512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789263688.401052:0:8512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3621:x1876178898031104:12345-0@lo:13: 00000100:00100000:2.0:1789263688.401116:0:9684:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9c0be3180 going to sleep for 11 seconds 00002000:00000024:1.0:1789263688.401180:0:8512:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3924074496 avail 3692552192 00000100:00100000:1.0:1789263688.401234:0:8512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3621:x1876178898031104:12345-0@lo:13: Request processed in 201us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263688.401261:0:8512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1789263688.401308:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd88397fb80 x1876178898031104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789263704 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789263688.401325:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898031104:0@lo:13: 00000100:00100000:0.0:1789263688.402431:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898030976:0@lo:501: 10000000:01000000:0.0:1789263688.402477:0:6484:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789263688.402487:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd990433000/0xce1582440fb1d8a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d8a9 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263688.402498:0:6484:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd990433000/0xce1582440fb1d8a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d8a9 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:1.0:1789263688.404326:0:9479:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1789263688.404335:0:9479:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00002000:00080000:0.0:1789263688.405842:0:8511:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1789263688.405849:0:8511:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1789263688.405867:0:8500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c08aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9678:x1876178898028800:12345-0@lo:700: Request processed in 19436us (19567us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263688.405880:0:8500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789263688.405905:0:8511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88397e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:9684:x1876178898031232:12345-0@lo:7: Request processed in 4953us (5058us total) trans 0 rc 0/0 00010000:00080000:1.0:1789263688.405906:0:9678:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd9c08ab800 x1876178898028800/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789263704 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263688.405919:0:8511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789263688.405939:0:9678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9c08ab800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9678:1876178898028800:0@lo:700: 00010000:00080000:0.0:1789263688.405979:0:9684:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd88397ea00 x1876178898031232/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789263704 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263688.405991:0:9684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9684:1876178898031232:0@lo:7: 00000004:00080000:0.0:1789263688.406001:0:9684:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1789263688.406033:0:9684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9684:1876178898031360:0@lo:5: 00000100:00100000:0.0:1789263688.406066:0:9684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263688.406140:0:8392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898031360 00000100:00100000:1.0:1789263688.406147:0:8392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898031360 00000100:00100000:0.0:1789263688.406156:0:9684:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd881f31780 going to sleep for 11 seconds 00000100:00100000:1.0:1789263688.406199:0:8392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789263688.406209:0:8392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaa6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:9684:x1876178898031360:12345-0@lo:5: 00002000:00080000:1.0:1789263688.406233:0:8392:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1789263688.406236:0:8392:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1789263688.406512:0:8392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaa6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9684:x1876178898031360:12345-0@lo:5: Request processed in 304us (444us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1789263688.406520:0:8392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1789263688.406596:0:9684:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd9bfaa5180 x1876178898031360/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789263704 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789263688.406608:0:9684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9684:1876178898031360:0@lo:5: 00000004:00080000:2.0:1789263688.406621:0:9684:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1789263688.406647:0:9684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaaf100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9684:1876178898031488:0@lo:700: 00000100:00100000:2.0:1789263688.406674:0:9684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263688.406699:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898031488 00000100:00100000:2.0:1789263688.406703:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898031488 00000100:00100000:2.0:1789263688.406729:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789263688.406736:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:9684:x1876178898031488:12345-0@lo:700: 00000100:00100000:2.0:1789263688.407299:0:9684:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9bb790900 going to sleep for 11 seconds 00000001:00080000:1.0:1789263688.409174:0:9479:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:2.0:1789263688.409399:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9684:x1876178898031488:12345-0@lo:700: Request processed in 2660us (2721us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263688.409410:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789263688.409746:0:9684:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd9bfaaf100 x1876178898031488/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789263704 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263688.409757:0:9684:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1789263688.409770:0:9684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaaf100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9684:1876178898031488:0@lo:700: 00000004:00080000:1.0:1789263688.410028:0:9678:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1789263688.410048:0:9678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88396ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9678:1876178898031744:0@lo:7: 00000100:00100000:2.0:1789263688.410056:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883968e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898031616:0@lo:13: 00000100:00100000:2.0:1789263688.410116:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263688.410123:0:9678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263688.410151:0:9678:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd882684240 going to sleep for 11 seconds 00000100:00100000:2.0:1789263688.410173:0:8395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898031744 00000100:00100000:2.0:1789263688.410179:0:8395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898031744 00000100:00100000:0.0:1789263688.410186:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898031616 00000100:00100000:0.0:1789263688.410192:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898031616 00000100:00100000:2.0:1789263688.410219:0:8395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789263688.410230:0:8395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883968a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:9678:x1876178898031744:12345-0@lo:7: 00000100:00100000:0.0:1789263688.410235:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789263688.410246:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3621:x1876178898031616:12345-0@lo:13: 00002000:00000024:0.0:1789263688.410276:0:8397:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3924074496 avail 3692552192 00000100:00100000:0.0:1789263688.410312:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3621:x1876178898031616:12345-0@lo:13: Request processed in 68us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263688.410320:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1789263688.410329:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd883968e00 x1876178898031616/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789263704 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789263688.410359:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883968e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898031616:0@lo:13: 00000004:02000040:0.0:1789263688.411571:0:9684:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00002000:00080000:2.0:1789263688.413721:0:8395:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1789263688.413727:0:8395:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1789263688.413868:0:8395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883968a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9678:x1876178898031744:12345-0@lo:7: Request processed in 3637us (3743us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263688.413877:0:8395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1789263688.413943:0:9678:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd88396ad80 x1876178898031744/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789263704 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789263688.413958:0:9678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88396ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9678:1876178898031744:0@lo:7: 00000004:00080000:1.0:1789263688.413971:0:9678:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1789263688.414002:0:9678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88396ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9678:1876178898031872:0@lo:5: 00000100:00100000:1.0:1789263688.414031:0:9678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263688.414108:0:9678:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd882684240 going to sleep for 11 seconds 00000100:00100000:2.0:1789263688.414164:0:8392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898031872 00000100:00100000:2.0:1789263688.414176:0:8392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898031872 00000100:00100000:2.0:1789263688.414223:0:8392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789263688.414233:0:8392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883968e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9678:x1876178898031872:12345-0@lo:5: 00002000:00080000:2.0:1789263688.414267:0:8392:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:2.0:1789263688.414302:0:8392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883968e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9678:x1876178898031872:12345-0@lo:5: Request processed in 72us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263688.414310:0:8392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1789263688.414329:0:9678:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd88396ad80 x1876178898031872/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789263704 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789263688.414341:0:9678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88396ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9678:1876178898031872:0@lo:5: 00000004:00080000:1.0:1789263688.414349:0:9678:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1789263688.414373:0:9678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88396ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9678:1876178898032000:0@lo:5: 00000100:00100000:1.0:1789263688.414395:0:9678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263688.414416:0:9678:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd882684240 going to sleep for 11 seconds 00000100:00100000:2.0:1789263688.414422:0:8511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898032000 00000100:00100000:2.0:1789263688.414427:0:8511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898032000 00000100:00100000:2.0:1789263688.414455:0:8511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789263688.414464:0:8511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88396b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9678:x1876178898032000:12345-0@lo:5: 00002000:00080000:2.0:1789263688.414485:0:8511:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:0.0:1789263688.415268:0:9684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9684:1876178898032128:0@lo:5: 00000100:00100000:0.0:1789263688.415298:0:9684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263688.415321:0:9684:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd881f31300 going to sleep for 11 seconds 00000100:00100000:1.0:1789263688.415350:0:8394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898032128 00000100:00100000:1.0:1789263688.415356:0:8394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898032128 00000100:00100000:1.0:1789263688.415407:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789263688.415416:0:8394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaa5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:9684:x1876178898032128:12345-0@lo:5: 00000100:00100000:2.0:1789263688.416392:0:8511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88396b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:9678:x1876178898032000:12345-0@lo:5: Request processed in 1929us (1995us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1789263688.416400:0:8511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1789263688.416431:0:9678:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd88396ad80 x1876178898032000/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789263704 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263688.416441:0:9678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88396ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9678:1876178898032000:0@lo:5: 00000004:00080000:0.0:1789263688.416454:0:9678:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1789263688.416486:0:9678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9678:1876178898032256:0@lo:900: 00000100:00100000:0.0:1789263688.416524:0:9678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263688.416551:0:9678:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd881f31780 going to sleep for 11 seconds 00000100:00100000:3.0:1789263688.416606:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898032256 00000100:00100000:3.0:1789263688.416613:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898032256 00000100:00100000:3.0:1789263688.416657:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789263688.416668:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9678:x1876178898032256:12345-0@lo:900: 00000100:00100000:3.0:1789263688.416724:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9678:x1876178898032256:12345-0@lo:900: Request processed in 59us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263688.416732:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789263688.416759:0:9678:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd9bfaa6300 x1876178898032256/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789263704 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263688.416770:0:9678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9678:1876178898032256:0@lo:900: 00002000:00080000:1.0:1789263688.419755:0:8394:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1789263688.419775:0:8394:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:1.0:1789263688.421295:0:8394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaa5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:9684:x1876178898032128:12345-0@lo:5: Request processed in 5876us (5991us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1789263688.421305:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1789263688.421333:0:9684:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd9bfaa5180 x1876178898032128/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789263704 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263688.421350:0:9684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9684:1876178898032128:0@lo:5: 00000004:00080000:0.0:1789263688.421363:0:9684:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00010000:00010000:2.0:1789263689.134241:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789263689.262018:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88396aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898032384:0@lo:41: 00000100:00100000:1.0:1789263689.262107:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263689.262182:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898032384 00000100:00100000:1.0:1789263689.262189:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898032384 00000100:00100000:1.0:1789263689.262233:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789263689.262264:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883969c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1876178898032384:12345-0@lo:41: 00000004:00000024:1.0:1789263689.262301:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789263689.262354:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883969c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1876178898032384:12345-0@lo:41: Request processed in 111us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263689.262362:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789263689.262402:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898032512:0@lo:13: 00000100:00100000:0.0:1789263689.262405:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88396aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898032384:0@lo:41: 00000100:00100000:1.0:1789263689.262436:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263689.262658:0:8512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898032512 00000100:00100000:0.0:1789263689.262667:0:8512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898032512 00000100:00100000:0.0:1789263689.262699:0:8512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789263689.262706:0:8512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88396b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1876178898032512:12345-0@lo:13: 00002000:00000024:0.0:1789263689.262794:0:8512:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789263689.262802:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883968700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898032640:0@lo:13: 00000100:00100000:1.0:1789263689.262846:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263689.262847:0:8512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88396b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1876178898032512:12345-0@lo:13: Request processed in 138us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263689.262856:0:8512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789263689.262871:0:8512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898032640 00000100:00100000:0.0:1789263689.262875:0:8512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898032640 00000100:00100000:0.0:1789263689.262895:0:8512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1789263689.262935:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd9bfaa6300 x1876178898032512/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789263705 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789263689.262947:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898032512:0@lo:13: 00000100:00100000:0.0:1789263689.263147:0:8512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88396a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1876178898032640:12345-0@lo:13: 00002000:00000024:0.0:1789263689.263159:0:8512:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789263689.263195:0:8512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88396a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1876178898032640:12345-0@lo:13: Request processed in 293us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263689.263202:0:8512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1789263689.263255:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd883968700 x1876178898032640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789263705 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263689.263269:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883968700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898032640:0@lo:13: 00000001:02000400:0.0:1789263689.353176:0:9851:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg320-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000020:00000004:3.0:1789263689.765211:0:9903:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789263689.765466:0:9903:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000001:00080000:2.0:1789263690.155535:0:9479:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:2.0:1789263690.155555:0:9479:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:2.0:1789263690.157342:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789263690.797433:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898032768:0@lo:41: 00000100:00100000:1.0:1789263690.797502:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263690.797846:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898032768 00000100:00100000:0.0:1789263690.797878:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898032768 00000100:00100000:0.0:1789263690.797987:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789263690.797998:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88396bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1876178898032768:12345-0@lo:41: 00000004:00000024:0.0:1789263690.798030:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1789263690.798111:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88396bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1876178898032768:12345-0@lo:41: Request processed in 114us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263690.798155:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789263690.798247:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898032768:0@lo:41: 00010000:00010000:0.0:1789263691.182608:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789263691.597680:0:10004:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789263691.598112:0:10004:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:1.0:1789263692.034478:0:10052:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789263692.034487:0:10052:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:2.0:1789263692.205275:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789263692.219669:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263692.219972:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888556672 00000100:00100000:3.0:1789263692.219986:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888556672 00000100:00100000:3.0:1789263692.220067:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 157 00000100:00100000:3.0:1789263692.220110:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2396:x1876178888556672:12345-192.168.203.20@tcp:250: 00010000:00080000:3.0:1789263692.220145:0:6481:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce@192.168.203.20@tcp t0 exp 0000000000000000 cur 134 last 0 00000020:00000080:3.0:1789263692.220190:0:6481:0:(genops.c:1385:class_connect()) connect: client 17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce, cookie 0xce1582440fb1d8b0 00000100:00080000:3.0:1789263692.220458:0:6481:0:(import.c:65:import_set_state_nolock()) ffff9dd883890000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789263692.220564:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+5:2396:x1876178888556672:12345-192.168.203.20@tcp:250: Request processed in 486us (907us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263692.220573:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 157 00000100:00100000:1.0:1789263692.222336:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263692.222450:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888556800 00000100:00100000:0.0:1789263692.222458:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888556800 00000100:00100000:0.0:1789263692.222539:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 158 00000100:00100000:0.0:1789263692.222547:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+5:6141:x1876178888556800:12345-192.168.203.20@tcp:101: 00010000:00010000:0.0:1789263692.222561:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263692.222580:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd990432200/0xce1582440fb1d8b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11b50 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263692.222610:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd990432200/0xce1582440fb1d8b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11b50 expref: 6 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263692.222623:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd990432200/0xce1582440fb1d8b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11b50 expref: 6 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263692.222634:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd990432200, rc 0) 00000100:00100000:0.0:1789263692.222692:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+6:6141:x1876178888556800:12345-192.168.203.20@tcp:101: Request processed in 145us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263692.222699:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 158 00000100:00100000:2.0:1789263692.223745:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263692.223806:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888556928 00000100:00100000:3.0:1789263692.223811:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888556928 00000100:00100000:3.0:1789263692.223846:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 159 00000100:00100000:3.0:1789263692.223853:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+6:6141:x1876178888556928:12345-192.168.203.20@tcp:501: 00000100:00100000:3.0:1789263692.223965:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+6:6141:x1876178888556928:12345-192.168.203.20@tcp:501: Request processed in 112us (222us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789263692.223972:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 159 00000100:00100000:1.0:1789263692.225774:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263692.225812:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888557056 00000100:00100000:0.0:1789263692.225819:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888557056 00000100:00100000:0.0:1789263692.225905:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 160 00000100:00100000:0.0:1789263692.225913:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+6:6141:x1876178888557056:12345-192.168.203.20@tcp:101: 00010000:00010000:0.0:1789263692.225935:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263692.225952:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd990433a00/0xce1582440fb1d8be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11b57 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263692.225974:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd990433a00/0xce1582440fb1d8be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11b57 expref: 7 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263692.226002:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd990433a00/0xce1582440fb1d8be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11b57 expref: 7 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263692.226013:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd990433a00, rc 0) 00000100:00100000:0.0:1789263692.226053:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+7:6141:x1876178888557056:12345-192.168.203.20@tcp:101: Request processed in 142us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263692.226058:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 160 00000100:00100000:1.0:1789263692.229349:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263692.229419:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888557184 00000100:00100000:0.0:1789263692.229431:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888557184 00000100:00100000:0.0:1789263692.229503:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 161 00000100:00100000:0.0:1789263692.229515:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+7:6141:x1876178888557184:12345-192.168.203.20@tcp:501: 00000100:00100000:0.0:1789263692.229870:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+8:6141:x1876178888557184:12345-192.168.203.20@tcp:501: Request processed in 356us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263692.229880:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 161 00000100:00100000:2.0:1789263692.234493:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263692.234609:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888557312 00000100:00100000:1.0:1789263692.234640:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888557312 00000100:00100000:1.0:1789263692.234760:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 162 00000100:00100000:1.0:1789263692.234773:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+8:6141:x1876178888557312:12345-192.168.203.20@tcp:503: 00000100:00100000:1.0:1789263692.234963:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+8:6141:x1876178888557312:12345-192.168.203.20@tcp:503: Request processed in 193us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263692.234973:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 162 00000100:00100000:1.0:1789263692.238209:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263692.238270:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888557440 00000100:00100000:0.0:1789263692.238282:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888557440 00000100:00100000:0.0:1789263692.238351:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 163 00000100:00100000:0.0:1789263692.238363:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+8:6159:x1876178888557440:12345-192.168.203.20@tcp:502: 00000100:00100000:0.0:1789263692.238565:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+8:6159:x1876178888557440:12345-192.168.203.20@tcp:502: Request processed in 205us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263692.238571:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 163 00000100:00100000:0.0:1789263692.260952:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263692.261117:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888557568 00000100:00100000:3.0:1789263692.261130:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888557568 00000100:00100000:3.0:1789263692.261213:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 164 00000100:00100000:3.0:1789263692.261239:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+8:6159:x1876178888557568:12345-192.168.203.20@tcp:502: 00000100:00100000:3.0:1789263692.263029:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+8:6159:x1876178888557568:12345-192.168.203.20@tcp:502: Request processed in 1792us (2079us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263692.263043:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 164 00000100:00100000:2.0:1789263692.266300:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263692.266404:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888557696 00000100:00100000:0.0:1789263692.266422:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888557696 00000100:00100000:0.0:1789263692.266510:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 165 00000100:00100000:0.0:1789263692.266524:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+8:6141:x1876178888557696:12345-192.168.203.20@tcp:101: 00010000:00010000:0.0:1789263692.266563:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263692.266587:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd990433e00/0xce1582440fb1d8c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11b88 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263692.266624:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd990433e00/0xce1582440fb1d8c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11b88 expref: 9 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263692.266638:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd990433e00/0xce1582440fb1d8c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11b88 expref: 9 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263692.266650:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd990433e00, rc 0) 00000100:00100000:0.0:1789263692.266742:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+9:6141:x1876178888557696:12345-192.168.203.20@tcp:101: Request processed in 221us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263692.266750:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 165 00000100:00100000:1.0:1789263692.269489:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263692.270156:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888557824 00000100:00100000:2.0:1789263692.270170:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888557824 00000100:00100000:2.0:1789263692.270239:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 166 00000100:00100000:2.0:1789263692.270249:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+9:6141:x1876178888557824:12345-192.168.203.20@tcp:256: 20000000:01000000:2.0:1789263692.270286:0:6481:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789263692.270306:0:6481:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789263692.270311:0:6481:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789263692.270314:0:6481:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789263692.270317:0:6481:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1789263692.270320:0:6481:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1789263692.271980:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+9:6141:x1876178888557824:12345-192.168.203.20@tcp:256: Request processed in 1727us (2496us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263692.271991:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 166 00000100:00100000:3.0:1789263692.276520:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263692.276740:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888557952 00000100:00100000:1.0:1789263692.276758:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888557952 00000100:00100000:1.0:1789263692.276840:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 167 00000100:00100000:1.0:1789263692.276853:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+9:6141:x1876178888557952:12345-192.168.203.20@tcp:101: 00010000:00010000:1.0:1789263692.276873:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263692.276894:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd981683c00/0xce1582440fb1d8cc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11b8f expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263692.276929:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd981683c00/0xce1582440fb1d8cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11b8f expref: 10 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263692.276945:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd981683c00/0xce1582440fb1d8cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11b8f expref: 10 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263692.276956:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981683c00, rc 0) 00000100:00100000:1.0:1789263692.277025:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+10:6141:x1876178888557952:12345-192.168.203.20@tcp:101: Request processed in 175us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263692.277033:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 167 00000100:00100000:1.0:1789263692.279015:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263692.279125:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888558080 00000100:00100000:0.0:1789263692.279142:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888558080 00000100:00100000:0.0:1789263692.279275:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 168 00000100:00100000:0.0:1789263692.279288:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+10:6141:x1876178888558080:12345-192.168.203.20@tcp:501: 00000100:00100000:0.0:1789263692.279444:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+10:6141:x1876178888558080:12345-192.168.203.20@tcp:501: Request processed in 160us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263692.279452:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 168 00000100:00100000:2.0:1789263692.281022:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263692.281121:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888558208 00000100:00100000:1.0:1789263692.281147:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888558208 00000100:00100000:1.0:1789263692.281207:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 169 00000100:00100000:1.0:1789263692.281217:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+10:6141:x1876178888558208:12345-192.168.203.20@tcp:503: 00000100:00100000:1.0:1789263692.281397:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+10:6141:x1876178888558208:12345-192.168.203.20@tcp:503: Request processed in 182us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263692.281404:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 169 00000100:00100000:3.0:1789263692.286943:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263692.287039:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888558336 00000100:00100000:0.0:1789263692.287053:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888558336 00000100:00100000:0.0:1789263692.287160:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 170 00000100:00100000:0.0:1789263692.287176:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+10:6165:x1876178888558336:12345-192.168.203.20@tcp:502: 00000100:00100000:0.0:1789263692.287354:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+10:6165:x1876178888558336:12345-192.168.203.20@tcp:502: Request processed in 181us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263692.287362:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 170 00000100:00100000:0.0:1789263692.289248:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263692.289336:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888558464 00000100:00100000:1.0:1789263692.289344:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888558464 00000100:00100000:1.0:1789263692.289394:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 171 00000100:00100000:1.0:1789263692.289403:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+10:6165:x1876178888558464:12345-192.168.203.20@tcp:502: 00000100:00100000:1.0:1789263692.289519:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+10:6165:x1876178888558464:12345-192.168.203.20@tcp:502: Request processed in 117us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263692.289526:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 171 00000100:00100000:2.0:1789263692.293501:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263692.293548:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263692.293646:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888558592 00000100:00100000:0.0:1789263692.293661:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888558592 00000100:00100000:0.0:1789263692.293712:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888558848 00000100:00100000:0.0:1789263692.293715:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888558848 00000100:00100000:0.0:1789263692.293751:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 7 00000100:00100000:0.0:1789263692.293762:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2396:x1876178888558592:12345-192.168.203.20@tcp:38: 00000100:00100000:1.0:1789263692.293772:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 8 00000100:00100000:1.0:1789263692.293783:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2396:x1876178888558848:12345-192.168.203.20@tcp:38: 00010000:00080000:0.0:1789263692.293795:0:6488:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 3ce90ea2-917f-4b54-98b0-25e051f2317f@192.168.203.20@tcp t0 exp 0000000000000000 cur 134 last 0 00010000:00080000:1.0:1789263692.293806:0:6489:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 3ce90ea2-917f-4b54-98b0-25e051f2317f@192.168.203.20@tcp t0 exp 0000000000000000 cur 134 last 0 00000020:00000080:1.0:1789263692.293867:0:6489:0:(genops.c:1385:class_connect()) connect: client 3ce90ea2-917f-4b54-98b0-25e051f2317f, cookie 0xce1582440fb1d8da 00000020:00000080:0.0:1789263692.293888:0:6488:0:(genops.c:1385:class_connect()) connect: client 3ce90ea2-917f-4b54-98b0-25e051f2317f, cookie 0xce1582440fb1d8d3 00000004:00100000:1.0:1789263692.293891:0:6489:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000004:00100000:0.0:1789263692.293903:0:6488:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789263692.294281:0:6488:0:(import.c:65:import_set_state_nolock()) ffff9dd882a37800 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1789263692.294331:0:6489:0:(import.c:65:import_set_state_nolock()) ffff9dd883f0d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789263692.294352:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+6:2396:x1876178888558592:12345-192.168.203.20@tcp:38: Request processed in 590us (870us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263692.294360:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 7 00000100:00100000:1.0:1789263692.294366:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+6:2396:x1876178888558848:12345-192.168.203.20@tcp:38: Request processed in 582us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263692.294376:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 8 00010000:00010000:2.0:1789263693.229262:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789263693.298110:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263693.298166:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263693.298170:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888558720 00000100:00100000:1.0:1789263693.298181:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888558720 00000100:00100000:2.0:1789263693.298207:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263693.298271:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888558976 00000100:00100000:1.0:1789263693.298274:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888558976 00000100:00100000:1.0:1789263693.298314:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888559104 00000100:00100000:1.0:1789263693.298318:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888559104 00000100:00100000:1.0:1789263693.298334:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 9 00000100:00100000:1.0:1789263693.298343:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+7:0:x1876178888558720:12345-192.168.203.20@tcp:41: 00000004:00000024:1.0:1789263693.298398:0:7434:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1789263693.298460:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+7:0:x1876178888558720:12345-192.168.203.20@tcp:41: Request processed in 118us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263693.298468:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 9 00000100:00100000:1.0:1789263693.298486:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 10 00000100:00100000:1.0:1789263693.298492:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+6:0:x1876178888558976:12345-192.168.203.20@tcp:41: 00000004:00000024:1.0:1789263693.298509:0:7434:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789263693.298532:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+6:0:x1876178888558976:12345-192.168.203.20@tcp:41: Request processed in 41us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263693.298539:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 10 00000100:00100000:1.0:1789263693.298550:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 11 00000100:00100000:1.0:1789263693.298556:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+6:6141:x1876178888559104:12345-192.168.203.20@tcp:41: 00000004:00000024:1.0:1789263693.298567:0:7434:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1789263693.298587:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+6:6141:x1876178888559104:12345-192.168.203.20@tcp:41: Request processed in 30us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263693.298592:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 11 00000100:00080000:0.0:1789263693.298679:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789263693.298684:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789263693.300490:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263693.300973:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888559232 00000100:00100000:1.0:1789263693.300982:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888559232 00000100:00100000:1.0:1789263693.301038:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 12 00000100:00100000:1.0:1789263693.301047:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+6:6141:x1876178888559232:12345-192.168.203.20@tcp:40: 00000100:00100000:1.0:1789263693.301156:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+6:6141:x1876178888559232:12345-192.168.203.20@tcp:40: Request processed in 110us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263693.301178:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 12 00000100:00100000:2.0:1789263693.302831:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263693.302869:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263693.302896:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888559744 00000100:00100000:0.0:1789263693.302904:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888559744 00000100:00100000:2.0:1789263693.302909:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263693.302939:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263693.302954:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 4 00000100:00100000:0.0:1789263693.302966:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:3ce90ea2-917f-4b54-98b0-25e051f2317f+6:6141:x1876178888559744:12345-192.168.203.20@tcp:900: 00000100:00100000:0.0:1789263693.303028:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:3ce90ea2-917f-4b54-98b0-25e051f2317f+6:6141:x1876178888559744:12345-192.168.203.20@tcp:900: Request processed in 65us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263693.303036:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 4 00000100:00100000:3.0:1789263693.303071:0:8395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888559360 00000100:00100000:0.0:1789263693.303104:0:8392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888559616 00000100:00100000:0.0:1789263693.303109:0:8392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888559616 00000100:00100000:3.0:1789263693.303112:0:8395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888559360 00000100:00100000:0.0:1789263693.303145:0:8392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 16 00000100:00100000:0.0:1789263693.303151:0:8392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2396:x1876178888559616:12345-192.168.203.20@tcp:8: 00000100:00100000:1.0:1789263693.303172:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888559488 00000100:00100000:1.0:1789263693.303177:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888559488 00010000:00080000:0.0:1789263693.303179:0:8392:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 3ce90ea2-917f-4b54-98b0-25e051f2317f@192.168.203.20@tcp t0 exp 0000000000000000 cur 135 last 0 00000020:00000080:0.0:1789263693.303223:0:8392:0:(genops.c:1385:class_connect()) connect: client 3ce90ea2-917f-4b54-98b0-25e051f2317f, cookie 0xce1582440fb1d8e1 00000100:00100000:1.0:1789263693.303225:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 172 00000100:00100000:1.0:1789263693.303236:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+10:2400:x1876178888559488:12345-192.168.203.20@tcp:400: 00002000:00100000:0.0:1789263693.303237:0:8392:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 3ce90ea2-917f-4b54-98b0-25e051f2317f/ffff9dd882a33800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789263693.303258:0:8392:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:1.0:1789263693.303269:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+10:2400:x1876178888559488:12345-192.168.203.20@tcp:400: Request processed in 34us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263693.303277:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 172 00000100:00100000:3.0:1789263693.303353:0:8395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 17 00000100:00100000:3.0:1789263693.303359:0:8395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2396:x1876178888559360:12345-192.168.203.20@tcp:8: 00010000:00080000:3.0:1789263693.303377:0:8395:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 3ce90ea2-917f-4b54-98b0-25e051f2317f@192.168.203.20@tcp t0 exp 0000000000000000 cur 135 last 0 00000020:00000080:3.0:1789263693.303402:0:8395:0:(genops.c:1385:class_connect()) connect: client 3ce90ea2-917f-4b54-98b0-25e051f2317f, cookie 0xce1582440fb1d8e8 00002000:00100000:3.0:1789263693.303408:0:8395:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3ce90ea2-917f-4b54-98b0-25e051f2317f/ffff9dd883891000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789263693.303422:0:8395:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789263693.303455:0:8392:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789263693.303488:0:8392:0:(import.c:65:import_set_state_nolock()) ffff9dd882a35000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789263693.303524:0:8392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+6:2396:x1876178888559616:12345-192.168.203.20@tcp:8: Request processed in 372us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263693.303532:0:8392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 16 00002000:00080000:3.0:1789263693.303601:0:8395:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789263693.303617:0:8395:0:(import.c:65:import_set_state_nolock()) ffff9dd883892800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789263693.303990:0:8395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+6:2396:x1876178888559360:12345-192.168.203.20@tcp:8: Request processed in 297us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263693.303997:0:8395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 17 00000100:00100000:2.0:1789263693.305312:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263693.305400:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888559872 00000100:00100000:0.0:1789263693.305407:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888559872 00000100:00100000:0.0:1789263693.305487:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 0 00000100:00100000:0.0:1789263693.305496:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+6:6141:x1876178888559872:12345-192.168.203.20@tcp:33: 00000004:00080000:3.0:1789263693.316210:0:6490:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 10640us 00000004:00200000:3.0:1789263693.322375:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1789263693.322484:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+6:6141:x1876178888559872:12345-192.168.203.20@tcp:33: Request processed in 16983us (17170us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263693.322499:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 0 00000100:00100000:2.0:1789263693.405735:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263693.405805:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888560000 00000100:00100000:0.0:1789263693.405815:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888560000 00000100:00100000:0.0:1789263693.405871:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 13 00000100:00100000:0.0:1789263693.405882:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+6:6183:x1876178888560000:12345-192.168.203.20@tcp:101: 00010000:00010000:0.0:1789263693.405902:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263693.405960:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432600/0xce1582440fb1d8ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11bc0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263693.406023:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1d8f6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263693.406047:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1d8f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263693.406061:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1d8f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789263693.406131:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789263693.406134:0:6488:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789263693.406151:0:6488:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1d8f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263693.406176:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432600/0xce1582440fb1d8ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11bc0 expref: 8 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263693.406195:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1d8f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11bc0 expref: 7 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263693.406205:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd98a473900) 00010000:00010000:0.0:1789263693.406207:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789263693.406211:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd990433600, rc 0) 00000100:00100000:0.0:1789263693.406284:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+7:6183:x1876178888560000:12345-192.168.203.20@tcp:101: Request processed in 396us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263693.406292:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 13 00000100:00100000:3.0:1789263693.869289:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883968700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:66a76ccf-c64c-4b18-8369-a2861ec3956c:3618:1876178898033024:0@lo:400: 00000100:00100000:2.0:1789263693.869289:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88396aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1876178898033152:0@lo:400: 00000100:00100000:0.0:1789263693.869349:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9c08ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898033280:0@lo:400: 00000100:00100000:2.0:1789263693.869361:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263693.869403:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263693.869412:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898033408:0@lo:13: 00000100:00100000:2.0:1789263693.869434:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1876178898033664:0@lo:400: 00000100:00100000:0.0:1789263693.869451:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1876178898033792:0@lo:400: 00000100:00100000:3.0:1789263693.869458:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263693.869473:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263693.869478:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263693.869503:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898033280 00000100:00100000:3.0:1789263693.869505:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88297ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898032896:0@lo:13: 00000100:00100000:1.0:1789263693.869507:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898033920:0@lo:400: 00000100:00100000:0.0:1789263693.869515:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898033280 00000100:00100000:2.0:1789263693.869520:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876178898034176:0@lo:400: 00000100:00100000:3.0:1789263693.869553:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263693.869557:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263693.869572:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898033152 00000100:00100000:0.0:1789263693.869576:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789263693.869579:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898033152 00000100:00100000:0.0:1789263693.869586:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaa6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898033280:12345-0@lo:400: 00000100:00100000:1.0:1789263693.869590:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3621:1876178898034432:0@lo:400: 00000100:00100000:3.0:1789263693.869594:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876178898033536:0@lo:400: 00000100:00100000:1.0:1789263693.869625:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263693.869627:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898033664 00000100:00100000:2.0:1789263693.869633:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898033664 00000100:00100000:3.0:1789263693.869645:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898033024 00000100:00100000:3.0:1789263693.869650:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898033024 00000100:00100000:0.0:1789263693.869656:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaa6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898033280:12345-0@lo:400: Request processed in 72us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263693.869663:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789263693.869676:0:8396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898033408 00000100:00100000:1.0:1789263693.869681:0:8396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898033408 00000100:00100000:2.0:1789263693.869692:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898034432 00000100:00100000:3.0:1789263693.869693:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1789263693.869699:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898034432 00000100:00100000:0.0:1789263693.869702:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898032896 00000100:00100000:3.0:1789263693.869708:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+24:3618:x1876178898033024:12345-0@lo:400: 00000100:00100000:0.0:1789263693.869708:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898032896 00000100:00100000:2.0:1789263693.869730:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789263693.869730:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789263693.869746:0:8396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaa8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1876178898033408:12345-0@lo:13: 00000100:00100000:2.0:1789263693.869748:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1876178898033152:12345-0@lo:400: 00000100:00100000:0.0:1789263693.869750:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789263693.869756:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+24:3618:x1876178898033024:12345-0@lo:400: Request processed in 50us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263693.869763:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88397ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876178898032896:12345-0@lo:13: 00002000:00000024:1.0:1789263693.869768:0:8396:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789263693.869769:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00002000:00000024:0.0:1789263693.869775:0:8397:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789263693.869815:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1876178898033152:12345-0@lo:400: Request processed in 72us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263693.869818:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88397ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876178898032896:12345-0@lo:13: Request processed in 58us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263693.869831:0:8396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaa8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1876178898033408:12345-0@lo:13: Request processed in 90us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263693.869832:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789263693.869835:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263693.869836:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789263693.869846:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789263693.869855:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898033792 00000100:00100000:0.0:1789263693.869858:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898033792 00000100:00100000:3.0:1789263693.869865:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1876178898034304:0@lo:400: 00000100:00100000:2.0:1789263693.869868:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789263693.869882:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1876178898033664:12345-0@lo:400: 00000100:00100000:0.0:1789263693.869887:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1789263693.869901:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd9bfaa7b80 x1876178898033408/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789263709 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263693.869901:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1876178898034432:12345-0@lo:400: 00000100:00100000:3.0:1789263693.869906:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263693.869919:0:3621:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1789263693.869935:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1876178898033664:12345-0@lo:400: Request processed in 55us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263693.869944:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9c08ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898033280:0@lo:400: 00000100:00100000:2.0:1789263693.869945:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789263693.869955:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898033408:0@lo:13: 00000100:00100000:0.0:1789263693.869965:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1876178898034432:12345-0@lo:400: Request processed in 68us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263693.869969:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898034304 00000100:00100000:2.0:1789263693.869974:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898034304 00000100:00100000:0.0:1789263693.869975:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1789263693.869978:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd9bfaa8380 x1876178898034432/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263709 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263693.869982:0:8511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898033920 00000100:00100000:3.0:1789263693.869990:0:8511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898033920 00000100:00100000:1.0:1789263693.869994:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3621:1876178898034432:0@lo:400: 00000100:00100000:0.0:1789263693.870000:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789263693.870009:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789263693.870013:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88397e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1876178898033792:12345-0@lo:400: 00000100:00100000:2.0:1789263693.870024:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88397d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1876178898034304:12345-0@lo:400: 00000100:00100000:1.0:1789263693.870026:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263693.870044:0:8511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789263693.870049:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898034048:0@lo:400: 00000100:00100000:3.0:1789263693.870056:0:8511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1876178898033920:12345-0@lo:400: 00000100:00100000:0.0:1789263693.870062:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88397e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1876178898033792:12345-0@lo:400: Request processed in 52us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263693.870069:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789263693.870104:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898033536 00000100:00100000:2.0:1789263693.870113:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88397d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1876178898034304:12345-0@lo:400: Request processed in 92us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263693.870113:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898033536 00000100:00100000:1.0:1789263693.870114:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263693.870124:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789263693.870139:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789263693.870146:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898034560:0@lo:400: 00000100:00100000:0.0:1789263693.870147:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaa8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876178898033536:12345-0@lo:400: 00000100:00080000:2.0:1789263693.870151:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789263693.870157:0:8511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1876178898033920:12345-0@lo:400: Request processed in 103us (602us total) trans 0 rc 0/0 00000100:00080000:2.0:1789263693.870160:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789263693.870166:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789263693.870170:0:8511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1789263693.870171:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789263693.870183:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263693.870191:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaa8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876178898033536:12345-0@lo:400: Request processed in 46us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263693.870197:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789263693.870199:0:8511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898034560 00000100:00100000:3.0:1789263693.870205:0:8511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898034560 00000100:00100000:2.0:1789263693.870227:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263693.870233:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883968700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:66a76ccf-c64c-4b18-8369-a2861ec3956c:3618:1876178898033024:0@lo:400: 00000100:00100000:0.0:1789263693.870235:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898034048 00000100:00100000:0.0:1789263693.870241:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898034048 00010000:00080000:1.0:1789263693.870253:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd88297ea00 x1876178898032896/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789263709 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263693.870254:0:8511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898034176 00000100:00100000:3.0:1789263693.870259:0:8511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898034176 00000100:00100000:2.0:1789263693.870262:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876178898034688:0@lo:400: 00000100:00100000:0.0:1789263693.870270:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789263693.870275:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:0.0:1789263693.870280:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1876178898034048:12345-0@lo:400: 00000100:00100000:1.0:1789263693.870297:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88297ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898032896:0@lo:13: 00000100:00100000:3.0:1789263693.870304:0:8511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789263693.870308:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263693.870316:0:8511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1876178898034560:12345-0@lo:400: 00000100:00100000:0.0:1789263693.870319:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1876178898034048:12345-0@lo:400: Request processed in 40us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263693.870334:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876178898033536:0@lo:400: 00000100:00100000:1.0:1789263693.870354:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898034048:0@lo:400: 00000100:00100000:2.0:1789263693.870355:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88396aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1876178898033152:0@lo:400: 00000100:00100000:3.0:1789263693.870361:0:8511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1876178898034560:12345-0@lo:400: Request processed in 50us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263693.870368:0:8511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1789263693.870372:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd9bfaa8000 x1876178898034560/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789263709 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789263693.870383:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898034560:0@lo:400: 00000100:00100000:3.0:1789263693.870385:0:8511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898034688 00000100:00100000:3.0:1789263693.870390:0:8511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898034688 00000100:00100000:2.0:1789263693.870394:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1876178898033664:0@lo:400: 00000100:00100000:3.0:1789263693.870413:0:8511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789263693.870420:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789263693.870423:0:8511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1876178898034176:12345-0@lo:400: 00000100:00100000:1.0:1789263693.870434:0:8394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9907a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1876178898034688:12345-0@lo:400: 00010000:00080000:2.0:1789263693.870455:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd9bfaaa680 x1876178898033792/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263709 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263693.870465:0:8511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1876178898034176:12345-0@lo:400: Request processed in 44us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263693.870470:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1876178898033792:0@lo:400: 00000100:00100000:3.0:1789263693.870473:0:8511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789263693.870480:0:8394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9907a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1876178898034688:12345-0@lo:400: Request processed in 48us (174us total) trans 0 rc 0/0 00000100:00080000:3.0:1789263693.870493:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789263693.870494:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789263693.870498:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1876178898034304:0@lo:400: 00010000:00080000:3.0:1789263693.870514:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd9bfaab480 x1876178898034176/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789263709 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263693.870522:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876178898034176:0@lo:400: 00010000:00080000:3.0:1789263693.870544:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd9bfaa9880 x1876178898034688/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789263709 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1789263693.870545:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd9bfaa9180 x1876178898033920/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789263709 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263693.870555:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876178898034688:0@lo:400: 00000100:00100000:2.0:1789263693.870569:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898033920:0@lo:400: 00000100:00100000:0.0:1789263693.871060:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:0.0:1789263694.253521:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789263694.381329:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898034944:0@lo:13: 00000100:00100000:3.0:1789263694.381331:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789263694.381356:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876178898035072:0@lo:41: 00000100:00100000:3.0:1789263694.381395:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263694.381395:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263694.381460:0:8499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898035072 00000100:00100000:3.0:1789263694.381465:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898034816:0@lo:13: 00000100:00100000:1.0:1789263694.381467:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898034944 00000100:00100000:0.0:1789263694.381468:0:8499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898035072 00000100:00100000:1.0:1789263694.381472:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898034944 00000100:00100000:3.0:1789263694.381506:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263694.381519:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898034816 00000100:00100000:1.0:1789263694.381523:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898034816 00000100:00100000:0.0:1789263694.381528:0:8499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789263694.381541:0:8499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88397f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1876178898035072:12345-0@lo:41: 00000100:00100000:1.0:1789263694.381543:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789263694.381556:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9907a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1876178898034944:12345-0@lo:13: 00002000:00000024:1.0:1789263694.381573:0:8397:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000004:00000024:0.0:1789263694.381576:0:8499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789263694.381595:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789263694.381603:0:8396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88397d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1876178898034816:12345-0@lo:13: 00002000:00000024:3.0:1789263694.381615:0:8396:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789263694.381619:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9907a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1876178898034944:12345-0@lo:13: Request processed in 66us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263694.381626:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789263694.381634:0:8499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88397f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1876178898035072:12345-0@lo:41: Request processed in 97us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263694.381642:0:8499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789263694.381675:0:8396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88397d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1876178898034816:12345-0@lo:13: Request processed in 62us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263694.381683:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789263694.381692:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876178898035072:0@lo:41: 00010000:00080000:3.0:1789263694.381710:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd9bfaa5180 x1876178898034816/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789263710 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263694.381724:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898034816:0@lo:13: 00010000:00080000:2.0:1789263694.381751:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd9bfaa8000 x1876178898034944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789263710 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789263694.381763:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898034944:0@lo:13: 00000100:00100000:0.0:1789263694.934281:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263694.934346:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888560128 00000100:00100000:0.0:1789263694.934355:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888560128 00000100:00100000:0.0:1789263694.934407:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 14 00000100:00100000:0.0:1789263694.934418:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaa7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+6:6236:x1876178888560128:12345-192.168.203.20@tcp:41: 00000004:00000024:0.0:1789263694.934454:0:8417:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789263694.934551:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaa7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+6:6236:x1876178888560128:12345-192.168.203.20@tcp:41: Request processed in 134us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263694.934559:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 14 00000100:00100000:2.0:1789263694.936716:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263694.936770:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888560256 00000100:00100000:1.0:1789263694.936778:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888560256 00000100:00080000:3.0:1789263694.936829:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789263694.936842:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 12 00000100:00100000:1.0:1789263694.936851:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9907a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3ce90ea2-917f-4b54-98b0-25e051f2317f+6:6236:x1876178888560256:12345-192.168.203.20@tcp:13: 00002000:00000024:1.0:1789263694.936879:0:8397:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789263694.936934:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9907a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3ce90ea2-917f-4b54-98b0-25e051f2317f+6:6236:x1876178888560256:12345-192.168.203.20@tcp:13: Request processed in 84us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263694.936942:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 12 00000100:00100000:0.0:1789263694.938186:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263694.938292:0:8396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888560384 00000100:00100000:3.0:1789263694.938298:0:8396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888560384 00000100:00100000:3.0:1789263694.938421:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 13 00000100:00100000:3.0:1789263694.938430:0:8396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaa6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3ce90ea2-917f-4b54-98b0-25e051f2317f+6:6236:x1876178888560384:12345-192.168.203.20@tcp:13: 00002000:00000024:3.0:1789263694.938452:0:8396:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789263694.938503:0:8396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaa6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3ce90ea2-917f-4b54-98b0-25e051f2317f+6:6236:x1876178888560384:12345-192.168.203.20@tcp:13: Request processed in 73us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263694.938521:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 13 00000100:00080000:2.0:1789263694.938610:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789263695.278302:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789263695.917761:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789263695.917785:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898035200:0@lo:41: 00000100:00100000:2.0:1789263695.917864:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263695.917911:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898035200 00000100:00100000:0.0:1789263695.917921:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898035200 00000100:00100000:0.0:1789263695.917979:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789263695.917989:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883f5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1876178898035200:12345-0@lo:41: 00000004:00000024:0.0:1789263695.918022:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1789263695.918098:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883f5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1876178898035200:12345-0@lo:41: Request processed in 110us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263695.918106:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789263695.918126:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898035200:0@lo:41: 00000001:02000400:1.0:1789263696.042872:0:10149:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1789263696.301781:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263697.325214:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789263697.455223:0:9479:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3ce90ea2-917f-4b54-98b0-25e051f2317f 00000001:00100000:1.0:1789263697.455422:0:7417:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 3ce90ea2-917f-4b54-98b0-25e051f2317f 00000001:00100000:0.0:1789263697.458022:0:6466:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3ce90ea2-917f-4b54-98b0-25e051f2317f 00000020:00000080:1.0:1789263697.505715:0:10297:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffb7c36ef0 20000000:00000080:1.0:1789263697.505729:0:10297:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9dd9bfa63c00 uarg=0000000000000000 20000000:01000000:1.0:1789263697.505769:0:10297:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1789263697.505773:0:10297:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1789263697.505776:0:10297:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1789263697.505779:0:10297:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1789263697.505783:0:10297:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1789263697.505826:0:10297:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789263697.505828:0:10297:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1789263697.506252:0:10298:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:3.0:1789263697.506575:0:10297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:3.0:1789263697.506607:0:10297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:3.0:1789263697.506623:0:10297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:3.0:1789263697.506634:0:10297:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1789263697.506642:0:10297:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789263697.506911:0:10299:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:1.0:1789263697.507035:0:10297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:1.0:1789263697.507058:0:10297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:1.0:1789263697.507071:0:10297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:1.0:1789263697.507111:0:10297:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1789263697.507114:0:10297:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789263697.507346:0:10300:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:1.0:1789263697.507448:0:10297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:1.0:1789263697.507470:0:10297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:1.0:1789263697.507486:0:10297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:1.0:1789263697.507495:0:10297:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1789263697.507497:0:10297:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789263697.507725:0:10301:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:1.0:1789263697.507803:0:10297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:1.0:1789263697.507824:0:10297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:1.0:1789263697.507837:0:10297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:1.0:1789263697.507845:0:10297:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789263697.507847:0:10297:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789263697.508042:0:10302:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:1.0:1789263697.508143:0:10297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:1.0:1789263697.508167:0:10297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:1.0:1789263697.508184:0:10297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 10000000:01000000:1.0:1789263697.508213:0:10297:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789263697.508232:0:10297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dd981682000/0xce1582440fb1d8fd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263697.508249:0:10297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd981530400/0xce1582440fb1d798 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d791 expref: 23 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263697.508256:0:10297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd981530600/0xce1582440fb1d7c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d7bb expref: 23 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263697.508270:0:10297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd981531600/0xce1582440fb1d801 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d7fa expref: 23 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263697.508276:0:10297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd981530200/0xce1582440fb1d80f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d808 expref: 23 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263697.508283:0:10297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd981530c00/0xce1582440fb1d81d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d816 expref: 23 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263697.508290:0:10297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd9bfa22c00/0xce1582440fb1d839 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d832 expref: 23 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263697.508296:0:10297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd981531200/0xce1582440fb1d863 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d85c expref: 23 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263697.508303:0:10297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd981530800/0xce1582440fb1d87f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d878 expref: 23 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263697.508309:0:10297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd990432e00/0xce1582440fb1d8a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d8a2 expref: 23 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263697.508317:0:10297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd990432200/0xce1582440fb1d8b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11b50 expref: 9 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263697.508324:0:10297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd990433a00/0xce1582440fb1d8be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11b57 expref: 9 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263697.508330:0:10297:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dd981682000/0xce1582440fb1d8fd lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263697.508376:0:10297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd990433a00/0xce1582440fb1d8be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11b57 expref: 9 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263697.508389:0:10297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dd990433a00/0xce1582440fb1d8be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11b57 expref: 9 pid: 6482 timeout: 239 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263697.508403:0:10297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaaa300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1876178898035328:192.168.203.20@tcp:104: 00010000:00010000:1.0:1789263697.508502:0:10297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd990432200/0xce1582440fb1d8b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11b50 expref: 9 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263697.508511:0:10297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dd990432200/0xce1582440fb1d8b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11b50 expref: 9 pid: 6482 timeout: 239 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263697.508520:0:10297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1876178898035456:192.168.203.20@tcp:104: 00010000:00010000:1.0:1789263697.508551:0:10297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd990432e00/0xce1582440fb1d8a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce1582440fb1d8a2 expref: 23 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263697.508560:0:10297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dd990432e00/0xce1582440fb1d8a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce1582440fb1d8a2 expref: 23 pid: 6482 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263697.508569:0:10297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaabb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1876178898035584:0@lo:104: 00000100:00100000:1.0:1789263697.508608:0:10297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789263697.508643:0:10297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd981530800/0xce1582440fb1d87f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce1582440fb1d878 expref: 23 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263697.508651:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898035584 00010000:00010000:1.0:1789263697.508652:0:10297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dd981530800/0xce1582440fb1d87f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce1582440fb1d878 expref: 23 pid: 6481 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263697.508658:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898035584 00000100:00100000:1.0:1789263697.508676:0:10297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1876178898035712:0@lo:104: 00000100:00100000:1.0:1789263697.508702:0:10297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789263697.508740:0:10297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd981531200/0xce1582440fb1d863 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce1582440fb1d85c expref: 23 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263697.508748:0:10297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dd981531200/0xce1582440fb1d863 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce1582440fb1d85c expref: 23 pid: 6480 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263697.508757:0:10297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1876178898035840:0@lo:104: 00010000:00010000:1.0:1789263697.508787:0:10297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd9bfa22c00/0xce1582440fb1d839 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce1582440fb1d832 expref: 23 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263697.508794:0:6471:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:1.0:1789263697.508796:0:10297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dd9bfa22c00/0xce1582440fb1d839 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce1582440fb1d832 expref: 23 pid: 6481 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263697.508808:0:10297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1876178898035968:0@lo:104: 00000100:00100000:2.0:1789263697.508817:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898035712 00000100:00100000:2.0:1789263697.508822:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898035712 00010000:00010000:1.0:1789263697.508837:0:10297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd981530c00/0xce1582440fb1d81d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce1582440fb1d816 expref: 23 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263697.508847:0:10297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dd981530c00/0xce1582440fb1d81d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce1582440fb1d816 expref: 23 pid: 6480 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263697.508857:0:6471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263697.508859:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789263697.508864:0:10297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1876178898036096:0@lo:104: 00000100:00100000:2.0:1789263697.508871:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:66a76ccf-c64c-4b18-8369-a2861ec3956c+4:10297:x1876178898035584:12345-0@lo:104: 00000100:00100000:3.0:1789263697.508880:0:6471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789263697.508889:0:6470:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff9dd990433000/0xce1582440fb1d8a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1d8a9 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263697.508892:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898035840 00000100:00100000:3.0:1789263697.508898:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898035840 00000100:00100000:1.0:1789263697.508899:0:10297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263697.508921:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898035968 00000100:00100000:3.0:1789263697.508925:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898035968 00000100:00100000:3.0:1789263697.508938:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898036096 00010000:00010000:1.0:1789263697.508939:0:10297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd981530200/0xce1582440fb1d80f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce1582440fb1d808 expref: 23 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263697.508943:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898036096 00010000:00010000:1.0:1789263697.508954:0:10297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dd981530200/0xce1582440fb1d80f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce1582440fb1d808 expref: 23 pid: 6481 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263697.508963:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00010000:00010000:2.0:1789263697.508970:0:6470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789263697.508977:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c0ae5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:66a76ccf-c64c-4b18-8369-a2861ec3956c+7:10297:x1876178898035712:12345-0@lo:104: 00000100:00100000:1.0:1789263697.508978:0:10297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1876178898036224:0@lo:104: 00000100:00100000:2.0:1789263697.508984:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:66a76ccf-c64c-4b18-8369-a2861ec3956c+7:10297:x1876178898035584:12345-0@lo:104: Request processed in 111us (371us total) trans 0 rc 0/0 00010000:00010000:3.0:1789263697.508992:0:6471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23800/0xce1582440fb1d878 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1d87f expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263697.508994:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789263697.509015:0:10297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263697.509020:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789263697.509030:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88397df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:66a76ccf-c64c-4b18-8369-a2861ec3956c+6:10297:x1876178898035840:12345-0@lo:104: 00010000:00010000:1.0:1789263697.509046:0:10297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd981531600/0xce1582440fb1d801 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce1582440fb1d7fa expref: 23 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263697.509047:0:6471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:2.0:1789263697.509051:0:6470:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22a00/0xce1582440fb1d85c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1d863 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263697.509058:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c0ae5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:66a76ccf-c64c-4b18-8369-a2861ec3956c+6:10297:x1876178898035712:12345-0@lo:104: Request processed in 83us (353us total) trans 0 rc 0/0 00010000:00010000:1.0:1789263697.509068:0:10297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dd981531600/0xce1582440fb1d801 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce1582440fb1d7fa expref: 23 pid: 6481 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263697.509118:0:6470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789263697.509125:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88397df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:66a76ccf-c64c-4b18-8369-a2861ec3956c+6:10297:x1876178898035840:12345-0@lo:104: Request processed in 98us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263697.509132:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789263697.509137:0:10297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaaad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1876178898036352:0@lo:104: 00000100:00100000:2.0:1789263697.509146:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898036224 00000100:00100000:2.0:1789263697.509151:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898036224 00000100:00100000:1.0:1789263697.509164:0:10297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263697.509170:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898036352 00000100:00100000:2.0:1789263697.509175:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898036352 00000100:00100000:2.0:1789263697.509206:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789263697.509214:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88397ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:66a76ccf-c64c-4b18-8369-a2861ec3956c+7:10297:x1876178898035968:12345-0@lo:104: 00010000:00010000:1.0:1789263697.509219:0:10297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd981530600/0xce1582440fb1d7c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce1582440fb1d7bb expref: 23 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263697.509225:0:6470:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff9dd990432400/0xce1582440fb1d832 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1d839 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263697.509233:0:10297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dd981530600/0xce1582440fb1d7c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce1582440fb1d7bb expref: 23 pid: 6480 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263697.509245:0:10297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88396aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1876178898036480:0@lo:104: 00000100:00100000:1.0:1789263697.509277:0:10297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789263697.509280:0:6470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1789263697.509293:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88397ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:66a76ccf-c64c-4b18-8369-a2861ec3956c+7:10297:x1876178898035968:12345-0@lo:104: Request processed in 79us (414us total) trans 0 rc 0/0 00010000:00010000:1.0:1789263697.509298:0:10297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd981530400/0xce1582440fb1d798 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce1582440fb1d791 expref: 23 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263697.509303:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:1.0:1789263697.509315:0:10297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dd981530400/0xce1582440fb1d798 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce1582440fb1d791 expref: 23 pid: 6480 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263697.509325:0:10297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88396ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1876178898036608:0@lo:104: 00000100:00100000:2.0:1789263697.509329:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898036480 00000100:00100000:2.0:1789263697.509334:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898036480 00000100:00100000:1.0:1789263697.509350:0:10297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263697.509356:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789263697.509365:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:66a76ccf-c64c-4b18-8369-a2861ec3956c+7:10297:x1876178898036096:12345-0@lo:104: 00000100:00100000:1.0:1789263697.509365:0:10297:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd88392a480 going to sleep for 11 seconds 00010000:00010000:2.0:1789263697.509374:0:6470:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff9dd981531a00/0xce1582440fb1d816 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1d81d expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263697.509382:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789263697.509390:0:10297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaabb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1876178898035584:0@lo:104: 00000100:00100000:1.0:1789263697.509415:0:10297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1876178898035712:0@lo:104: 00010000:00010000:2.0:1789263697.509423:0:6470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1789263697.509429:0:10297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1876178898035840:0@lo:104: 00000100:00100000:2.0:1789263697.509431:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:66a76ccf-c64c-4b18-8369-a2861ec3956c+6:10297:x1876178898036096:12345-0@lo:104: Request processed in 67us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263697.509432:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898036608 00000100:00100000:3.0:1789263697.509438:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898036608 00000100:00100000:1.0:1789263697.509440:0:10297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1876178898035968:0@lo:104: 00000100:00100000:2.0:1789263697.509444:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789263697.509456:0:10297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1876178898036096:0@lo:104: 00000100:00100000:3.0:1789263697.509466:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789263697.509474:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaaa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:66a76ccf-c64c-4b18-8369-a2861ec3956c+6:10297:x1876178898036224:12345-0@lo:104: 00000100:00100000:2.0:1789263697.509478:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00010000:00010000:3.0:1789263697.509485:0:6471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22200/0xce1582440fb1d808 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1d80f expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263697.509488:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:66a76ccf-c64c-4b18-8369-a2861ec3956c+6:10297:x1876178898036352:12345-0@lo:104: 00010000:00010000:2.0:1789263697.509499:0:6470:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23600/0xce1582440fb1d7fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1d801 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263697.509540:0:6471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:3.0:1789263697.509548:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaaa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:66a76ccf-c64c-4b18-8369-a2861ec3956c+6:10297:x1876178898036224:12345-0@lo:104: Request processed in 74us (535us total) trans 0 rc 0/0 00010000:00010000:2.0:1789263697.509549:0:6470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1789263697.509557:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:66a76ccf-c64c-4b18-8369-a2861ec3956c+6:10297:x1876178898036352:12345-0@lo:104: Request processed in 71us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263697.509559:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789263697.509567:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789263697.509577:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789263697.509583:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789263697.509587:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883968700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:66a76ccf-c64c-4b18-8369-a2861ec3956c+4:10297:x1876178898036480:12345-0@lo:104: 00000100:00100000:2.0:1789263697.509593:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883df4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:66a76ccf-c64c-4b18-8369-a2861ec3956c+4:10297:x1876178898036608:12345-0@lo:104: 00010000:00010000:3.0:1789263697.509594:0:6471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22800/0xce1582440fb1d7bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1d7c2 expref: -99 pid: 9477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263697.509602:0:6470:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff9dd981530e00/0xce1582440fb1d791 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1d798 expref: -99 pid: 9477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263697.509616:0:10297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1876178898036224:0@lo:104: 00010000:00010000:3.0:1789263697.509627:0:6471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:3.0:1789263697.509632:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883968700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:66a76ccf-c64c-4b18-8369-a2861ec3956c+4:10297:x1876178898036480:12345-0@lo:104: Request processed in 49us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263697.509634:0:10297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaaad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1876178898036352:0@lo:104: 00000100:00100000:3.0:1789263697.509641:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1789263697.509654:0:6470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to priority blp list, 9 blwis in pool 00000100:00100000:2.0:1789263697.509659:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883df4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:66a76ccf-c64c-4b18-8369-a2861ec3956c+3:10297:x1876178898036608:12345-0@lo:104: Request processed in 69us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263697.509662:0:10297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88396aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1876178898036480:0@lo:104: 00000100:00100000:2.0:1789263697.509668:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789263697.509678:0:10297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88396ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1876178898036608:0@lo:104: 00010000:00010000:2.0:1789263697.509704:0:7427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:2.0:1789263697.509709:0:7427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd990433000/0xce1582440fb1d8a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1d8a9 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263697.509714:0:7427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd990433000 already unused, calling callback (ffffffffc12b1c20) 10000000:00010000:2.0:1789263697.509717:0:7427:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd990433000/0xce1582440fb1d8a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xce1582440fb1d8a9 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263697.509722:0:7427:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd990433000/0xce1582440fb1d8a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xce1582440fb1d8a9 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789263697.509727:0:7427:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd990433000/0xce1582440fb1d8a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xce1582440fb1d8a9 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789263697.509730:0:7427:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789263697.509797:0:7427:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff9dd990433000/0xce1582440fb1d8a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d8a9 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263697.509804:0:7427:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789263697.509826:0:7427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd990433000/0xce1582440fb1d8a2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d8a9 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263697.509833:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd990433000/0xce1582440fb1d8a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d8a9 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263697.509842:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1789263697.509857:0:7427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00000100:00100000:1.0:1789263697.509859:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:66a76ccf-c64c-4b18-8369-a2861ec3956c:3621:1876178898036736:0@lo:103: 00010000:00010000:2.0:1789263697.509862:0:7427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23800/0xce1582440fb1d878 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1d87f expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263697.509870:0:7427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bfa23800 already unused, calling callback (ffffffffc12b1c20) 10000000:00010000:2.0:1789263697.509873:0:7427:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23800/0xce1582440fb1d878 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xce1582440fb1d87f expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263697.509880:0:7427:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23800/0xce1582440fb1d878 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xce1582440fb1d87f expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789263697.509888:0:7427:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23800/0xce1582440fb1d878 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xce1582440fb1d87f expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263697.509895:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:2.0:1789263697.509900:0:7427:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789263697.509927:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898036736 00000100:00100000:3.0:1789263697.509932:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898036736 00010000:00010000:3.0:1789263697.509952:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd990432e00/0xce1582440fb1d8a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1d8a2 expref: 24 pid: 6482 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263697.509982:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789263697.509986:0:10297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaaa300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1876178898035328:192.168.203.20@tcp:104: 00000100:00100000:3.0:1789263697.509993:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883968700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a76ccf-c64c-4b18-8369-a2861ec3956c+24:3621:x1876178898036736:12345-0@lo:103: 00010000:00010000:3.0:1789263697.510003:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789263697.510007:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd990432e00/0xce1582440fb1d8a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1d8a2 expref: 24 pid: 6482 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263697.510013:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd990432e00/0xce1582440fb1d8a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce1582440fb1d8a2 expref: 24 pid: 6482 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263697.510038:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd990432e00/0xce1582440fb1d8a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce1582440fb1d8a2 expref: 24 pid: 6482 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263697.510051:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789263697.510056:0:7427:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23800/0xce1582440fb1d878 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d87f expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263697.510063:0:7427:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789263697.510099:0:7427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23800/0xce1582440fb1d878 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d87f expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263697.510111:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23800/0xce1582440fb1d878 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d87f expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263697.510111:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:66a76ccf-c64c-4b18-8369-a2861ec3956c:3621:1876178898036864:0@lo:103: 00010000:00010000:2.0:1789263697.510128:0:7427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1789263697.510131:0:7427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22a00/0xce1582440fb1d85c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1d863 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263697.510148:0:7427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bfa22a00 already unused, calling callback (ffffffffc12b1c20) 10000000:00010000:2.0:1789263697.510151:0:7427:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22a00/0xce1582440fb1d85c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xce1582440fb1d863 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263697.510156:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883968700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a76ccf-c64c-4b18-8369-a2861ec3956c+23:3621:x1876178898036736:12345-0@lo:103: Request processed in 165us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263697.510164:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789263697.510165:0:7427:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22a00/0xce1582440fb1d85c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xce1582440fb1d863 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263697.510174:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 10000000:00010000:2.0:1789263697.510177:0:7427:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22a00/0xce1582440fb1d85c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xce1582440fb1d863 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789263697.510193:0:7427:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789263697.510205:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898036864 00000100:00100000:3.0:1789263697.510211:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898036864 00010000:00010000:2.0:1789263697.510219:0:7427:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22a00/0xce1582440fb1d85c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d863 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263697.510227:0:7427:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789263697.510229:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd981530800/0xce1582440fb1d87f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1d878 expref: 23 pid: 6481 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263697.510231:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:66a76ccf-c64c-4b18-8369-a2861ec3956c:3621:1876178898036736:0@lo:103: 00010000:00010000:2.0:1789263697.510251:0:7427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22a00/0xce1582440fb1d85c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d863 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263697.510260:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22a00/0xce1582440fb1d85c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d863 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263697.510267:0:10297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1876178898035456:192.168.203.20@tcp:104: 00010000:00010000:2.0:1789263697.510271:0:7427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1789263697.510275:0:7427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd990432400/0xce1582440fb1d832 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1d839 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263697.510281:0:7427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd990432400 already unused, calling callback (ffffffffc12b1c20) 10000000:00010000:2.0:1789263697.510284:0:7427:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd990432400/0xce1582440fb1d832 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xce1582440fb1d839 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263697.510305:0:7427:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd990432400/0xce1582440fb1d832 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xce1582440fb1d839 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263697.510305:0:10297:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dd981682000/0xce1582440fb1d8fd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789263697.510325:0:7427:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd990432400/0xce1582440fb1d832 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xce1582440fb1d839 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789263697.510332:0:7427:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789263697.510347:0:7427:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff9dd990432400/0xce1582440fb1d832 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d839 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263697.510353:0:7427:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789263697.510359:0:7427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd990432400/0xce1582440fb1d832 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d839 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263697.510365:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd990432400/0xce1582440fb1d832 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d839 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263697.510374:0:7427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1789263697.510377:0:7427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd981531a00/0xce1582440fb1d816 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1d81d expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263697.510381:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:66a76ccf-c64c-4b18-8369-a2861ec3956c:3618:1876178898036992:0@lo:103: 00010000:00010000:2.0:1789263697.510383:0:7427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981531a00 already unused, calling callback (ffffffffc12b1c20) 10000000:00010000:2.0:1789263697.510386:0:7427:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd981531a00/0xce1582440fb1d816 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xce1582440fb1d81d expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263697.510392:0:7427:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd981531a00/0xce1582440fb1d816 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xce1582440fb1d81d expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789263697.510398:0:7427:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd981531a00/0xce1582440fb1d816 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xce1582440fb1d81d expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263697.510407:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:2.0:1789263697.510409:0:7427:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789263697.510423:0:7427:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff9dd981531a00/0xce1582440fb1d816 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d81d expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263697.510429:0:7427:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789263697.510430:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789263697.510434:0:7428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898036992 00000100:00100000:0.0:1789263697.510437:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:66a76ccf-c64c-4b18-8369-a2861ec3956c:3618:1876178898037120:0@lo:103: 00000100:00100000:1.0:1789263697.510440:0:7428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898036992 00010000:00010000:2.0:1789263697.510443:0:7427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd981531a00/0xce1582440fb1d816 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d81d expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263697.510455:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd981531a00/0xce1582440fb1d816 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d81d expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263697.510462:0:7428:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd981531200/0xce1582440fb1d863 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1d85c expref: 24 pid: 6480 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263697.510463:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789263697.510469:0:7427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789263697.510474:0:7427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22200/0xce1582440fb1d808 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1d80f expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263697.510476:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898037120 00000100:00100000:3.0:1789263697.510481:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898037120 00010000:00010000:2.0:1789263697.510483:0:7427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bfa22200 already unused, calling callback (ffffffffc12b1c20) 10000000:00010000:2.0:1789263697.510488:0:7427:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22200/0xce1582440fb1d808 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xce1582440fb1d80f expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263697.510495:0:7428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00010000:00010000:2.0:1789263697.510498:0:7427:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22200/0xce1582440fb1d808 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xce1582440fb1d80f expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263697.510499:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd9bfa22c00/0xce1582440fb1d839 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1d832 expref: 25 pid: 6481 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263697.510515:0:7428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882610a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a76ccf-c64c-4b18-8369-a2861ec3956c+25:3621:x1876178898036864:12345-0@lo:103: 10000000:00010000:2.0:1789263697.510518:0:7427:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22200/0xce1582440fb1d808 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xce1582440fb1d80f expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263697.510526:0:7428:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 10000000:01000000:2.0:1789263697.510527:0:7427:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789263697.510535:0:7428:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd981530800/0xce1582440fb1d87f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1d878 expref: 25 pid: 6481 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263697.510546:0:7427:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22200/0xce1582440fb1d808 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d80f expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263697.510547:0:7428:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd981530800/0xce1582440fb1d87f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce1582440fb1d878 expref: 25 pid: 6481 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263697.510564:0:7427:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789263697.510571:0:7428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd981530800/0xce1582440fb1d87f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce1582440fb1d878 expref: 25 pid: 6481 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263697.510579:0:7427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22200/0xce1582440fb1d808 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d80f expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263697.510582:0:7428:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789263697.510590:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22200/0xce1582440fb1d808 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d80f expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263697.510602:0:7427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789263697.510605:0:7427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23600/0xce1582440fb1d7fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1d801 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263697.510613:0:7428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882610a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a76ccf-c64c-4b18-8369-a2861ec3956c+24:3621:x1876178898036864:12345-0@lo:103: Request processed in 100us (451us total) trans 0 rc 0/0 00010000:00010000:2.0:1789263697.510615:0:7427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bfa23600 already unused, calling callback (ffffffffc12b1c20) 10000000:00010000:2.0:1789263697.510620:0:7427:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23600/0xce1582440fb1d7fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xce1582440fb1d801 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263697.510627:0:7427:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23600/0xce1582440fb1d7fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xce1582440fb1d801 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789263697.510634:0:7427:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23600/0xce1582440fb1d7fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xce1582440fb1d801 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789263697.510639:0:7427:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789263697.510652:0:7427:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23600/0xce1582440fb1d7fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d801 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263697.510658:0:7427:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789263697.510661:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1789263697.510669:0:7427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23600/0xce1582440fb1d7fa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d801 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263697.510670:0:7428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789263697.510673:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaa6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a76ccf-c64c-4b18-8369-a2861ec3956c+24:3618:x1876178898036992:12345-0@lo:103: 00000100:00100000:3.0:1789263697.510680:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00010000:00010000:2.0:1789263697.510681:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23600/0xce1582440fb1d7fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d801 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263697.510683:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789263697.510689:0:6473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd981531200/0xce1582440fb1d863 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1d85c expref: 23 pid: 6480 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263697.510694:0:7427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:3.0:1789263697.510695:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaa4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a76ccf-c64c-4b18-8369-a2861ec3956c+23:3618:x1876178898037120:12345-0@lo:103: 00010000:00010000:2.0:1789263697.510703:0:7427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22800/0xce1582440fb1d7bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1d7c2 expref: -99 pid: 9477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263697.510704:0:6473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd981531200/0xce1582440fb1d863 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce1582440fb1d85c expref: 23 pid: 6480 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263697.510711:0:7427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bfa22800 already unused, calling callback (ffffffffc12b1c20) 00010000:00010000:3.0:1789263697.510712:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 10000000:00010000:2.0:1789263697.510715:0:7427:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22800/0xce1582440fb1d7bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xce1582440fb1d7c2 expref: -99 pid: 9477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263697.510721:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd9bfa22c00/0xce1582440fb1d839 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1d832 expref: 23 pid: 6481 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263697.510724:0:7427:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22800/0xce1582440fb1d7bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xce1582440fb1d7c2 expref: -99 pid: 9477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263697.510728:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd981531200/0xce1582440fb1d863 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce1582440fb1d85c expref: 23 pid: 6480 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789263697.510737:0:7427:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22800/0xce1582440fb1d7bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xce1582440fb1d7c2 expref: -99 pid: 9477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263697.510741:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd9bfa22c00/0xce1582440fb1d839 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce1582440fb1d832 expref: 22 pid: 6481 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789263697.510747:0:7427:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789263697.510755:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789263697.510763:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd9bfa22c00/0xce1582440fb1d839 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce1582440fb1d832 expref: 22 pid: 6481 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263697.510764:0:7427:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22800/0xce1582440fb1d7bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d7c2 expref: -99 pid: 9477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263697.510777:0:7427:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789263697.510779:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaa6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a76ccf-c64c-4b18-8369-a2861ec3956c+22:3618:x1876178898036992:12345-0@lo:103: Request processed in 111us (371us total) trans 0 rc 0/0 00010000:00010000:2.0:1789263697.510782:0:7427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22800/0xce1582440fb1d7bb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d7c2 expref: -99 pid: 9477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263697.510791:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1789263697.510799:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22800/0xce1582440fb1d7bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d7c2 expref: -99 pid: 9477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263697.510806:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789263697.510810:0:7427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789263697.510814:0:7427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd981530e00/0xce1582440fb1d791 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1d798 expref: -99 pid: 9477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263697.510821:0:7427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981530e00 already unused, calling callback (ffffffffc12b1c20) 10000000:00010000:2.0:1789263697.510824:0:7427:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd981530e00/0xce1582440fb1d791 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xce1582440fb1d798 expref: -99 pid: 9477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263697.510831:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaa4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a76ccf-c64c-4b18-8369-a2861ec3956c+20:3618:x1876178898037120:12345-0@lo:103: Request processed in 143us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263697.510837:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:2.0:1789263697.510847:0:7427:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd981530e00/0xce1582440fb1d791 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xce1582440fb1d798 expref: -99 pid: 9477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789263697.510855:0:7427:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd981530e00/0xce1582440fb1d791 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xce1582440fb1d798 expref: -99 pid: 9477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789263697.510859:0:7427:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789263697.510873:0:7427:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff9dd981530e00/0xce1582440fb1d791 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d798 expref: -99 pid: 9477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263697.510879:0:7427:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789263697.510884:0:7427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd981530e00/0xce1582440fb1d791 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d798 expref: -99 pid: 9477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263697.510890:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd981530e00/0xce1582440fb1d791 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d798 expref: -99 pid: 9477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263697.510902:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789263697.510904:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789263697.510906:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789263697.510914:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789263697.510919:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789263697.510929:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:66a76ccf-c64c-4b18-8369-a2861ec3956c:3619:1876178898037632:0@lo:103: 00000100:00100000:2.0:1789263697.510955:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263697.510982:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789263697.510988:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:66a76ccf-c64c-4b18-8369-a2861ec3956c:3619:1876178898037504:0@lo:103: 00000100:00100000:1.0:1789263697.511000:0:7428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898037632 00000100:00100000:1.0:1789263697.511006:0:7428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898037632 00000100:00100000:2.0:1789263697.511014:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789263697.511025:0:7428:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd981530600/0xce1582440fb1d7c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1d7bb expref: 20 pid: 6480 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263697.511047:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:66a76ccf-c64c-4b18-8369-a2861ec3956c:3620:1876178898037248:0@lo:103: 00000100:00100000:1.0:1789263697.511058:0:7428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898037504 00000100:00100000:1.0:1789263697.511063:0:7428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898037504 00000100:00100000:0.0:1789263697.511068:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789263697.511096:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883f5c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a76ccf-c64c-4b18-8369-a2861ec3956c+21:3619:x1876178898037632:12345-0@lo:103: 00010000:00010000:1.0:1789263697.511100:0:7428:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd981531600/0xce1582440fb1d801 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1d7fa expref: 21 pid: 6481 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263697.511107:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789263697.511111:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789263697.511116:0:6473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd981530600/0xce1582440fb1d7c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1d7bb expref: 21 pid: 6480 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263697.511126:0:6473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd981530600/0xce1582440fb1d7c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce1582440fb1d7bb expref: 21 pid: 6480 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263697.511139:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd981530600/0xce1582440fb1d7c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce1582440fb1d7bb expref: 21 pid: 6480 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263697.511145:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:66a76ccf-c64c-4b18-8369-a2861ec3956c:3620:1876178898037760:0@lo:103: 00010000:00010000:0.0:1789263697.511153:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789263697.511155:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263697.511182:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:66a76ccf-c64c-4b18-8369-a2861ec3956c:3618:1876178898037120:0@lo:103: 00000100:00100000:0.0:1789263697.511204:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883f5c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a76ccf-c64c-4b18-8369-a2861ec3956c+20:3619:x1876178898037632:12345-0@lo:103: Request processed in 126us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263697.511205:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:66a76ccf-c64c-4b18-8369-a2861ec3956c:3618:1876178898036992:0@lo:103: 00000100:00100000:0.0:1789263697.511217:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789263697.511231:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:66a76ccf-c64c-4b18-8369-a2861ec3956c:3619:1876178898037632:0@lo:103: 00000100:00100000:2.0:1789263697.511245:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:66a76ccf-c64c-4b18-8369-a2861ec3956c:3621:1876178898037376:0@lo:103: 00000100:00100000:1.0:1789263697.511306:0:7428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898037248 00000100:00100000:2.0:1789263697.511312:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888560512 00000100:00100000:1.0:1789263697.511312:0:7428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898037248 00000100:00100000:2.0:1789263697.511318:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888560512 00000100:00100000:0.0:1789263697.511323:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1789263697.511331:0:7428:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd981530c00/0xce1582440fb1d81d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1d816 expref: 20 pid: 6480 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263697.511333:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd987243c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a76ccf-c64c-4b18-8369-a2861ec3956c+20:3619:x1876178898037504:12345-0@lo:103: 00010000:00010000:2.0:1789263697.511338:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd990433a00/0xce1582440fb1d8be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11b57 expref: 10 pid: 6482 timeout: 239 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263697.511359:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789263697.511360:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263697.511363:0:7428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00010000:00010000:0.0:1789263697.511367:0:6473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd981531600/0xce1582440fb1d801 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1d7fa expref: 20 pid: 6481 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263697.511377:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888560640 00000100:00100000:2.0:1789263697.511379:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 26 00000100:00100000:1.0:1789263697.511383:0:7428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883f5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a76ccf-c64c-4b18-8369-a2861ec3956c+20:3620:x1876178898037248:12345-0@lo:103: 00000100:00100000:3.0:1789263697.511384:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888560640 00010000:00010000:0.0:1789263697.511389:0:6473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd981531600/0xce1582440fb1d801 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce1582440fb1d7fa expref: 20 pid: 6481 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263697.511395:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88397fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+11:2398:x1876178888560512:12345-192.168.203.20@tcp:103: 00010000:00010000:1.0:1789263697.511396:0:7428:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789263697.511405:0:7428:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd981530c00/0xce1582440fb1d81d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1d816 expref: 20 pid: 6480 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263697.511411:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789263697.511412:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd981531600/0xce1582440fb1d801 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce1582440fb1d7fa expref: 20 pid: 6481 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263697.511417:0:7428:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd981530c00/0xce1582440fb1d81d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce1582440fb1d816 expref: 20 pid: 6480 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263697.511420:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd990433a00/0xce1582440fb1d8be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11b57 expref: 11 pid: 6482 timeout: 239 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263697.511437:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789263697.511443:0:8409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd990432200/0xce1582440fb1d8b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11b50 expref: 11 pid: 6482 timeout: 239 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263697.511447:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd990433a00/0xce1582440fb1d8be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11b57 expref: 11 pid: 6482 timeout: 239 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263697.511450:0:7428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd981530c00/0xce1582440fb1d81d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce1582440fb1d816 expref: 19 pid: 6480 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263697.511468:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd987243c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a76ccf-c64c-4b18-8369-a2861ec3956c+19:3619:x1876178898037504:12345-0@lo:103: Request processed in 136us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263697.511469:0:8409:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 5 min 3 max 56 00010000:00010000:1.0:1789263697.511475:0:7428:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789263697.511476:0:8409:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_005' 00010000:00010000:2.0:1789263697.511476:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd990433a00/0xce1582440fb1d8be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11b57 expref: 11 pid: 6482 timeout: 239 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263697.511476:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1789263697.511491:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789263697.511526:0:7428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883f5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a76ccf-c64c-4b18-8369-a2861ec3956c+17:3620:x1876178898037248:12345-0@lo:103: Request processed in 147us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263697.511533:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88397fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+10:2398:x1876178888560512:12345-192.168.203.20@tcp:103: Request processed in 140us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263697.511534:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 27 00000100:00100000:1.0:1789263697.511544:0:7428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789263697.511549:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88397ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+10:2397:x1876178888560640:12345-192.168.203.20@tcp:103: 00000100:00100000:2.0:1789263697.511559:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 26 00010000:00010000:0.0:1789263697.511561:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789263697.511568:0:6473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd990432200/0xce1582440fb1d8b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11b50 expref: 10 pid: 6482 timeout: 239 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263697.511579:0:6473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd990432200/0xce1582440fb1d8b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11b50 expref: 9 pid: 6482 timeout: 239 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263697.511589:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd990432200/0xce1582440fb1d8b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11b50 expref: 9 pid: 6482 timeout: 239 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263697.511598:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789263697.511619:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88397ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+8:2397:x1876178888560640:12345-192.168.203.20@tcp:103: Request processed in 75us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263697.511626:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 27 00000100:00100000:2.0:1789263697.511651:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263697.511683:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:66a76ccf-c64c-4b18-8369-a2861ec3956c:3620:1876178898037248:0@lo:103: 00000100:00100000:1.0:1789263697.511689:0:7428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898037760 00000100:00100000:1.0:1789263697.511694:0:7428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898037760 00000100:00100000:2.0:1789263697.511711:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:66a76ccf-c64c-4b18-8369-a2861ec3956c:3619:1876178898037504:0@lo:103: 00010000:00010000:1.0:1789263697.511714:0:7428:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd981530400/0xce1582440fb1d798 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1d791 expref: 17 pid: 6480 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263697.511734:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263697.511748:0:7428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898037376 00000100:00100000:1.0:1789263697.511753:0:7428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898037376 00000100:00100000:2.0:1789263697.511759:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:66a76ccf-c64c-4b18-8369-a2861ec3956c:3621:1876178898036864:0@lo:103: 00010000:00010000:1.0:1789263697.511771:0:7428:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd981530200/0xce1582440fb1d80f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1d808 expref: 18 pid: 6481 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263697.511786:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789263697.511793:0:7428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789263697.511798:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883f5f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a76ccf-c64c-4b18-8369-a2861ec3956c+18:3620:x1876178898037760:12345-0@lo:103: 00000100:00100000:1.0:1789263697.511806:0:7428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883f5df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a76ccf-c64c-4b18-8369-a2861ec3956c+18:3621:x1876178898037376:12345-0@lo:103: 00010000:00010000:2.0:1789263697.511808:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789263697.511815:0:6473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd981530400/0xce1582440fb1d798 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1d791 expref: 18 pid: 6480 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263697.511817:0:7428:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789263697.511826:0:7428:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd981530200/0xce1582440fb1d80f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1d808 expref: 18 pid: 6481 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263697.511830:0:6473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd981530400/0xce1582440fb1d798 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce1582440fb1d791 expref: 18 pid: 6480 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263697.511848:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd981530400/0xce1582440fb1d798 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce1582440fb1d791 expref: 18 pid: 6480 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263697.511858:0:7428:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd981530200/0xce1582440fb1d80f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce1582440fb1d808 expref: 17 pid: 6481 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263697.511866:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789263697.511874:0:7428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd981530200/0xce1582440fb1d80f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce1582440fb1d808 expref: 17 pid: 6481 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263697.511888:0:7428:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dd981682000/0xce1582440fb1d8fd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263697.511896:0:7428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd981682000/0xce1582440fb1d8fd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263697.511902:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883f5f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a76ccf-c64c-4b18-8369-a2861ec3956c+16:3620:x1876178898037760:12345-0@lo:103: Request processed in 106us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263697.511911:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:1.0:1789263697.511915:0:7428:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd981682000/0xce1582440fb1d8fd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263697.511924:0:7428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd981682000/0xce1582440fb1d8fd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263697.511931:0:7428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dd981682000/0xce1582440fb1d8fd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263697.511938:0:7428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dd981682000/0xce1582440fb1d8fd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263697.511944:0:7428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981682000 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263697.511948:0:7428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dd981682000/0xce1582440fb1d8fd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263697.511955:0:7428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dd981682000/0xce1582440fb1d8fd lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263697.511983:0:7428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dd981682000/0xce1582440fb1d8fd lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263697.511994:0:7428:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789263697.512007:0:10297:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dd981682000/0xce1582440fb1d8fd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263697.512024:0:10297:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dd981682000/0xce1582440fb1d8fd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263697.512033:0:7428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883f5df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a76ccf-c64c-4b18-8369-a2861ec3956c+15:3621:x1876178898037376:12345-0@lo:103: Request processed in 228us (298us total) trans 0 rc 0/0 00010000:00010000:0.0:1789263697.512033:0:10297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd981682000/0xce1582440fb1d8fd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263697.512050:0:7428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789263697.512063:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:66a76ccf-c64c-4b18-8369-a2861ec3956c:3621:1876178898037376:0@lo:103: 00000100:00100000:3.0:1789263697.512341:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:66a76ccf-c64c-4b18-8369-a2861ec3956c:3620:1876178898037760:0@lo:103: 00000100:00100000:0.0:1789263697.874697:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263697.874767:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888560768 00000100:00100000:1.0:1789263697.874776:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888560768 00000100:00100000:1.0:1789263697.874827:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 174 00000100:00100000:1.0:1789263697.874837:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+8:6155:x1876178888560768:12345-192.168.203.20@tcp:101: 00010000:00010000:1.0:1789263697.874853:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263697.874877:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd981682000/0xce1582440fb1d904 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11bc7 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263697.874906:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd981682000/0xce1582440fb1d904 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11bc7 expref: 9 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263697.874917:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd981682000/0xce1582440fb1d904 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11bc7 expref: 9 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263697.874925:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981682000, rc 0) 00000100:00100000:1.0:1789263697.874987:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+9:6155:x1876178888560768:12345-192.168.203.20@tcp:101: Request processed in 151us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263697.874994:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 174 00000100:00100000:2.0:1789263697.876068:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263697.876269:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888560896 00000100:00100000:1.0:1789263697.876283:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888560896 00000100:00100000:1.0:1789263697.876342:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 175 00000100:00100000:1.0:1789263697.876367:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+9:6155:x1876178888560896:12345-192.168.203.20@tcp:501: 00000100:00100000:1.0:1789263697.876527:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+9:6155:x1876178888560896:12345-192.168.203.20@tcp:501: Request processed in 163us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263697.876533:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 175 00000100:00100000:3.0:1789263697.877482:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263697.877544:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888561024 00000100:00100000:1.0:1789263697.877556:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888561024 00000100:00100000:1.0:1789263697.877613:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 176 00000100:00100000:1.0:1789263697.877624:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+9:6155:x1876178888561024:12345-192.168.203.20@tcp:503: 00000100:00100000:1.0:1789263697.877741:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+9:6155:x1876178888561024:12345-192.168.203.20@tcp:503: Request processed in 119us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263697.877749:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 176 00000100:00100000:0.0:1789263697.879485:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263697.879574:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888561152 00000100:00100000:1.0:1789263697.879587:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888561152 00000100:00100000:1.0:1789263697.879659:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 177 00000100:00100000:1.0:1789263697.879674:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+9:6630:x1876178888561152:12345-192.168.203.20@tcp:502: 00000100:00100000:1.0:1789263697.879851:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+9:6630:x1876178888561152:12345-192.168.203.20@tcp:502: Request processed in 181us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263697.879869:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 177 00000100:00100000:2.0:1789263697.881378:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263697.881565:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888561280 00000100:00100000:1.0:1789263697.881574:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888561280 00000100:00100000:1.0:1789263697.881615:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 178 00000100:00100000:1.0:1789263697.881621:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+9:6630:x1876178888561280:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789263697.881756:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+9:6630:x1876178888561280:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 133us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263697.881764:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 178 00000100:00100000:3.0:1789263697.884463:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263697.884522:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888561408 00000100:00100000:1.0:1789263697.884531:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888561408 00000100:00100000:1.0:1789263697.884568:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 179 00000100:00100000:1.0:1789263697.884575:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c2072c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+9:6155:x1876178888561408:12345-192.168.203.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789263697.884587:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263697.884601:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd981683400/0xce1582440fb1d90b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11bce expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263697.884629:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd981683400/0xce1582440fb1d90b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11bce expref: 10 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263697.884640:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd981683400/0xce1582440fb1d90b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11bce expref: 10 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263697.884649:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981683400, rc 0) 00000100:00100000:1.0:1789263697.884707:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c2072c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+10:6155:x1876178888561408:12345-192.168.203.20@tcp:101:ll_cfg_requeue.0 Request processed in 131us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263697.884714:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 179 00000100:00100000:0.0:1789263697.885607:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263697.885653:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888561536 00000100:00100000:1.0:1789263697.885660:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888561536 00000100:00100000:1.0:1789263697.885688:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 180 00000100:00100000:1.0:1789263697.885695:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd991565c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+10:6155:x1876178888561536:12345-192.168.203.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789263697.885782:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd991565c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+10:6155:x1876178888561536:12345-192.168.203.20@tcp:501:ll_cfg_requeue.0 Request processed in 86us (177us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789263697.885790:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 180 00010000:00010000:2.0:1789263698.349258:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789263698.362646:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263698.362703:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263698.362734:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888561664 00000100:00100000:1.0:1789263698.362748:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888561664 00000100:00100000:2.0:1789263698.362758:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263698.362792:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263698.362826:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263698.362839:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 181 00000100:00100000:1.0:1789263698.362852:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd991566050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+10:2398:x1876178888561664:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1789263698.362944:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd991566050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+10:2398:x1876178888561664:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 94us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263698.362955:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 181 00000100:00100000:0.0:1789263698.362960:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888561920 00000100:00100000:0.0:1789263698.362982:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888561920 00000100:00100000:3.0:1789263698.362987:0:8395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888562176 00000100:00100000:3.0:1789263698.363004:0:8395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888562176 00000100:00100000:1.0:1789263698.363028:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888561792 00000100:00100000:1.0:1789263698.363034:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888561792 00000100:00100000:3.0:1789263698.363065:0:8395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888562048 00000100:00100000:3.0:1789263698.363071:0:8395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888562048 00000100:00100000:1.0:1789263698.363158:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 29 00000100:00100000:3.0:1789263698.363163:0:8395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 10 00000100:00100000:1.0:1789263698.363171:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883f5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+5:2398:x1876178888561920:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789263698.363189:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 30 00000100:00100000:0.0:1789263698.363210:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883f5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+6:2398:x1876178888561792:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1789263698.363231:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883f5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+5:2398:x1876178888561920:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 61us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263698.363240:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 29 00000100:00080000:1.0:1789263698.363292:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789263698.363299:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789263698.363300:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883f5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+6:2398:x1876178888561792:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 95us (503us total) trans 0 rc 0/0 00000100:00080000:1.0:1789263698.363303:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789263698.363309:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789263698.363318:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 30 00000100:00100000:1.0:1789263698.363384:0:8511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 11 00000100:00100000:3.0:1789263698.363389:0:8395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883f5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+5:2398:x1876178888562176:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1789263698.363416:0:8511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883f5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+6:2398:x1876178888562048:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1789263698.363595:0:8511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883f5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+6:2398:x1876178888562048:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 196us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263698.363607:0:8511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 11 00000100:00100000:3.0:1789263698.363701:0:8395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883f5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+5:2398:x1876178888562176:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 315us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263698.363720:0:8395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 10 00000001:00100000:0.0:1789263698.478218:0:8388:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3ce90ea2-917f-4b54-98b0-25e051f2317f 00000020:00000080:3.0:1789263698.921933:0:10351:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd9df5f190 20000000:00000080:3.0:1789263698.921947:0:10351:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9dd88386c400 uarg=0000000000000000 20000000:01000000:3.0:1789263698.921993:0:10351:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789263698.921999:0:10351:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789263698.922004:0:10351:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1789263698.922373:0:10352:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1789263698.922454:0:10351:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1789263698.925503:0:10351:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1789263698.925541:0:10351:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1789263698.925559:0:10351:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1789263698.925575:0:10351:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789263698.925594:0:10351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dd981682200/0xce1582440fb1d912 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263698.925623:0:10351:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd9813fd000/0xce1582440fb1d656 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d64f expref: 14 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263698.925631:0:10351:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd9813fc400/0xce1582440fb1d6e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d6e2 expref: 14 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263698.925637:0:10351:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd9bfa23a00/0xce1582440fb1d759 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d752 expref: 14 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263698.925643:0:10351:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd9bfa22e00/0xce1582440fb1d7b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d7ad expref: 14 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263698.925652:0:10351:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd981683c00/0xce1582440fb1d8cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11b8f expref: 9 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263698.925659:0:10351:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dd981682200/0xce1582440fb1d912 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263698.925695:0:10351:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd981683c00/0xce1582440fb1d8cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11b8f expref: 9 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263698.925711:0:10351:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dd981683c00/0xce1582440fb1d8cc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11b8f expref: 9 pid: 6482 timeout: 241 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263698.925725:0:10351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882613b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10351:1876178898037888:192.168.203.20@tcp:104: 00010000:00010000:1.0:1789263698.925830:0:10351:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd9bfa22e00/0xce1582440fb1d7b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce1582440fb1d7ad expref: 14 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263698.925839:0:10351:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dd9bfa22e00/0xce1582440fb1d7b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce1582440fb1d7ad expref: 14 pid: 6482 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263698.925856:0:10351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882612a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10351:1876178898038016:0@lo:104: 00000100:00100000:1.0:1789263698.925900:0:10351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789263698.925961:0:10351:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd9bfa23a00/0xce1582440fb1d759 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce1582440fb1d752 expref: 14 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263698.925969:0:9488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898038016 00010000:00010000:1.0:1789263698.925972:0:10351:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dd9bfa23a00/0xce1582440fb1d759 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce1582440fb1d752 expref: 14 pid: 6482 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263698.925979:0:9488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898038016 00000100:00100000:1.0:1789263698.925985:0:10351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882612d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10351:1876178898038144:0@lo:104: 00000100:00100000:1.0:1789263698.926018:0:10351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263698.926349:0:9488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898038144 00000100:00100000:0.0:1789263698.926356:0:9488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898038144 00000100:00100000:2.0:1789263698.926381:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789263698.926407:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882612300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:66a76ccf-c64c-4b18-8369-a2861ec3956c+4:10351:x1876178898038016:12345-0@lo:104: 00000100:00100000:0.0:1789263698.926415:0:9488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00010000:00010000:1.0:1789263698.926419:0:10351:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd9813fc400/0xce1582440fb1d6e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce1582440fb1d6e2 expref: 14 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263698.926434:0:10351:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dd9813fc400/0xce1582440fb1d6e9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce1582440fb1d6e2 expref: 14 pid: 6482 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263698.926436:0:9488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882612680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:66a76ccf-c64c-4b18-8369-a2861ec3956c+4:10351:x1876178898038144:12345-0@lo:104: 00010000:00010000:2.0:1789263698.926442:0:6470:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff9dd981683a00/0xce1582440fb1d7ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1d7b4 expref: -99 pid: 9477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263698.926459:0:9488:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff9dd9813fd600/0xce1582440fb1d752 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1d759 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263698.926460:0:10351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882611180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10351:1876178898038272:0@lo:104: 00000100:00100000:1.0:1789263698.926506:0:10351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789263698.926540:0:10351:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd9813fd000/0xce1582440fb1d656 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce1582440fb1d64f expref: 14 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263698.926549:0:10351:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dd9813fd000/0xce1582440fb1d656 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce1582440fb1d64f expref: 14 pid: 6481 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263698.926553:0:6470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789263698.926559:0:10351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882613480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10351:1876178898038400:0@lo:104: 00000100:00100000:2.0:1789263698.926568:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882612300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:66a76ccf-c64c-4b18-8369-a2861ec3956c+4:10351:x1876178898038016:12345-0@lo:104: Request processed in 167us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263698.926587:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789263698.926601:0:10351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263698.926615:0:10351:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd883e4e300 going to sleep for 11 seconds 00000100:00100000:1.0:1789263698.926636:0:10351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882612a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10351:1876178898038016:0@lo:104: 00010000:00010000:1.0:1789263698.926846:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263698.926853:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd981683a00/0xce1582440fb1d7ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1d7b4 expref: -99 pid: 9477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263698.926862:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981683a00 already unused, calling callback (ffffffffc12b1c20) 10000000:00010000:1.0:1789263698.926867:0:6476:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd981683a00/0xce1582440fb1d7ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xce1582440fb1d7b4 expref: -99 pid: 9477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263698.926875:0:6476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd981683a00/0xce1582440fb1d7ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xce1582440fb1d7b4 expref: -99 pid: 9477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789263698.926883:0:6476:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd981683a00/0xce1582440fb1d7ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xce1582440fb1d7b4 expref: -99 pid: 9477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263698.926887:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898038272 10000000:01000000:1.0:1789263698.926892:0:6476:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1789263698.926893:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898038272 00010000:00010000:1.0:1789263698.926929:0:6476:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff9dd981683a00/0xce1582440fb1d7ad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d7b4 expref: -99 pid: 9477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263698.926936:0:6476:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789263698.926955:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898038400 00000100:00100000:2.0:1789263698.926963:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898038400 00010000:00010000:1.0:1789263698.926964:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd981683a00/0xce1582440fb1d7ad lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d7b4 expref: -99 pid: 9477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263698.926975:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd981683a00/0xce1582440fb1d7ad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d7b4 expref: -99 pid: 9477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263698.926980:0:9488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1789263698.926991:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263698.926996:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd9813fd600/0xce1582440fb1d752 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1d759 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263698.927004:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789263698.927007:0:9488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882612680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:66a76ccf-c64c-4b18-8369-a2861ec3956c+5:10351:x1876178898038144:12345-0@lo:104: Request processed in 564us (976us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263698.927017:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882611500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:66a76ccf-c64c-4b18-8369-a2861ec3956c+5:10351:x1876178898038400:12345-0@lo:104: 00010000:00010000:2.0:1789263698.927040:0:6470:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff9dd990433800/0xce1582440fb1d64f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1d656 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263698.927041:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9813fd600 already unused, calling callback (ffffffffc12b1c20) 00000100:00100000:0.0:1789263698.927042:0:9488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 10000000:00010000:1.0:1789263698.927054:0:6476:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd9813fd600/0xce1582440fb1d752 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xce1582440fb1d759 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263698.927112:0:6476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd9813fd600/0xce1582440fb1d752 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xce1582440fb1d759 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789263698.927122:0:6476:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd9813fd600/0xce1582440fb1d752 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xce1582440fb1d759 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789263698.927128:0:6476:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789263698.927145:0:6470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789263698.927152:0:10351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882612d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10351:1876178898038144:0@lo:104: 00010000:00010000:1.0:1789263698.927155:0:6476:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff9dd9813fd600/0xce1582440fb1d752 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d759 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263698.927157:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882611500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:66a76ccf-c64c-4b18-8369-a2861ec3956c+4:10351:x1876178898038400:12345-0@lo:104: Request processed in 139us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263698.927189:0:10351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882613480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10351:1876178898038400:0@lo:104: 00000100:00100000:2.0:1789263698.927195:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:1.0:1789263698.927209:0:6476:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789263698.927247:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882610380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:66a76ccf-c64c-4b18-8369-a2861ec3956c:3621:1876178898038528:0@lo:103: 00010000:00010000:1.0:1789263698.927249:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd9813fd600/0xce1582440fb1d752 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d759 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263698.927263:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882610000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:66a76ccf-c64c-4b18-8369-a2861ec3956c:3618:1876178898038656:0@lo:103: 00010000:00010000:1.0:1789263698.927265:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd9813fd600/0xce1582440fb1d752 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d759 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263698.927283:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263698.927287:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd990433800/0xce1582440fb1d64f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1d656 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263698.927292:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd990433800 already unused, calling callback (ffffffffc12b1c20) 10000000:00010000:1.0:1789263698.927296:0:6476:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd990433800/0xce1582440fb1d64f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xce1582440fb1d656 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263698.927303:0:6476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd990433800/0xce1582440fb1d64f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xce1582440fb1d656 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263698.927316:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789263698.927319:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:1.0:1789263698.927322:0:6476:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd990433800/0xce1582440fb1d64f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xce1582440fb1d656 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263698.927328:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789263698.927338:0:6476:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789263698.927363:0:6476:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff9dd990433800/0xce1582440fb1d64f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d656 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263698.927364:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898038528 00000100:00100000:0.0:1789263698.927371:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898038528 00010000:00010000:1.0:1789263698.927372:0:6476:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789263698.927384:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd990433800/0xce1582440fb1d64f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d656 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263698.927391:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd990433800/0xce1582440fb1d64f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d656 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263698.927407:0:6472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd9bfa22e00/0xce1582440fb1d7b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1d7ad expref: 15 pid: 6482 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263698.927413:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263698.927420:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263698.927426:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789263698.927459:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263698.927460:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789263698.927463:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882611880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:66a76ccf-c64c-4b18-8369-a2861ec3956c:3619:1876178898038784:0@lo:103: 00000100:00100000:0.0:1789263698.927475:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883f5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a76ccf-c64c-4b18-8369-a2861ec3956c+15:3621:x1876178898038528:12345-0@lo:103: 00010000:00010000:0.0:1789263698.927490:0:6472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789263698.927496:0:6472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd9bfa22e00/0xce1582440fb1d7b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1d7ad expref: 15 pid: 6482 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263698.927510:0:6472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd9bfa22e00/0xce1582440fb1d7b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce1582440fb1d7ad expref: 15 pid: 6482 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263698.927514:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789263698.927530:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd9bfa22e00/0xce1582440fb1d7b4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce1582440fb1d7ad expref: 15 pid: 6482 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263698.927536:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898038656 00000100:00100000:2.0:1789263698.927545:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898038656 00010000:00010000:0.0:1789263698.927547:0:6472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789263698.927571:0:6473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd9bfa23a00/0xce1582440fb1d759 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1d752 expref: 15 pid: 6482 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263698.927593:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898038784 00000100:00100000:1.0:1789263698.927601:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898038784 00000100:00100000:0.0:1789263698.927602:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883f5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a76ccf-c64c-4b18-8369-a2861ec3956c+15:3621:x1876178898038528:12345-0@lo:103: Request processed in 131us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263698.927611:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00010000:00010000:1.0:1789263698.927627:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd9813fd000/0xce1582440fb1d656 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1d64f expref: 16 pid: 6481 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263698.927629:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd987241c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a76ccf-c64c-4b18-8369-a2861ec3956c+16:3618:x1876178898038656:12345-0@lo:103: 00010000:00010000:2.0:1789263698.927651:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789263698.927660:0:6473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd9bfa23a00/0xce1582440fb1d759 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1d752 expref: 16 pid: 6482 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263698.927672:0:6473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd9bfa23a00/0xce1582440fb1d759 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce1582440fb1d752 expref: 16 pid: 6482 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263698.927693:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd9bfa23a00/0xce1582440fb1d759 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce1582440fb1d752 expref: 16 pid: 6482 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263698.927711:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789263698.927765:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd987241c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a76ccf-c64c-4b18-8369-a2861ec3956c+15:3618:x1876178898038656:12345-0@lo:103: Request processed in 144us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263698.927775:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789263698.927797:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789263698.927798:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789263698.927819:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882611f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:66a76ccf-c64c-4b18-8369-a2861ec3956c+3:10351:x1876178898038272:12345-0@lo:104: 00010000:00010000:3.0:1789263698.927832:0:6471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff9dd981682600/0xce1582440fb1d6e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1d6e9 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263698.927845:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789263698.927859:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882610700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a76ccf-c64c-4b18-8369-a2861ec3956c+13:3619:x1876178898038784:12345-0@lo:103: 00010000:00010000:1.0:1789263698.927872:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789263698.927879:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd9813fd000/0xce1582440fb1d656 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1d64f expref: 13 pid: 6481 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263698.927893:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd9813fd000/0xce1582440fb1d656 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce1582440fb1d64f expref: 13 pid: 6481 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263698.927912:0:6471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789263698.927914:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882610000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:66a76ccf-c64c-4b18-8369-a2861ec3956c:3618:1876178898038656:0@lo:103: 00010000:00010000:1.0:1789263698.927921:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd9813fd000/0xce1582440fb1d656 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce1582440fb1d64f expref: 13 pid: 6481 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263698.927929:0:10351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882611180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10351:1876178898038272:0@lo:104: 00010000:00010000:1.0:1789263698.927939:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789263698.927974:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882610380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:66a76ccf-c64c-4b18-8369-a2861ec3956c:3621:1876178898038528:0@lo:103: 00000100:00100000:3.0:1789263698.927989:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882611f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:66a76ccf-c64c-4b18-8369-a2861ec3956c+3:10351:x1876178898038272:12345-0@lo:104: Request processed in 175us (1481us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263698.927997:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882610700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a76ccf-c64c-4b18-8369-a2861ec3956c+12:3619:x1876178898038784:12345-0@lo:103: Request processed in 138us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263698.928003:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789263698.928011:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:3.0:1789263698.928030:0:7427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789263698.928037:0:7427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd981682600/0xce1582440fb1d6e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1d6e9 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263698.928039:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882611880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:66a76ccf-c64c-4b18-8369-a2861ec3956c:3619:1876178898038784:0@lo:103: 00010000:00010000:3.0:1789263698.928045:0:7427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981682600 already unused, calling callback (ffffffffc12b1c20) 10000000:00010000:3.0:1789263698.928049:0:7427:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd981682600/0xce1582440fb1d6e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xce1582440fb1d6e9 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263698.928057:0:7427:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd981682600/0xce1582440fb1d6e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xce1582440fb1d6e9 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789263698.928064:0:7427:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd981682600/0xce1582440fb1d6e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xce1582440fb1d6e9 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789263698.928070:0:7427:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789263698.928134:0:7427:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff9dd981682600/0xce1582440fb1d6e2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d6e9 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263698.928141:0:7427:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789263698.928162:0:7427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd981682600/0xce1582440fb1d6e2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d6e9 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263698.928169:0:10351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882613b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10351:1876178898037888:192.168.203.20@tcp:104: 00000100:00100000:0.0:1789263698.928187:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:66a76ccf-c64c-4b18-8369-a2861ec3956c:3620:1876178898038912:0@lo:103: 00000100:00100000:2.0:1789263698.928191:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00010000:00010000:3.0:1789263698.928203:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd981682600/0xce1582440fb1d6e2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d6e9 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263698.928231:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263698.928233:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263698.928238:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789263698.928239:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789263698.928252:0:10351:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dd981682200/0xce1582440fb1d912 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263698.928292:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888562304 00000100:00100000:1.0:1789263698.928297:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888562304 00000100:00100000:0.0:1789263698.928306:0:10303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898038912 00000100:00100000:0.0:1789263698.928312:0:10303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898038912 00010000:00010000:1.0:1789263698.928315:0:6472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd981683c00/0xce1582440fb1d8cc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11b8f expref: 10 pid: 6482 timeout: 241 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263698.928330:0:10303:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd9813fc400/0xce1582440fb1d6e9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1d6e2 expref: 12 pid: 6482 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263698.928340:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 33 00000100:00100000:1.0:1789263698.928351:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883f5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+10:2397:x1876178888562304:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789263698.928360:0:6472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789263698.928365:0:6472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd981683c00/0xce1582440fb1d8cc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11b8f expref: 10 pid: 6482 timeout: 241 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263698.928375:0:10303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00010000:00010000:1.0:1789263698.928383:0:6472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd981683c00/0xce1582440fb1d8cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11b8f expref: 10 pid: 6482 timeout: 241 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263698.928388:0:10303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaa6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a76ccf-c64c-4b18-8369-a2861ec3956c+12:3620:x1876178898038912:12345-0@lo:103: 00010000:00010000:0.0:1789263698.928402:0:10303:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789263698.928405:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd981683c00/0xce1582440fb1d8cc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11b8f expref: 10 pid: 6482 timeout: 241 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263698.928409:0:10303:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd9813fc400/0xce1582440fb1d6e9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1d6e2 expref: 12 pid: 6482 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263698.928425:0:10303:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd9813fc400/0xce1582440fb1d6e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce1582440fb1d6e2 expref: 12 pid: 6482 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263698.928445:0:10303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd9813fc400/0xce1582440fb1d6e9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce1582440fb1d6e2 expref: 12 pid: 6482 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263698.928447:0:6472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dd981682200/0xce1582440fb1d912 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263698.928457:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd981682200/0xce1582440fb1d912 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263698.928466:0:10303:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789263698.928468:0:6472:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd981682200/0xce1582440fb1d912 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263698.928476:0:6472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd981682200/0xce1582440fb1d912 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263698.928483:0:6472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dd981682200/0xce1582440fb1d912 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263698.928490:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dd981682200/0xce1582440fb1d912 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263698.928496:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981682200 already unused, calling callback (ffffffffc0cc9350) 00000100:00100000:0.0:1789263698.928501:0:10303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaa6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:66a76ccf-c64c-4b18-8369-a2861ec3956c+11:3620:x1876178898038912:12345-0@lo:103: Request processed in 117us (262us total) trans 0 rc 0/0 00010000:00010000:1.0:1789263698.928502:0:6472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dd981682200/0xce1582440fb1d912 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263698.928519:0:6472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dd981682200/0xce1582440fb1d912 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263698.928520:0:10303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789263698.928539:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:66a76ccf-c64c-4b18-8369-a2861ec3956c:3620:1876178898038912:0@lo:103: 00010000:00010000:1.0:1789263698.928555:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dd981682200/0xce1582440fb1d912 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263698.928568:0:6472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789263698.928613:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883f5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+9:2397:x1876178888562304:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 263us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263698.928627:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 33 00010000:00010000:3.0:1789263698.928686:0:10351:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dd981682200/0xce1582440fb1d912 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263698.928694:0:10351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dd981682200/0xce1582440fb1d912 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263698.928701:0:10351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd981682200/0xce1582440fb1d912 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789263698.934153:0:6484:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789263698.934159:0:6484:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9dd882a29800 from 48 10000000:01000000:0.0:1789263698.934163:0:6484:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789263698.934217:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd990432400/0xce1582440fb1d919 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263698.934234:0:6484:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd990432400/0xce1582440fb1d919 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263698.934246:0:6484:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd990432400/0xce1582440fb1d919 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263698.934269:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898039040:0@lo:101: 00000100:00100000:0.0:1789263698.934335:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263698.934376:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9c0be3cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789263698.934386:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898039040 00000100:00100000:1.0:1789263698.934395:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898039040 00000100:00100000:1.0:1789263698.934460:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1789263698.934470:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd991565850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+11:6484:x1876178898039040:12345-0@lo:101: 00010000:00010000:1.0:1789263698.934484:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263698.934497:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd981683c00/0xce1582440fb1d920 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1d919 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263698.934522:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd981683c00/0xce1582440fb1d920 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1d919 expref: 12 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263698.934533:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd981683c00/0xce1582440fb1d920 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d919 expref: 12 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263698.934542:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981683c00, rc 0) 00000100:00100000:1.0:1789263698.934590:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd991565850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+12:6484:x1876178898039040:12345-0@lo:101: Request processed in 122us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263698.934597:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1789263698.934629:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898039040:0@lo:101: 00010000:00010000:0.0:1789263698.934642:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd990432400/0xce1582440fb1d919 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d920 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263698.934651:0:6484:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd990432400/0xce1582440fb1d919 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1d920 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263698.934709:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898039168:0@lo:501: 00000100:00100000:0.0:1789263698.934740:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263698.934761:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9c0be3cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789263698.934774:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898039168 00000100:00100000:3.0:1789263698.934779:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898039168 00000100:00100000:3.0:1789263698.934805:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1789263698.934810:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd991567050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+12:6484:x1876178898039168:12345-0@lo:501: 00000100:00100000:3.0:1789263698.934924:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd991567050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+12:6484:x1876178898039168:12345-0@lo:501: Request processed in 113us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263698.934938:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1789263698.934954:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898039168:0@lo:501: 00000100:00100000:0.0:1789263698.934982:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898039296:0@lo:503: 00000100:00100000:0.0:1789263698.935014:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263698.935035:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9c0be3cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789263698.935054:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898039296 00000100:00100000:1.0:1789263698.935060:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898039296 00000100:00100000:1.0:1789263698.935107:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1789263698.935114:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd991566850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+12:6484:x1876178898039296:12345-0@lo:503: 00000100:00100000:1.0:1789263698.935202:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd991566850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+12:6484:x1876178898039296:12345-0@lo:503: Request processed in 88us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263698.935209:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1789263698.935232:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898039296:0@lo:503: 00000100:00100000:0.0:1789263698.935584:0:10354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:10354:1876178898039424:0@lo:502: 00000100:00100000:0.0:1789263698.935644:0:10354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263698.935667:0:10354:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9c0be3cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789263698.935678:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898039424 00000100:00100000:3.0:1789263698.935683:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898039424 00000100:00100000:3.0:1789263698.935762:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1789263698.935768:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd991567c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+12:10354:x1876178898039424:12345-0@lo:502: 00000100:00100000:3.0:1789263698.935847:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd991567c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+12:10354:x1876178898039424:12345-0@lo:502: Request processed in 80us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263698.935854:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1789263698.935878:0:10354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:10354:1876178898039424:0@lo:502: 00000100:00100000:0.0:1789263698.935918:0:10354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:10354:1876178898039552:0@lo:502: 00000100:00100000:0.0:1789263698.935963:0:10354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263698.935982:0:10354:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9908ece40 going to sleep for 11 seconds 00000100:00100000:3.0:1789263698.935994:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898039552 00000100:00100000:3.0:1789263698.935999:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898039552 00000100:00100000:3.0:1789263698.936021:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1789263698.936027:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd991564050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+12:10354:x1876178898039552:12345-0@lo:502: 00000100:00100000:3.0:1789263698.936117:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd991564050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+12:10354:x1876178898039552:12345-0@lo:502: Request processed in 88us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263698.936123:0:10354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:10354:1876178898039552:0@lo:502: 00000100:00100000:3.0:1789263698.936129:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000040:00080000:0.0:1789263698.936149:0:10354:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1789263698.936230:0:6484:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1789263698.936262:0:6484:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789263698.936270:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd990432400/0xce1582440fb1d919 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d920 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263698.936279:0:6484:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd990432400/0xce1582440fb1d919 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d920 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789263698.936287:0:6484:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1789263698.936289:0:6484:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1789263698.936292:0:6484:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1789263698.936311:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd981683a00/0xce1582440fb1d927 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263698.936318:0:6484:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd981683a00/0xce1582440fb1d927 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263698.936325:0:6484:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd981683a00/0xce1582440fb1d927 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263698.936337:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882613b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898039680:0@lo:101: 00000100:00100000:1.0:1789263698.936364:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263698.936392:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898039680 00000100:00100000:1.0:1789263698.936394:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd883e4e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789263698.936397:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898039680 00000100:00100000:0.0:1789263698.936430:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1789263698.936439:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd991564850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+12:6484:x1876178898039680:12345-0@lo:101: 00010000:00010000:0.0:1789263698.936448:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263698.936458:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd990433000/0xce1582440fb1d92e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1d927 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263698.936472:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd990433000/0xce1582440fb1d92e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1d927 expref: 13 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263698.936479:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd990433000/0xce1582440fb1d92e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d927 expref: 13 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263698.936484:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd990433000, rc 0) 00000100:00100000:0.0:1789263698.936527:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd991564850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+13:6484:x1876178898039680:12345-0@lo:101: Request processed in 89us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263698.936537:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1789263698.936893:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882613b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898039680:0@lo:101: 00010000:00010000:1.0:1789263698.936908:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd981683a00/0xce1582440fb1d927 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d92e expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263698.936917:0:6484:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd981683a00/0xce1582440fb1d927 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1d92e expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263698.936982:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882613b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898039808:0@lo:501: 00000100:00100000:1.0:1789263698.937024:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263698.937048:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd883e4e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789263698.937790:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898039808 00000100:00100000:2.0:1789263698.937797:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898039808 00000100:00100000:2.0:1789263698.937840:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1789263698.937851:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd991564c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+13:6484:x1876178898039808:12345-0@lo:501: 00000100:00100000:2.0:1789263698.937986:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd991564c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+13:6484:x1876178898039808:12345-0@lo:501: Request processed in 138us (961us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263698.937997:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1789263698.938008:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882613b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898039808:0@lo:501: 00000100:00100000:1.0:1789263698.938046:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882613b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898039936:0@lo:503: 00000100:00100000:1.0:1789263698.938259:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263698.938292:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd883e4e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789263698.938379:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898039936 00000100:00100000:3.0:1789263698.938385:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898039936 00000100:00100000:3.0:1789263698.938418:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1789263698.938426:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd991567850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+13:6484:x1876178898039936:12345-0@lo:503: 00000100:00100000:3.0:1789263698.938510:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd991567850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+13:6484:x1876178898039936:12345-0@lo:503: Request processed in 83us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263698.938519:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882613b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898039936:0@lo:503: 00000100:00100000:3.0:1789263698.938520:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1789263698.938751:0:10356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:10356:1876178898040064:0@lo:502: 00000100:00100000:3.0:1789263698.938787:0:10356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263698.938805:0:10356:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9bb605480 going to sleep for 11 seconds 00000100:00100000:2.0:1789263698.938821:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898040064 00000100:00100000:2.0:1789263698.938827:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898040064 00000100:00100000:2.0:1789263698.938855:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1789263698.938863:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd991565050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+13:10356:x1876178898040064:12345-0@lo:502: 00000100:00100000:2.0:1789263698.938947:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd991565050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+13:10356:x1876178898040064:12345-0@lo:502: Request processed in 86us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263698.938955:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1789263698.939123:0:10356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:10356:1876178898040064:0@lo:502: 00000020:01000000:3.0:1789263698.939145:0:10356:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789263698.939152:0:10356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789263698.939155:0:10356:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789263698.939159:0:10356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789263698.939197:0:10356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:10356:1876178898040192:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789263698.939235:0:10356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263698.939262:0:10356:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9bb605480 going to sleep for 11 seconds 00000100:00100000:1.0:1789263698.939279:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898040192 00000100:00100000:1.0:1789263698.939285:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898040192 00000100:00100000:1.0:1789263698.939328:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1789263698.939337:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd991566450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+13:10356:x1876178898040192:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789263698.939422:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd991566450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+13:10356:x1876178898040192:12345-0@lo:502:llog_process_th.0 Request processed in 86us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263698.939430:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1789263698.939448:0:10356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:10356:1876178898040192:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789263698.939472:0:10356:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789263698.939477:0:10356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789263698.939479:0:10356:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789263698.939483:0:10356:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:1.0:1789263698.939563:0:6484:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1789263698.939587:0:6484:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789263698.939597:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd981683a00/0xce1582440fb1d927 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d92e expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263698.939607:0:6484:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd981683a00/0xce1582440fb1d927 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d92e expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789263698.939616:0:6484:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789263698.939618:0:6484:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dd882a29800 from 4 10000000:01000000:1.0:1789263698.939620:0:6484:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789263698.939643:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd981683600/0xce1582440fb1d935 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263698.939661:0:6484:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd981683600/0xce1582440fb1d935 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263698.939671:0:6484:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd981683600/0xce1582440fb1d935 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263698.939686:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882613b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898040320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789263698.939718:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263698.939742:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd883e4e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789263698.939762:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898040320 00000100:00100000:2.0:1789263698.939768:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898040320 00000100:00100000:2.0:1789263698.939794:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1789263698.939802:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd988441050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+13:6484:x1876178898040320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789263698.939811:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263698.939822:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd9bfa23a00/0xce1582440fb1d93c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1d935 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263698.939840:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd9bfa23a00/0xce1582440fb1d93c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1d935 expref: 14 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263698.939850:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd9bfa23a00/0xce1582440fb1d93c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d935 expref: 14 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263698.939859:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bfa23a00, rc 0) 00000100:00100000:2.0:1789263698.939893:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd988441050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+14:6484:x1876178898040320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 91us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263698.939900:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1789263698.939908:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882613b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898040320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789263698.939924:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd981683600/0xce1582440fb1d935 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d93c expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263698.939934:0:6484:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd981683600/0xce1582440fb1d935 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1d93c expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263698.939985:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882613b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898040448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789263698.940024:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263698.940052:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd883e4e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789263698.940071:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898040448 00000100:00100000:3.0:1789263698.940094:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898040448 00000100:00100000:3.0:1789263698.940134:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1789263698.940141:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd988442050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+14:6484:x1876178898040448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789263698.940221:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd988442050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+14:6484:x1876178898040448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 80us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263698.940227:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1789263698.940240:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882613b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898040448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789263698.940267:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882613b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898040576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789263698.940305:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263698.940338:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd883e4e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789263698.940392:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898040576 00000100:00100000:2.0:1789263698.940396:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898040576 00000100:00100000:2.0:1789263698.940455:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1789263698.940463:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd988442c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+14:6484:x1876178898040576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789263698.940537:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd988442c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+14:6484:x1876178898040576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263698.940545:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1789263698.940566:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882613b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898040576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789263698.940766:0:10357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:10357:1876178898040704:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789263698.940802:0:10357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263698.940821:0:10357:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9c09d3300 going to sleep for 11 seconds 00000100:00100000:3.0:1789263698.940835:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898040704 00000100:00100000:3.0:1789263698.940841:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898040704 00000100:00100000:3.0:1789263698.940876:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1789263698.940883:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a07450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+14:10357:x1876178898040704:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789263698.940971:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a07450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+14:10357:x1876178898040704:12345-0@lo:502:llog_process_th.0 Request processed in 87us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263698.940991:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1789263698.940995:0:10357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:10357:1876178898040704:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789263698.941022:0:10357:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789263698.941029:0:10357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263698.941031:0:10357:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789263698.941038:0:10357:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dd882a29800 00000020:00000080:2.0:1789263698.941040:0:10357:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789263698.941287:0:10357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:10357:1876178898040832:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789263698.941324:0:10357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263698.941350:0:10357:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9c09d3300 going to sleep for 11 seconds 00000100:00100000:1.0:1789263698.941366:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898040832 00000100:00100000:1.0:1789263698.941372:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898040832 00000100:00100000:1.0:1789263698.941415:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1789263698.941425:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a07050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+14:10357:x1876178898040832:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789263698.941521:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a07050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+14:10357:x1876178898040832:12345-0@lo:502:llog_process_th.0 Request processed in 96us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263698.941532:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1789263698.941724:0:10357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:10357:1876178898040832:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789263698.941744:0:10357:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789263698.941750:0:10357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263698.941752:0:10357:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789263698.941756:0:10357:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789263698.942139:0:6484:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789263698.942163:0:6484:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789263698.942170:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd981683600/0xce1582440fb1d935 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d93c expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263698.942197:0:6484:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd981683600/0xce1582440fb1d935 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d93c expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789263698.942207:0:6484:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789263698.942209:0:6484:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9dd9c1b57000 from 48 10000000:01000000:2.0:1789263698.942211:0:6484:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789263698.942236:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22200/0xce1582440fb1d943 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263698.942244:0:6484:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22200/0xce1582440fb1d943 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263698.942252:0:6484:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22200/0xce1582440fb1d943 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263698.942264:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898040960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789263698.942292:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263698.942315:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9c09d3300 going to sleep for 11 seconds 00000100:00100000:0.0:1789263698.942327:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898040960 00000100:00100000:0.0:1789263698.942340:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898040960 00000100:00100000:0.0:1789263698.942377:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1789263698.942387:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a05850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+14:6484:x1876178898040960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789263698.942396:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263698.942409:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd990432600/0xce1582440fb1d94a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1d943 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263698.942430:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd990432600/0xce1582440fb1d94a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1d943 expref: 15 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263698.942441:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd990432600/0xce1582440fb1d94a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d943 expref: 15 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263698.942450:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd990432600, rc 0) 00000100:00100000:0.0:1789263698.942501:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a05850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+15:6484:x1876178898040960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263698.942508:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1789263698.942684:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898040960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789263698.942697:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22200/0xce1582440fb1d943 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d94a expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263698.942708:0:6484:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22200/0xce1582440fb1d943 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1d94a expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263698.942759:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882611180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898041088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789263698.942790:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263698.942806:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd883e4ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1789263698.942821:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898041088 00000100:00100000:1.0:1789263698.942825:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898041088 00000100:00100000:1.0:1789263698.942858:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1789263698.942866:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a07850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+15:6484:x1876178898041088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789263698.942966:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a07850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+15:6484:x1876178898041088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 100us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263698.942973:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1789263698.943023:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882611180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898041088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789263698.943052:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882611180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898041216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789263698.943128:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263698.943170:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd883e4ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1789263698.943247:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898041216 00000100:00100000:0.0:1789263698.943252:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898041216 00000100:00100000:0.0:1789263698.943283:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1789263698.943302:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a04050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+15:6484:x1876178898041216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789263698.943405:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a04050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+15:6484:x1876178898041216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 114us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263698.943413:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1789263698.943433:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882611180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898041216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789263698.946717:0:10359:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:10359:1876178898041344:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789263698.946796:0:10359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263698.946846:0:10359:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9862b6300 going to sleep for 11 seconds 00000100:00100000:3.0:1789263698.946869:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898041344 00000100:00100000:3.0:1789263698.946884:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898041344 00000100:00100000:3.0:1789263698.946960:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1789263698.946973:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a04850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+15:10359:x1876178898041344:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789263698.947251:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a04850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+15:10359:x1876178898041344:12345-0@lo:502:llog_process_th.0 Request processed in 281us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263698.947260:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1789263698.947349:0:10359:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:10359:1876178898041344:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789263698.947422:0:10359:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:10359:1876178898041472:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789263698.947485:0:10359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263698.947534:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898041472 00000100:00100000:3.0:1789263698.947539:0:10359:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd88392acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789263698.947554:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898041472 00000100:00100000:0.0:1789263698.947613:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1789263698.947627:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a06850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+15:10359:x1876178898041472:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789263698.947777:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a06850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+15:10359:x1876178898041472:12345-0@lo:502:llog_process_th.0 Request processed in 153us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263698.947790:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1789263698.947823:0:10359:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:10359:1876178898041472:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789263698.947858:0:10359:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1789263698.948135:0:6484:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1789263698.948192:0:6484:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789263698.948207:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22200/0xce1582440fb1d943 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d94a expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263698.948220:0:6484:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22200/0xce1582440fb1d943 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d94a expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789263698.948233:0:6484:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1789263698.948236:0:6484:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1789263698.948240:0:6484:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789263698.948283:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9813fd400/0xce1582440fb1d951 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263698.948293:0:6484:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd9813fd400/0xce1582440fb1d951 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263698.948304:0:6484:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd9813fd400/0xce1582440fb1d951 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263698.948333:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898041600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789263698.948390:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263698.948434:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd88392acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789263698.948463:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898041600 00000100:00100000:3.0:1789263698.948469:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898041600 00000100:00100000:3.0:1789263698.948520:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1789263698.948533:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a04450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+15:6484:x1876178898041600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789263698.948548:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263698.948569:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd9813fda00/0xce1582440fb1d958 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1d951 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263698.948600:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd9813fda00/0xce1582440fb1d958 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1d951 expref: 16 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263698.948613:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd9813fda00/0xce1582440fb1d958 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d951 expref: 16 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263698.948623:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9813fda00, rc 0) 00000100:00100000:3.0:1789263698.948675:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a04450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+16:6484:x1876178898041600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263698.948683:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1789263698.948765:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898041600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789263698.948783:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd9813fd400/0xce1582440fb1d951 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d958 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263698.948795:0:6484:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd9813fd400/0xce1582440fb1d951 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1d958 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263698.948888:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898041728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789263698.948935:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263698.948969:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd88392acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789263698.949005:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898041728 00000100:00100000:3.0:1789263698.949010:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898041728 00000100:00100000:3.0:1789263698.949068:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1789263698.949131:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a07c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+16:6484:x1876178898041728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789263698.949327:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a07c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+16:6484:x1876178898041728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 249us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263698.949337:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1789263698.949396:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898041728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789263698.949446:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898041856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789263698.949498:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263698.949532:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd88392acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789263698.949551:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898041856 00000100:00100000:3.0:1789263698.949557:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898041856 00000100:00100000:3.0:1789263698.949609:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1789263698.949620:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a05c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+16:6484:x1876178898041856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789263698.949742:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a05c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+16:6484:x1876178898041856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 121us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263698.949751:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1789263698.949821:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898041856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789263698.950344:0:10363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:10363:1876178898041984:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789263698.950417:0:10363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263698.950468:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898041984 00000100:00100000:2.0:1789263698.950477:0:10363:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9c09d3780 going to sleep for 11 seconds 00000100:00100000:3.0:1789263698.950487:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898041984 00000100:00100000:3.0:1789263698.950542:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1789263698.950557:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a04c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+16:10363:x1876178898041984:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789263698.950685:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a04c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+16:10363:x1876178898041984:12345-0@lo:502:llog_process_th.0 Request processed in 133us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263698.950694:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1789263698.950722:0:10363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:10363:1876178898041984:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789263698.950767:0:10363:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789263698.950776:0:10363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263698.950778:0:10363:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789263698.950784:0:10363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789263698.950807:0:10363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:10363:1876178898042112:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789263698.950856:0:10363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263698.950879:0:10363:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9c09d3780 going to sleep for 11 seconds 00000100:00100000:3.0:1789263698.950901:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898042112 00000100:00100000:3.0:1789263698.950908:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898042112 00000100:00100000:3.0:1789263698.950946:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1789263698.950954:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a05050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+16:10363:x1876178898042112:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789263698.951041:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a05050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+16:10363:x1876178898042112:12345-0@lo:502:llog_process_th.0 Request processed in 88us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263698.951049:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1789263698.951095:0:10363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:10363:1876178898042112:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789263698.951127:0:10363:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789263698.951132:0:10363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263698.951134:0:10363:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789263698.951137:0:10363:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:3.0:1789263698.951209:0:6484:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1789263698.951251:0:6484:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789263698.951262:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9813fd400/0xce1582440fb1d951 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d958 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263698.951282:0:6484:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd9813fd400/0xce1582440fb1d951 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d958 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789263698.951294:0:6484:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789263698.951296:0:6484:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dd9c1b57000 from 4 10000000:01000000:3.0:1789263698.951299:0:6484:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789263698.951332:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9813fde00/0xce1582440fb1d95f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263698.951341:0:6484:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd9813fde00/0xce1582440fb1d95f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263698.951366:0:6484:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd9813fde00/0xce1582440fb1d95f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263698.951386:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898042240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789263698.951426:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263698.951472:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898042240 00000100:00100000:3.0:1789263698.951476:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd88392a180 going to sleep for 11 seconds 00000100:00100000:2.0:1789263698.951480:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898042240 00000100:00100000:2.0:1789263698.951530:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1789263698.951545:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a06050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+16:6484:x1876178898042240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789263698.951559:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263698.951576:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd9bfa23600/0xce1582440fb1d966 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1d95f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263698.951603:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd9bfa23600/0xce1582440fb1d966 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1d95f expref: 17 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263698.951614:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd9bfa23600/0xce1582440fb1d966 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d95f expref: 17 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263698.952268:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bfa23600, rc 0) 00000100:00100000:2.0:1789263698.952328:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a06050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+17:6484:x1876178898042240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 787us (899us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263698.952335:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1789263698.952372:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898042240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789263698.952393:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd9813fde00/0xce1582440fb1d95f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d966 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263698.952405:0:6484:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd9813fde00/0xce1582440fb1d95f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1d966 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263698.952480:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898042368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789263698.952520:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263698.952556:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd88392a180 going to sleep for 11 seconds 00000100:00100000:2.0:1789263698.952572:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898042368 00000100:00100000:2.0:1789263698.952580:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898042368 00000100:00100000:2.0:1789263698.952623:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1789263698.952636:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a06c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+17:6484:x1876178898042368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789263698.952790:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a06c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+17:6484:x1876178898042368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 158us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263698.952798:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1789263698.952827:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898042368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789263698.952870:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898042496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789263698.952942:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263698.952965:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd88392a180 going to sleep for 11 seconds 00000100:00100000:2.0:1789263698.953533:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898042496 00000100:00100000:2.0:1789263698.953540:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898042496 00000100:00100000:2.0:1789263698.953577:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1789263698.953585:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a06450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+17:6484:x1876178898042496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789263698.953683:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a06450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+17:6484:x1876178898042496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 99us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263698.953693:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1789263698.953736:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898042496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789263698.954837:0:10364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:10364:1876178898042624:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789263698.954891:0:10364:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263698.954922:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898042624 00000100:00100000:0.0:1789263698.954928:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898042624 00000100:00100000:3.0:1789263698.954951:0:10364:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd88392a840 going to sleep for 11 seconds 00000100:00100000:0.0:1789263698.954967:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1789263698.954977:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a05450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+17:10364:x1876178898042624:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789263698.955110:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a05450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+17:10364:x1876178898042624:12345-0@lo:502:llog_process_th.0 Request processed in 134us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263698.955116:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1789263698.955220:0:10364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:10364:1876178898042624:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789263698.955250:0:10364:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789263698.955260:0:10364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789263698.955262:0:10364:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789263698.955270:0:10364:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dd9c1b57000 00000020:00000080:3.0:1789263698.955273:0:10364:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789263698.955323:0:10364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:10364:1876178898042752:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789263698.955359:0:10364:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263698.955420:0:10364:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd88392a840 going to sleep for 11 seconds 00000100:00100000:0.0:1789263698.955452:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898042752 00000100:00100000:0.0:1789263698.955456:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898042752 00000100:00100000:0.0:1789263698.955516:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1789263698.955524:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+17:10364:x1876178898042752:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789263698.955591:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+17:10364:x1876178898042752:12345-0@lo:502:llog_process_th.0 Request processed in 67us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263698.955598:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1789263698.955657:0:10364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:10364:1876178898042752:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789263698.955674:0:10364:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789263698.955679:0:10364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789263698.955681:0:10364:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1789263698.955684:0:10364:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1789263698.955793:0:6484:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1789263698.955817:0:6484:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789263698.955827:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9813fde00/0xce1582440fb1d95f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d966 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263698.955837:0:6484:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd9813fde00/0xce1582440fb1d95f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d966 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789263698.955856:0:6484:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789263698.955858:0:6484:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9dd9c0889800 from 48 10000000:01000000:0.0:1789263698.955860:0:6484:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789263698.955883:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd990432e00/0xce1582440fb1d96d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263698.955891:0:6484:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd990432e00/0xce1582440fb1d96d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263698.955899:0:6484:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd990432e00/0xce1582440fb1d96d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263698.955911:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898042880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789263698.955940:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263698.955964:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9862b6480 going to sleep for 11 seconds 00000100:00100000:3.0:1789263698.955986:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898042880 00000100:00100000:3.0:1789263698.955992:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898042880 00000100:00100000:3.0:1789263698.956018:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1789263698.956025:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+17:6484:x1876178898042880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789263698.956032:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263698.956053:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd9813fd800/0xce1582440fb1d974 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1d96d expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263698.956103:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd9813fd800/0xce1582440fb1d974 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1d96d expref: 18 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263698.956115:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd9813fd800/0xce1582440fb1d974 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d96d expref: 18 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263698.956134:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9813fd800, rc 0) 00000100:00100000:3.0:1789263698.956191:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+18:6484:x1876178898042880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 165us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263698.956199:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1789263698.956202:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898042880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789263698.956217:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd990432e00/0xce1582440fb1d96d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d974 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263698.956227:0:6484:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd990432e00/0xce1582440fb1d96d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1d974 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263698.956271:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898043008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789263698.956296:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263698.956322:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898043008 00000100:00100000:0.0:1789263698.956326:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9862b6480 going to sleep for 11 seconds 00000100:00100000:3.0:1789263698.956328:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898043008 00000100:00100000:3.0:1789263698.956360:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1789263698.956369:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+18:6484:x1876178898043008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789263698.956476:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+18:6484:x1876178898043008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 108us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263698.956484:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1789263698.956486:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898043008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789263698.956518:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898043136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789263698.956555:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263698.956572:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9862b6480 going to sleep for 11 seconds 00000100:00100000:3.0:1789263698.956575:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898043136 00000100:00100000:3.0:1789263698.956581:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898043136 00000100:00100000:3.0:1789263698.956610:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1789263698.956619:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+18:6484:x1876178898043136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789263698.956697:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+18:6484:x1876178898043136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263698.956704:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1789263698.956708:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898043136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789263698.959533:0:10367:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:10367:1876178898043264:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789263698.959610:0:10367:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263698.959643:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898043264 00000100:00100000:2.0:1789263698.959650:0:10367:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9c09d3480 going to sleep for 11 seconds 00000100:00100000:0.0:1789263698.959652:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898043264 00000100:00100000:0.0:1789263698.959710:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1789263698.960094:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+18:10367:x1876178898043264:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789263698.960310:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+18:10367:x1876178898043264:12345-0@lo:502:llog_process_th.0 Request processed in 592us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263698.960319:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1789263698.960396:0:10367:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:10367:1876178898043264:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789263698.960451:0:10367:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:10367:1876178898043392:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789263698.960511:0:10367:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263698.960544:0:10367:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9c09d3480 going to sleep for 11 seconds 00000100:00100000:0.0:1789263698.960571:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898043392 00000100:00100000:0.0:1789263698.960577:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898043392 00000100:00100000:0.0:1789263698.960609:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1789263698.960617:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+18:10367:x1876178898043392:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789263698.960687:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+18:10367:x1876178898043392:12345-0@lo:502:llog_process_th.0 Request processed in 70us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263698.960693:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1789263698.960722:0:10367:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:10367:1876178898043392:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789263698.960747:0:10367:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1789263698.960836:0:6484:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1789263698.960864:0:6484:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789263698.960874:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd990432e00/0xce1582440fb1d96d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d974 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263698.960885:0:6484:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd990432e00/0xce1582440fb1d96d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d974 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789263698.960895:0:6484:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1789263698.960898:0:6484:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:3.0:1789263698.960901:0:6484:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1789263698.960931:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9813fc600/0xce1582440fb1d97b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263698.960940:0:6484:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd9813fc600/0xce1582440fb1d97b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263698.960950:0:6484:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd9813fc600/0xce1582440fb1d97b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263698.960965:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898043520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789263698.960997:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263698.961361:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9908ece40 going to sleep for 11 seconds 00000100:00100000:2.0:1789263698.961478:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898043520 00000100:00100000:2.0:1789263698.961484:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898043520 00000100:00100000:2.0:1789263698.961522:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1789263698.961530:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+18:6484:x1876178898043520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789263698.961541:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263698.961571:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd9bfa22800/0xce1582440fb1d982 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1d97b expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263698.961600:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd9bfa22800/0xce1582440fb1d982 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1d97b expref: 19 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263698.961611:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd9bfa22800/0xce1582440fb1d982 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d97b expref: 19 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263698.961620:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bfa22800, rc 0) 00000100:00100000:2.0:1789263698.961663:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+19:6484:x1876178898043520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263698.961672:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898043520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789263698.961673:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00010000:00010000:0.0:1789263698.961689:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd9813fc600/0xce1582440fb1d97b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d982 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263698.961699:0:6484:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd9813fc600/0xce1582440fb1d97b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1d982 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263698.961750:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898043648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789263698.961790:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263698.961807:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9862b6a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789263698.961813:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898043648 00000100:00100000:1.0:1789263698.961820:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898043648 00000100:00100000:1.0:1789263698.961852:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1789263698.961863:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+19:6484:x1876178898043648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789263698.961986:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+19:6484:x1876178898043648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 125us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263698.961990:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898043648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789263698.962001:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1789263698.962025:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898043776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789263698.962066:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263698.962112:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9862b6a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789263698.962132:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898043776 00000100:00100000:1.0:1789263698.962137:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898043776 00000100:00100000:1.0:1789263698.962163:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1789263698.962173:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+19:6484:x1876178898043776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789263698.962264:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+19:6484:x1876178898043776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 93us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263698.962271:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1789263698.962277:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898043776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789263698.962451:0:10370:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:10370:1876178898043904:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789263698.962491:0:10370:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263698.962513:0:10370:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9862b60c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789263698.962517:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898043904 00000100:00100000:1.0:1789263698.962523:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898043904 00000100:00100000:1.0:1789263698.962553:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1789263698.962561:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+19:10370:x1876178898043904:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789263698.962648:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+19:10370:x1876178898043904:12345-0@lo:502:llog_process_th.0 Request processed in 87us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263698.962656:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1789263698.962663:0:10370:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:10370:1876178898043904:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789263698.962692:0:10370:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789263698.962700:0:10370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789263698.962702:0:10370:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789263698.962708:0:10370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789263698.962727:0:10370:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:10370:1876178898044032:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789263698.962765:0:10370:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263698.962782:0:10370:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9bb790300 going to sleep for 11 seconds 00000100:00100000:1.0:1789263698.962789:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898044032 00000100:00100000:1.0:1789263698.962795:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898044032 00000100:00100000:1.0:1789263698.962824:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1789263698.962834:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+19:10370:x1876178898044032:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789263698.962920:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+19:10370:x1876178898044032:12345-0@lo:502:llog_process_th.0 Request processed in 88us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263698.962927:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1789263698.962932:0:10370:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:10370:1876178898044032:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789263698.962957:0:10370:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789263698.962962:0:10370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789263698.962964:0:10370:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789263698.962968:0:10370:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:1.0:1789263698.963026:0:6484:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:1.0:1789263698.963046:0:6484:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1789263698.963054:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9813fc600/0xce1582440fb1d97b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d982 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263698.963065:0:6484:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd9813fc600/0xce1582440fb1d97b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d982 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789263698.963294:0:6484:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789263698.963297:0:6484:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dd9c0889800 from 4 10000000:01000000:1.0:1789263698.963300:0:6484:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789263698.963322:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd981682200/0xce1582440fb1d989 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263698.963331:0:6484:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd981682200/0xce1582440fb1d989 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263698.963339:0:6484:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd981682200/0xce1582440fb1d989 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263698.963354:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882611180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898044160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789263698.963387:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263698.963414:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd883e4e240 going to sleep for 11 seconds 00000100:00100000:0.0:1789263698.963427:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898044160 00000100:00100000:0.0:1789263698.963433:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898044160 00000100:00100000:0.0:1789263698.963471:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1789263698.963480:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+19:6484:x1876178898044160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789263698.963488:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263698.963500:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd990433800/0xce1582440fb1d990 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1d989 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263698.963518:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd990433800/0xce1582440fb1d990 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1d989 expref: 20 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263698.963542:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd990433800/0xce1582440fb1d990 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d989 expref: 20 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263698.963551:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd990433800, rc 0) 00000100:00100000:0.0:1789263698.963586:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+20:6484:x1876178898044160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263698.963594:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1789263698.963603:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882611180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898044160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789263698.963618:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd981682200/0xce1582440fb1d989 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d990 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263698.963634:0:6484:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd981682200/0xce1582440fb1d989 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1d990 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263698.963687:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882611180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898044288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789263698.963718:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263698.963737:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd883e4e240 going to sleep for 11 seconds 00000100:00100000:0.0:1789263698.963742:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898044288 00000100:00100000:0.0:1789263698.963748:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898044288 00000100:00100000:0.0:1789263698.963772:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1789263698.963780:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+20:6484:x1876178898044288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789263698.963856:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+20:6484:x1876178898044288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 77us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263698.963863:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1789263698.963871:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882611180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898044288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789263698.963901:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882611180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898044416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789263698.963937:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263698.963954:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd883e4e240 going to sleep for 11 seconds 00000100:00100000:0.0:1789263698.963958:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898044416 00000100:00100000:0.0:1789263698.963963:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898044416 00000100:00100000:0.0:1789263698.963988:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1789263698.963997:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+20:6484:x1876178898044416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789263698.964066:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+20:6484:x1876178898044416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 69us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263698.964094:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882611180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898044416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789263698.964105:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1789263698.964302:0:10371:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:10371:1876178898044544:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789263698.964335:0:10371:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263698.964358:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898044544 00000100:00100000:0.0:1789263698.964362:0:10371:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9bb790000 going to sleep for 11 seconds 00000100:00100000:1.0:1789263698.964364:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898044544 00000100:00100000:1.0:1789263698.964397:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1789263698.964405:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+20:10371:x1876178898044544:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789263698.964486:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+20:10371:x1876178898044544:12345-0@lo:502:llog_process_th.0 Request processed in 81us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263698.964493:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1789263698.964498:0:10371:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:10371:1876178898044544:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789263698.964525:0:10371:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789263698.964532:0:10371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789263698.964535:0:10371:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789263698.964541:0:10371:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dd9c0889800 00000020:00000080:0.0:1789263698.964544:0:10371:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789263698.964609:0:10371:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:10371:1876178898044672:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789263698.964643:0:10371:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263698.964663:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898044672 00000100:00100000:0.0:1789263698.964667:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898044672 00000100:00100000:0.0:1789263698.964691:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1789263698.964698:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+20:10371:x1876178898044672:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789263698.964760:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+20:10371:x1876178898044672:12345-0@lo:502:llog_process_th.0 Request processed in 62us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263698.964767:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1789263698.964797:0:10371:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9bb790000 going to sleep for 11 seconds 00000100:00100000:0.0:1789263698.964810:0:10371:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:10371:1876178898044672:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789263698.964827:0:10371:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789263698.964831:0:10371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789263698.964833:0:10371:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1789263698.964836:0:10371:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1789263698.964949:0:6484:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1789263698.964963:0:6484:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789263698.964968:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd981682200/0xce1582440fb1d989 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d990 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263698.964975:0:6484:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd981682200/0xce1582440fb1d989 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d990 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789263698.964987:0:6484:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789263698.964988:0:6484:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9dd9896b8000 from 48 10000000:01000000:1.0:1789263698.964990:0:6484:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789263698.965005:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd981682600/0xce1582440fb1d997 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263698.965010:0:6484:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd981682600/0xce1582440fb1d997 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263698.965015:0:6484:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd981682600/0xce1582440fb1d997 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263698.965023:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882611180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898044800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789263698.965044:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263698.965063:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd883e4e480 going to sleep for 11 seconds 00000100:00100000:0.0:1789263698.965105:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898044800 00000100:00100000:0.0:1789263698.965115:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898044800 00000100:00100000:0.0:1789263698.965142:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1789263698.965165:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+20:6484:x1876178898044800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789263698.965173:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263698.965195:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd990433a00/0xce1582440fb1d99e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1d997 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263698.965212:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd990433a00/0xce1582440fb1d99e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1d997 expref: 21 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263698.965222:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd990433a00/0xce1582440fb1d99e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d997 expref: 21 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263698.965230:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd990433a00, rc 0) 00000100:00100000:0.0:1789263698.965265:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+21:6484:x1876178898044800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263698.965271:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1789263698.965276:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882611180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898044800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789263698.965289:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd981682600/0xce1582440fb1d997 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d99e expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263698.965297:0:6484:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd981682600/0xce1582440fb1d997 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1d99e expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263698.965344:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882611180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898044928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789263698.965375:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263698.965396:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898044928 00000100:00100000:0.0:1789263698.965401:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898044928 00000100:00100000:1.0:1789263698.965405:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd883e4e480 going to sleep for 11 seconds 00000100:00100000:0.0:1789263698.965434:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1789263698.965444:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+21:6484:x1876178898044928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789263698.965528:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+21:6484:x1876178898044928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 87us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263698.965535:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1789263698.965537:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882611180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898044928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789263698.965561:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882611180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898045056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789263698.965607:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263698.965626:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd883e4e480 going to sleep for 11 seconds 00000100:00100000:0.0:1789263698.965627:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898045056 00000100:00100000:0.0:1789263698.965630:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898045056 00000100:00100000:0.0:1789263698.965656:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1789263698.965664:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+21:6484:x1876178898045056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789263698.965745:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+21:6484:x1876178898045056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 81us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263698.965752:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1789263698.965754:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882611180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898045056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789263698.965934:0:10372:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:10372:1876178898045184:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789263698.965972:0:10372:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263698.965992:0:10372:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9863393c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789263698.965995:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898045184 00000100:00100000:1.0:1789263698.965999:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898045184 00000100:00100000:1.0:1789263698.966028:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1789263698.966037:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+21:10372:x1876178898045184:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789263698.966141:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+21:10372:x1876178898045184:12345-0@lo:502:llog_process_th.0 Request processed in 105us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263698.966149:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1789263698.966151:0:10372:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:10372:1876178898045184:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789263698.966200:0:10372:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:10372:1876178898045312:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789263698.966236:0:10372:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263698.966257:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898045312 00000100:00100000:1.0:1789263698.966261:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898045312 00000100:00100000:0.0:1789263698.966264:0:10372:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9863393c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789263698.966289:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1789263698.966296:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+21:10372:x1876178898045312:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789263698.966366:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+21:10372:x1876178898045312:12345-0@lo:502:llog_process_th.0 Request processed in 71us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263698.966374:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1789263698.966890:0:10372:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:10372:1876178898045312:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789263698.966913:0:10372:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1789263698.967009:0:6484:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1789263698.967040:0:6484:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789263698.967052:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd981682600/0xce1582440fb1d997 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d99e expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263698.967062:0:6484:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd981682600/0xce1582440fb1d997 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d99e expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789263698.967070:0:6484:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1789263698.967073:0:6484:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:3.0:1789263698.967107:0:6484:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789263698.967131:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9813fc400/0xce1582440fb1d9a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263698.967139:0:6484:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd9813fc400/0xce1582440fb1d9a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263698.967149:0:6484:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd9813fc400/0xce1582440fb1d9a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263698.967173:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898045440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789263698.967222:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263698.967252:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9908eccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789263698.967272:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898045440 00000100:00100000:3.0:1789263698.967276:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898045440 00000100:00100000:3.0:1789263698.967313:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1789263698.967322:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+21:6484:x1876178898045440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789263698.967330:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263698.967341:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd9813fd000/0xce1582440fb1d9ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1d9a5 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263698.967359:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd9813fd000/0xce1582440fb1d9ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1d9a5 expref: 22 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263698.967368:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd9813fd000/0xce1582440fb1d9ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d9a5 expref: 22 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263698.967376:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9813fd000, rc 0) 00000100:00100000:3.0:1789263698.967411:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+22:6484:x1876178898045440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 90us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263698.967420:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1789263698.967427:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898045440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789263698.967440:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd9813fc400/0xce1582440fb1d9a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d9ac expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263698.967450:0:6484:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd9813fc400/0xce1582440fb1d9a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1d9ac expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263698.967519:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882611180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898045568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789263698.967555:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263698.967576:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd883e4e180 going to sleep for 11 seconds 00000100:00100000:3.0:1789263698.967587:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898045568 00000100:00100000:3.0:1789263698.967592:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898045568 00000100:00100000:3.0:1789263698.967614:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1789263698.967620:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+22:6484:x1876178898045568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789263698.967712:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+22:6484:x1876178898045568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 92us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263698.967723:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882611180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898045568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789263698.967724:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1789263698.967755:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882611180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898045696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789263698.967791:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263698.967811:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd883e4e180 going to sleep for 11 seconds 00000100:00100000:3.0:1789263698.967843:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898045696 00000100:00100000:3.0:1789263698.967849:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898045696 00000100:00100000:3.0:1789263698.967882:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1789263698.967892:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+22:6484:x1876178898045696:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789263698.967982:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+22:6484:x1876178898045696:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 91us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263698.967990:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1789263698.967994:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882611180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898045696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789263698.968398:0:10374:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882611180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:10374:1876178898045824:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789263698.968432:0:10374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263698.968459:0:10374:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd883e4e840 going to sleep for 11 seconds 00000100:00100000:3.0:1789263698.968465:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898045824 00000100:00100000:3.0:1789263698.968471:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898045824 00000100:00100000:3.0:1789263698.968559:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1789263698.968569:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+22:10374:x1876178898045824:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789263698.968648:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+22:10374:x1876178898045824:12345-0@lo:502:llog_process_th.0 Request processed in 81us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263698.968655:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1789263698.968658:0:10374:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882611180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:10374:1876178898045824:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789263698.968686:0:10374:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789263698.968693:0:10374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789263698.968696:0:10374:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789263698.968702:0:10374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789263698.968720:0:10374:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882611180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:10374:1876178898045952:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789263698.968753:0:10374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263698.968775:0:10374:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd883e4e840 going to sleep for 11 seconds 00000100:00100000:3.0:1789263698.968785:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898045952 00000100:00100000:3.0:1789263698.968790:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898045952 00000100:00100000:3.0:1789263698.968822:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1789263698.968833:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+22:10374:x1876178898045952:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789263698.968931:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+22:10374:x1876178898045952:12345-0@lo:502:llog_process_th.0 Request processed in 101us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263698.968939:0:10374:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882611180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:10374:1876178898045952:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789263698.968940:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000020:01000000:1.0:1789263698.968965:0:10374:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789263698.968969:0:10374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789263698.968971:0:10374:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789263698.968975:0:10374:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1789263698.969027:0:6484:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:0.0:1789263698.969045:0:6484:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789263698.969054:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9813fc400/0xce1582440fb1d9a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d9ac expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263698.969063:0:6484:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd9813fc400/0xce1582440fb1d9a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d9ac expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789263698.969072:0:6484:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789263698.969096:0:6484:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dd9896b8000 from 4 10000000:01000000:0.0:1789263698.969099:0:6484:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789263698.969118:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd990432200/0xce1582440fb1d9b3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263698.969125:0:6484:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd990432200/0xce1582440fb1d9b3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263698.969142:0:6484:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd990432200/0xce1582440fb1d9b3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263698.969155:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898046080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789263698.969199:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263698.969225:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9863393c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789263698.969232:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898046080 00000100:00100000:1.0:1789263698.969237:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898046080 00000100:00100000:1.0:1789263698.969270:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1789263698.969276:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+22:6484:x1876178898046080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789263698.969284:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263698.969294:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd981683800/0xce1582440fb1d9ba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1d9b3 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263698.969312:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd981683800/0xce1582440fb1d9ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1d9b3 expref: 23 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263698.969320:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd981683800/0xce1582440fb1d9ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d9b3 expref: 23 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263698.969329:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981683800, rc 0) 00000100:00100000:1.0:1789263698.969360:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+23:6484:x1876178898046080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 84us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263698.969365:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1789263698.969370:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898046080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789263698.969381:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd990432200/0xce1582440fb1d9b3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d9ba expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263698.969390:0:6484:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd990432200/0xce1582440fb1d9b3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1d9ba expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263698.969431:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898046208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789263698.969456:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263698.969471:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9863393c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789263698.969477:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898046208 00000100:00100000:1.0:1789263698.969480:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898046208 00000100:00100000:1.0:1789263698.969504:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1789263698.969511:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+23:6484:x1876178898046208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789263698.969588:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+23:6484:x1876178898046208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 77us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263698.969594:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1789263698.969595:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898046208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789263698.969616:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898046336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789263698.969648:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263698.969663:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9863393c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789263698.969666:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898046336 00000100:00100000:1.0:1789263698.969669:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898046336 00000100:00100000:1.0:1789263698.969691:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1789263698.969697:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+23:6484:x1876178898046336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789263698.969760:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+23:6484:x1876178898046336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 63us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263698.969769:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898046336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789263698.969774:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1789263698.969925:0:10376:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:10376:1876178898046464:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789263698.969956:0:10376:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263698.969971:0:10376:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd986339f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789263698.969975:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898046464 00000100:00100000:1.0:1789263698.969979:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898046464 00000100:00100000:1.0:1789263698.970005:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1789263698.970013:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+23:10376:x1876178898046464:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789263698.970096:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+23:10376:x1876178898046464:12345-0@lo:502:llog_process_th.0 Request processed in 83us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263698.970103:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1789263698.970105:0:10376:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:10376:1876178898046464:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789263698.970127:0:10376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789263698.970133:0:10376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789263698.970135:0:10376:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789263698.970142:0:10376:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dd9896b8000 00000020:00000080:0.0:1789263698.970145:0:10376:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789263698.970220:0:10376:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:10376:1876178898046592:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789263698.970255:0:10376:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263698.970283:0:10376:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd986339f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789263698.970384:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898046592 00000100:00100000:1.0:1789263698.970389:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898046592 00000100:00100000:1.0:1789263698.970418:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1789263698.970425:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+23:10376:x1876178898046592:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789263698.970503:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+23:10376:x1876178898046592:12345-0@lo:502:llog_process_th.0 Request processed in 77us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263698.970510:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1789263698.970513:0:10376:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:10376:1876178898046592:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789263698.970533:0:10376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789263698.970537:0:10376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789263698.970539:0:10376:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1789263698.970543:0:10376:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1789263698.970606:0:6484:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1789263698.970633:0:6484:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789263698.970640:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd990432200/0xce1582440fb1d9b3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d9ba expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263698.970650:0:6484:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd990432200/0xce1582440fb1d9b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d9ba expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789263698.970659:0:6484:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789263698.970661:0:6484:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9dd9b7983370 from 1 10000000:01000000:1.0:1789263698.970664:0:6484:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789263698.970692:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883f59c00/0xce1582440fb1d9c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263698.970704:0:6484:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd883f59c00/0xce1582440fb1d9c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263698.970713:0:6484:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd883f59c00/0xce1582440fb1d9c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263698.970726:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882611180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898046720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789263698.970754:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263698.970776:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd986325180 going to sleep for 11 seconds 00000100:00100000:0.0:1789263698.970780:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898046720 00000100:00100000:0.0:1789263698.970783:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898046720 00000100:00100000:0.0:1789263698.970810:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1789263698.970817:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+23:6484:x1876178898046720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789263698.970825:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263698.970837:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd990432a00/0xce1582440fb1d9c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1d9c1 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263698.970854:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd990432a00/0xce1582440fb1d9c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1d9c1 expref: 24 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263698.970864:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd990432a00/0xce1582440fb1d9c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d9c1 expref: 24 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263698.970872:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd990432a00, rc 0) 00000100:00100000:0.0:1789263698.970914:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+24:6484:x1876178898046720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263698.970919:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1789263698.970924:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882611180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898046720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789263698.970936:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd883f59c00/0xce1582440fb1d9c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d9c8 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263698.970945:0:6484:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd883f59c00/0xce1582440fb1d9c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1d9c8 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263698.970989:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882611180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898046848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789263698.971017:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263698.971035:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd986325180 going to sleep for 11 seconds 00000100:00100000:0.0:1789263698.971038:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898046848 00000100:00100000:0.0:1789263698.971041:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898046848 00000100:00100000:0.0:1789263698.971068:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1789263698.971097:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c2072c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+24:6484:x1876178898046848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789263698.971161:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c2072c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+24:6484:x1876178898046848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 86us (142us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789263698.971168:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1789263698.971171:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882611180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898046848:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1789263698.971204:0:6484:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789263698.971211:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883f59c00/0xce1582440fb1d9c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d9c8 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263698.971219:0:6484:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd883f59c00/0xce1582440fb1d9c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d9c8 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263698.989669:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898046976:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789263698.989744:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263698.989795:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9c09f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3621:1876178898047488:0@lo:400:kworker.0 00000100:00100000:0.0:1789263698.989826:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263698.989850:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9c09f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898048000:0@lo:400:kworker.0 00000100:00100000:0.0:1789263698.989879:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263698.989901:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8840b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898048512:0@lo:400:kworker.0 00000100:00100000:0.0:1789263698.989931:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263698.989956:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1789263698.989962:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1876178898047360:0@lo:400:kworker.0 00000100:00100000:0.0:1789263698.989986:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263698.990020:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9c09f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898047872:0@lo:400:kworker.0 00000100:00100000:0.0:1789263698.990059:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263698.990109:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8840b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898048384:0@lo:400:kworker.0 00000100:00100000:0.0:1789263698.990134:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263698.990197:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876178898047104:0@lo:400:kworker.0 00000100:00100000:0.0:1789263698.990222:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263698.990240:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9c09f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1876178898047616:0@lo:400:kworker.0 00000100:00100000:0.0:1789263698.990260:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263698.990276:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9c09f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1876178898048128:0@lo:400:kworker.0 00000100:00100000:0.0:1789263698.990295:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263698.990312:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789263698.990318:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898047232:0@lo:400:kworker.0 00000100:00100000:0.0:1789263698.990336:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263698.990349:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9c09f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898047744:0@lo:400:kworker.0 00000100:00100000:0.0:1789263698.990364:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263698.990376:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9c09f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1876178898048256:0@lo:400:kworker.0 00000100:00100000:0.0:1789263698.990395:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263698.990417:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898046976 00000100:00100000:0.0:1789263698.990423:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898046976 00000100:00100000:0.0:1789263698.990485:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789263698.990498:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8840b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1876178898046976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789263698.990535:0:8397:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789263698.990614:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8840b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1876178898046976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263698.990625:0:8395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898048000 00000100:00100000:0.0:1789263698.990625:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789263698.990635:0:8395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898048000 00000100:00100000:0.0:1789263698.990664:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898047488 00000100:00100000:0.0:1789263698.990672:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898047488 00000100:00100000:3.0:1789263698.990685:0:8395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898048512 00000100:00100000:3.0:1789263698.990691:0:8395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898048512 00000100:00100000:0.0:1789263698.990716:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898047360 00000100:00100000:0.0:1789263698.990724:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898047360 00000100:00100000:3.0:1789263698.990740:0:8395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898048384 00000100:00100000:3.0:1789263698.990747:0:8395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898048384 00000100:00100000:0.0:1789263698.990762:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898047104 00000100:00100000:0.0:1789263698.990769:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898047104 00000100:00100000:3.0:1789263698.990785:0:8395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898047744 00000100:00100000:3.0:1789263698.990805:0:8395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898047744 00000100:00100000:0.0:1789263698.990817:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898047616 00000100:00100000:0.0:1789263698.990826:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898047616 00000100:00100000:3.0:1789263698.990843:0:8395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789263698.990856:0:8395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8840b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1876178898048000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263698.990867:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898048128 00000100:00100000:0.0:1789263698.990875:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898048128 00000100:00100000:0.0:1789263698.990909:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898048256 00000100:00100000:0.0:1789263698.990912:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898048256 00000100:00100000:3.0:1789263698.990945:0:8395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8840b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1876178898048000:12345-0@lo:400:kworker.0 Request processed in 94us (1065us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263698.990957:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789263698.990965:0:8395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789263698.990978:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8840b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1876178898047488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263698.990996:0:8395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789263698.991032:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8840b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1876178898047488:12345-0@lo:400:kworker.0 Request processed in 60us (1202us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263698.991040:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789263698.991056:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789263698.991064:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8840b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1876178898047360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263698.991124:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8840b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1876178898047360:12345-0@lo:400:kworker.0 Request processed in 61us (1138us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263698.991130:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789263698.991142:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789263698.991147:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8840b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876178898047104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263698.991187:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8840b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876178898047104:12345-0@lo:400:kworker.0 Request processed in 29us (954us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263698.991193:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789263698.991207:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789263698.991215:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8840b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876178898047616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263698.991222:0:8395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8840b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1876178898048512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263698.991251:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8840b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876178898047616:12345-0@lo:400:kworker.0 Request processed in 35us (987us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263698.991262:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789263698.991285:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789263698.991295:0:8395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8840b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1876178898048512:12345-0@lo:400:kworker.0 Request processed in 289us (1362us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263698.991307:0:8395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789263698.991317:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8840b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1876178898048128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263698.991331:0:8395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789263698.991339:0:8395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8840b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1876178898048384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263698.991395:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8840b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1876178898048128:12345-0@lo:400:kworker.0 Request processed in 87us (1094us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263698.991396:0:8395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8840b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1876178898048384:12345-0@lo:400:kworker.0 Request processed in 58us (1260us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263698.991423:0:8395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789263698.991438:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789263698.991446:0:8395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789263698.991458:0:8395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8840b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1876178898047744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263698.991479:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789263698.991489:0:8395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8840b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1876178898047744:12345-0@lo:400:kworker.0 Request processed in 31us (1123us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263698.991498:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8840b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1876178898048256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263698.991502:0:8395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789263698.991528:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789263698.991545:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898048640:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789263698.991563:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8840b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1876178898048256:12345-0@lo:400:kworker.0 Request processed in 73us (1163us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263698.991572:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789263698.991598:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263698.991636:0:8499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898047872 00000100:00100000:0.0:1789263698.991645:0:8499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898047872 00000100:00100000:3.0:1789263698.991678:0:8512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898048640 00000100:00100000:3.0:1789263698.991683:0:8512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898048640 00000100:00100000:0.0:1789263698.991694:0:8499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898047232 00000100:00100000:0.0:1789263698.991700:0:8499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898047232 00000100:00100000:0.0:1789263698.991726:0:8499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789263698.991733:0:8512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789263698.991743:0:8499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8840b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1876178898047872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263698.991754:0:8512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88397c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1876178898048640:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789263698.991778:0:8512:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789263698.991817:0:8499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8840b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1876178898047872:12345-0@lo:400:kworker.0 Request processed in 80us (1753us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263698.991826:0:8499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789263698.991847:0:8512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88397c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1876178898048640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263698.991857:0:8499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789263698.991863:0:8512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789263698.991875:0:8499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8840b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1876178898047232:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1789263698.991924:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd88397c000 x1876178898048640/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789263714 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263698.991937:0:8499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8840b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1876178898047232:12345-0@lo:400:kworker.0 Request processed in 66us (1596us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263698.991951:0:8499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789263698.991954:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898048640:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1789263698.992019:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789263698.992029:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789263698.992035:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789263698.992038:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789263698.992066:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898047232:0@lo:400:kworker.0 00000100:00100000:0.0:1789263698.992122:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1876178898047360:0@lo:400:kworker.0 00000100:00100000:0.0:1789263698.992156:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9c09f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898047872:0@lo:400:kworker.0 00010000:00080000:0.0:1789263698.992168:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd8840b3100 x1876178898048384/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789263714 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263698.992188:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8840b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898048384:0@lo:400:kworker.0 00010000:00080000:0.0:1789263698.992218:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd9bfaa4700 x1876178898046976/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789263714 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263698.992242:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898046976:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789263698.992270:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9c09f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3621:1876178898047488:0@lo:400:kworker.0 00010000:00080000:0.0:1789263698.992292:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd9c09f7b80 x1876178898048000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789263714 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263698.992302:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9c09f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898048000:0@lo:400:kworker.0 00010000:00080000:0.0:1789263698.992324:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd8840b0a80 x1876178898048512/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789263714 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263698.992334:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8840b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898048512:0@lo:400:kworker.0 00010000:00080000:3.0:1789263698.992484:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd9c09f5500 x1876178898047744/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789263714 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263698.992494:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9c09f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898047744:0@lo:400:kworker.0 00010000:00080000:3.0:1789263698.992511:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd9c09f5f80 x1876178898048256/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263714 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263698.992517:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9c09f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1876178898048256:0@lo:400:kworker.0 00000100:00100000:3.0:1789263698.992533:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876178898047104:0@lo:400:kworker.0 00010000:00080000:3.0:1789263698.992549:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd9c09f5c00 x1876178898047616/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263714 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263698.992555:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9c09f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1876178898047616:0@lo:400:kworker.0 00000100:00100000:3.0:1789263698.992577:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9c09f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1876178898048128:0@lo:400:kworker.0 00000100:00100000:2.0:1789263699.370404:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263699.370523:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888562432 00000100:00100000:1.0:1789263699.370533:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888562432 00000100:00100000:1.0:1789263699.370601:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 244 00000100:00100000:1.0:1789263699.370612:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd991565c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+9:6155:x1876178888562432:12345-192.168.203.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789263699.370630:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263699.370717:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd883f58c00/0xce1582440fb1d9cf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11bd5 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263699.370746:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd883f58c00/0xce1582440fb1d9cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11bd5 expref: 10 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263699.370757:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd883f58c00/0xce1582440fb1d9cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11bd5 expref: 10 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263699.370766:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd883f58c00, rc 0) 00000100:00100000:1.0:1789263699.371234:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd991565c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+10:6155:x1876178888562432:12345-192.168.203.20@tcp:101:ll_cfg_requeue.0 Request processed in 622us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263699.371242:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 244 00000100:00100000:1.0:1789263699.372673:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263699.372714:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888562560 00000100:00100000:0.0:1789263699.372722:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888562560 00000100:00100000:0.0:1789263699.372757:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 245 00000100:00100000:0.0:1789263699.372766:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd991566050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+10:6155:x1876178888562560:12345-192.168.203.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789263699.372900:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd991566050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+10:6155:x1876178888562560:12345-192.168.203.20@tcp:501:ll_cfg_requeue.0 Request processed in 135us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263699.372908:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 245 00000100:00100000:3.0:1789263699.374121:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263699.374200:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888562688 00000100:00100000:0.0:1789263699.374207:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888562688 00010000:00010000:3.0:1789263699.374234:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789263699.374249:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 246 00000100:00100000:0.0:1789263699.374260:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd991565850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+10:6155:x1876178888562688:12345-192.168.203.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789263699.374357:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd991565850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+10:6155:x1876178888562688:12345-192.168.203.20@tcp:503:ll_cfg_requeue.0 Request processed in 100us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263699.374365:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 246 00000100:00100000:0.0:1789263699.375944:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263699.376032:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888562816 00000100:00100000:2.0:1789263699.376039:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888562816 00000100:00100000:2.0:1789263699.376110:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 247 00000100:00100000:2.0:1789263699.376121:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd991567050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+10:6687:x1876178888562816:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789263699.376233:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd991567050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+10:6687:x1876178888562816:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 114us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263699.376241:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 247 00000100:00100000:2.0:1789263699.377462:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263699.377523:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888562944 00000100:00100000:0.0:1789263699.377531:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888562944 00000100:00100000:0.0:1789263699.377576:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 248 00000100:00100000:0.0:1789263699.377584:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd991566850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+10:6687:x1876178888562944:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789263699.377691:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd991566850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+10:6687:x1876178888562944:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 107us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263699.377700:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 248 00000100:00100000:0.0:1789263699.501206:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789263699.501226:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898048768:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789263699.501278:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789263699.501291:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898048896:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789263699.501299:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263699.501336:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263699.501350:0:8396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898048768 00000100:00100000:3.0:1789263699.501358:0:8396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898048768 00000100:00100000:2.0:1789263699.501376:0:8512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898048896 00000100:00100000:2.0:1789263699.501379:0:8512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898048896 00000100:00100000:3.0:1789263699.501406:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789263699.501417:0:8396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8840b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876178898048768:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789263699.501417:0:8512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789263699.501434:0:8512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883f5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1876178898048896:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789263699.501447:0:8396:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00002000:00000024:2.0:1789263699.501447:0:8512:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789263699.501484:0:8512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883f5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1876178898048896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 51us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263699.501492:0:8512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789263699.501503:0:8396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8840b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876178898048768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263699.501508:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1789263699.501561:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd883f5ed80 x1876178898048896/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789263715 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263699.501579:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898048896:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1789263699.501604:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd883f5df80 x1876178898048768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789263715 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263699.501615:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898048768:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789263699.502157:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789263699.502168:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898049024:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789263699.502221:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263699.502247:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898049024 00000100:00100000:2.0:1789263699.502253:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898049024 00000100:00100000:2.0:1789263699.502285:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789263699.502292:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88397d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1876178898049024:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789263699.502317:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789263699.502362:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88397d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1876178898049024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 70us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263699.502368:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789263699.502473:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898049024:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789263700.398556:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789263701.037273:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898049152:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789263701.037366:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263701.037423:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898049152 00000100:00100000:2.0:1789263701.037432:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898049152 00000100:00100000:2.0:1789263701.037486:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789263701.037498:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88397c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1876178898049152:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789263701.037531:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789263701.037593:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88397c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1876178898049152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263701.037602:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789263701.037622:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898049152:0@lo:41:osp-pre-0-1.0 00000001:02000400:0.0:1789263701.198896:0:10659:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg320-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:3.0:1789263701.421706:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263702.445476:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789263702.969553:0:10902:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg320-server.virtnet: executing yml_node 00010000:00010000:1.0:1789263703.471122:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789263703.484104:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263703.484136:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888563072 00000100:00100000:2.0:1789263703.484155:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888563072 00000100:00100000:1.0:1789263703.484163:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263703.484202:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263703.484209:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 249 00000100:00100000:2.0:1789263703.484218:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd991567c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+10:2398:x1876178888563072:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1789263703.484228:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263703.484255:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263703.484282:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd991567c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+10:2398:x1876178888563072:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 64us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263703.484289:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888563328 00000100:00100000:2.0:1789263703.484294:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 249 00000100:00100000:1.0:1789263703.484300:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888563328 00000100:00100000:1.0:1789263703.484343:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888563200 00000100:00100000:1.0:1789263703.484345:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888563200 00000100:00100000:1.0:1789263703.484367:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 37 00000100:00100000:1.0:1789263703.484374:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882611180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+5:2398:x1876178888563328:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1789263703.484414:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882611180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+5:2398:x1876178888563328:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 40us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263703.484421:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 37 00000100:00100000:1.0:1789263703.484439:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 38 00000100:00100000:1.0:1789263703.484447:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882612d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+6:2398:x1876178888563200:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1789263703.484457:0:8395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888563584 00000100:00100000:3.0:1789263703.484463:0:8395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888563584 00000100:00100000:1.0:1789263703.484476:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882612d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+6:2398:x1876178888563200:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 30us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263703.484484:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 38 00000100:00100000:3.0:1789263703.484494:0:8395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888563456 00000100:00100000:3.0:1789263703.484499:0:8395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888563456 00000100:00100000:3.0:1789263703.484525:0:8395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 16 00000100:00100000:3.0:1789263703.484534:0:8395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882613480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+5:2398:x1876178888563584:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1789263703.484575:0:8395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882613480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+5:2398:x1876178888563584:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 42us (373us total) trans 0 rc 0/0 00000100:00080000:1.0:1789263703.484575:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789263703.484580:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789263703.484585:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789263703.484590:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789263703.484594:0:8395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 16 00000100:00100000:1.0:1789263703.484605:0:8392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 17 00000100:00100000:1.0:1789263703.484615:0:8392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882612a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+5:2398:x1876178888563456:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1789263703.484643:0:8392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882612a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+5:2398:x1876178888563456:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 30us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263703.484650:0:8392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 17 00000100:00100000:3.0:1789263704.109279:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876178898049664:0@lo:400:kworker.0 00000100:00100000:0.0:1789263704.109280:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:66a76ccf-c64c-4b18-8369-a2861ec3956c:3621:1876178898049536:0@lo:400:kworker.0 00000100:00100000:1.0:1789263704.109292:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898049280:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789263704.109369:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263704.109371:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263704.109374:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263704.109417:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898049536 00000100:00100000:2.0:1789263704.109426:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898049536 00000100:00100000:1.0:1789263704.109428:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898049792:0@lo:400:kworker.0 00000100:00100000:0.0:1789263704.109438:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3621:1876178898050048:0@lo:400:kworker.0 00000100:00100000:3.0:1789263704.109439:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1876178898050176:0@lo:400:kworker.0 00000100:00100000:2.0:1789263704.109476:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1789263704.109490:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd991564050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+24:3621:x1876178898049536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789263704.109498:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263704.109498:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263704.109533:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898049280 00000100:00100000:3.0:1789263704.109539:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898049280 00000100:00100000:0.0:1789263704.109540:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898050560:0@lo:400:kworker.0 00000100:00100000:1.0:1789263704.109552:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898050304:0@lo:400:kworker.0 00000100:00100000:2.0:1789263704.109555:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd991564050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+24:3621:x1876178898049536:12345-0@lo:400:kworker.0 Request processed in 67us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263704.109565:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1789263704.109577:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263704.109591:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789263704.109598:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8840b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898049408:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789263704.109604:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882613800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1876178898049280:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789263704.109618:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898049664 00002000:00000024:3.0:1789263704.109633:0:8397:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789263704.109635:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898049664 00000100:00100000:1.0:1789263704.109648:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263704.109669:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898050048 00000100:00100000:1.0:1789263704.109677:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1876178898049920:0@lo:400:kworker.0 00000100:00100000:2.0:1789263704.109683:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898050048 00000100:00100000:3.0:1789263704.109684:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882613800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1876178898049280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263704.109694:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898051072:0@lo:400:kworker.0 00000100:00100000:3.0:1789263704.109695:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789263704.109713:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263704.109718:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789263704.109720:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898049408 00000100:00100000:3.0:1789263704.109725:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898049408 00000100:00100000:2.0:1789263704.109728:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88397f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876178898049664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263704.109736:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263704.109741:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898050432:0@lo:400:kworker.0 00000100:00100000:3.0:1789263704.109762:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789263704.109773:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882611c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1876178898049408:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789263704.109776:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88397f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876178898049664:12345-0@lo:400:kworker.0 Request processed in 50us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263704.109782:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:66a76ccf-c64c-4b18-8369-a2861ec3956c:3621:1876178898049536:0@lo:400:kworker.0 00000100:00100000:1.0:1789263704.109787:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263704.109790:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00002000:00000024:3.0:1789263704.109793:0:8397:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789263704.109814:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898049920 00000100:00100000:1.0:1789263704.109816:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898050944:0@lo:400:kworker.0 00000100:00100000:2.0:1789263704.109819:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898049920 00000100:00100000:0.0:1789263704.109827:0:8499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898049792 00000100:00100000:3.0:1789263704.109828:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882611c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1876178898049408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263704.109833:0:8499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898049792 00000100:00100000:3.0:1789263704.109838:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789263704.109847:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789263704.109858:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8840b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1876178898050048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789263704.109863:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263704.109872:0:8499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898050432 00000100:00100000:3.0:1789263704.109876:0:8395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898050560 00000100:00100000:0.0:1789263704.109877:0:8499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898050432 00000100:00100000:3.0:1789263704.109883:0:8395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898050560 00000100:00100000:0.0:1789263704.109912:0:8499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789263704.109917:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8840b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1876178898050048:12345-0@lo:400:kworker.0 Request processed in 61us (427us total) trans 0 rc 0/0 00010000:00080000:1.0:1789263704.109918:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd8840b3100 x1876178898049408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789263720 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263704.109923:0:8395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898051072 00000100:00100000:2.0:1789263704.109928:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789263704.109930:0:8395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898051072 00000100:00100000:0.0:1789263704.109936:0:8499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882610e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1876178898049792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789263704.109944:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789263704.109949:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8840b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898049408:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789263704.109953:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882613100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1876178898049920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263704.109955:0:8395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898050944 00000100:00100000:3.0:1789263704.109959:0:8395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898050944 00000100:00100000:0.0:1789263704.109985:0:8499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882610e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1876178898049792:12345-0@lo:400:kworker.0 Request processed in 62us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263704.109995:0:8395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789263704.110004:0:8395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8840b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1876178898050560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263704.110007:0:8499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789263704.110018:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882613100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1876178898049920:12345-0@lo:400:kworker.0 Request processed in 66us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263704.110021:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789263704.110032:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789263704.110037:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882613b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1876178898050432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263704.110052:0:8392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789263704.110054:0:8395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8840b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1876178898050560:12345-0@lo:400:kworker.0 Request processed in 49us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263704.110064:0:8392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8840b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1876178898051072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263704.110065:0:8395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789263704.110106:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882613b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1876178898050432:12345-0@lo:400:kworker.0 Request processed in 73us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263704.110108:0:8511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789263704.110117:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789263704.110123:0:8511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882611880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898050944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263704.110134:0:8392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8840b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1876178898051072:12345-0@lo:400:kworker.0 Request processed in 72us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263704.110153:0:8392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789263704.110175:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1876178898049920:0@lo:400:kworker.0 00000100:00100000:2.0:1789263704.110185:0:8511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882611880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898050944:12345-0@lo:400:kworker.0 Request processed in 65us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263704.110186:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789263704.110187:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789263704.110194:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898050432:0@lo:400:kworker.0 00000100:00080000:3.0:1789263704.110195:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789263704.110200:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789263704.110200:0:8511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1789263704.110219:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd9bfa70a80 x1876178898050944/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789263720 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263704.110219:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1876178898050688:0@lo:400:kworker.0 00000100:00100000:3.0:1789263704.110224:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898050176 00000100:00100000:3.0:1789263704.110230:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898050176 00000100:00100000:2.0:1789263704.110241:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263704.110243:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898050944:0@lo:400:kworker.0 00000100:00100000:2.0:1789263704.110271:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1876178898050816:0@lo:400:kworker.0 00000100:00100000:0.0:1789263704.110273:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263704.110279:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789263704.110291:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8840b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876178898050176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789263704.110312:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263704.110312:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3621:1876178898050048:0@lo:400:kworker.0 00000100:00100000:0.0:1789263704.110320:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876178898049664:0@lo:400:kworker.0 00010000:00080000:1.0:1789263704.110336:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd883f5d500 x1876178898050560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789263720 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263704.110345:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8840b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876178898050176:12345-0@lo:400:kworker.0 Request processed in 55us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263704.110348:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898050560:0@lo:400:kworker.0 00010000:00080000:0.0:1789263704.110353:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd883f5df80 x1876178898050176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263720 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1789263704.110357:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd88397dc00 x1876178898049280/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789263720 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263704.110362:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:1.0:1789263704.110369:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd9bfa73b80 x1876178898051072/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789263720 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263704.110377:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898050688 00000100:00100000:3.0:1789263704.110385:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898050688 00000100:00100000:0.0:1789263704.110389:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1876178898050176:0@lo:400:kworker.0 00000100:00100000:2.0:1789263704.110394:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898049280:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789263704.110396:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898051072:0@lo:400:kworker.0 00000100:00100000:2.0:1789263704.110415:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898049792:0@lo:400:kworker.0 00000100:00100000:3.0:1789263704.110421:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898050816 00000100:00100000:3.0:1789263704.110427:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898050816 00000100:00100000:0.0:1789263704.110427:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789263704.110441:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883f5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1876178898050688:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789263704.110462:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789263704.110467:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789263704.110469:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789263704.110481:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1876178898050816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789263704.110482:0:8395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898050304 00000100:00100000:2.0:1789263704.110488:0:8395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898050304 00000100:00100000:0.0:1789263704.110489:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883f5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1876178898050688:12345-0@lo:400:kworker.0 Request processed in 50us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263704.110499:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789263704.110512:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1876178898050688:0@lo:400:kworker.0 00000100:00100000:2.0:1789263704.110527:0:8395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789263704.110536:0:8395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1876178898050304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263704.110539:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1876178898050816:12345-0@lo:400:kworker.0 Request processed in 60us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263704.110550:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:1.0:1789263704.110577:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd883f5fb80 x1876178898050816/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263720 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789263704.110578:0:8395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1876178898050304:12345-0@lo:400:kworker.0 Request processed in 42us (336us total) trans 0 rc 0/0 00000100:00080000:3.0:1789263704.110581:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789263704.110594:0:8395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789263704.110598:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1876178898050816:0@lo:400:kworker.0 00010000:00080000:1.0:1789263704.110620:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd883f5ed80 x1876178898050304/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789263720 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789263704.110629:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898050304:0@lo:400:kworker.0 00010000:00010000:0.0:1789263704.493255:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789263704.621267:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898051200:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789263704.621268:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876178898051328:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789263704.621317:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898051456:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789263704.621346:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263704.621381:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263704.621415:0:8499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898051456 00000100:00100000:1.0:1789263704.621421:0:8499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898051456 00000100:00100000:2.0:1789263704.621433:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898051328 00000100:00100000:2.0:1789263704.621439:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898051328 00000100:00100000:1.0:1789263704.621458:0:8499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789263704.621469:0:8499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883f5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1876178898051456:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789263704.621476:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789263704.621486:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1876178898051328:12345-0@lo:13:osp-pre-0-0.0 00000004:00000024:1.0:1789263704.621502:0:8499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00002000:00000024:2.0:1789263704.621508:0:8397:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789263704.621557:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1876178898051328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263704.621565:0:8499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883f5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1876178898051456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263704.621569:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789263704.621588:0:8499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789263704.621611:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263704.621636:0:8396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898051200 00000100:00100000:1.0:1789263704.621641:0:8396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898051200 00010000:00080000:2.0:1789263704.621663:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd9bfa72d80 x1876178898051328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789263720 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789263704.621669:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789263704.621683:0:8396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876178898051200:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789263704.621692:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876178898051328:0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789263704.621697:0:8396:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789263704.621754:0:8396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876178898051200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263704.621761:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1789263704.621815:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd883f5df80 x1876178898051200/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789263720 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789263704.621826:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898051200:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789263704.621983:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898051456:0@lo:41:osp-pre-1-0.0 00000001:02000400:0.0:1789263704.811697:0:11086:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.103 00010000:00010000:3.0:1789263705.517388:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789263705.952093:0:11183:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.103 00000100:00100000:3.0:1789263706.158197:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789263706.158219:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898051584:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789263706.158349:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263706.160002:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898051584 00000100:00100000:1.0:1789263706.160011:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898051584 00000100:00100000:1.0:1789263706.160069:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789263706.160113:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88397ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898051584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789263706.160159:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789263706.160236:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88397ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898051584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 158us (1887us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263706.160252:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789263706.160400:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898051584:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789263706.541520:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789263707.068817:0:11280:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.103 00010000:00010000:0.0:1789263707.566351:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789263707.761463:0:11328:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Sat Sep 12 21:41:47 EDT 2026 00010000:00010000:3.0:1789263708.591122:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789263708.602730:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263708.602782:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888563712 00000100:00100000:0.0:1789263708.602792:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888563712 00000100:00100000:3.0:1789263708.602808:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263708.602843:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 251 00000100:00100000:3.0:1789263708.602850:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263708.602858:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd991564850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+10:2397:x1876178888563712:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1789263708.602866:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888563840 00000100:00100000:1.0:1789263708.602872:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888563840 00000100:00100000:1.0:1789263708.602926:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 45 00000100:00100000:0.0:1789263708.602927:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd991564850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+10:2397:x1876178888563712:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 71us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263708.602939:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88397fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+6:2398:x1876178888563840:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789263708.602940:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 251 00000100:00100000:3.0:1789263708.602962:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263708.602982:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88397fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+6:2398:x1876178888563840:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 46us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263708.602991:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 45 00000100:00100000:1.0:1789263708.603015:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888563968 00000100:00100000:1.0:1789263708.603019:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888563968 00000100:00100000:1.0:1789263708.603056:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 46 00000100:00100000:1.0:1789263708.603066:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88397df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+5:2397:x1876178888563968:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1789263708.603126:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263708.603137:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88397df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+5:2397:x1876178888563968:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 72us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263708.603146:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 46 00000100:00100000:0.0:1789263708.603165:0:8511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888564096 00000100:00080000:1.0:1789263708.603170:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789263708.603171:0:8511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888564096 00000100:00080000:1.0:1789263708.603176:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789263708.603196:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789263708.603215:0:8511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888564224 00000100:00100000:0.0:1789263708.603218:0:8511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888564224 00000100:00100000:3.0:1789263708.603237:0:8392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 22 00000100:00080000:1.0:1789263708.603237:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789263708.603252:0:8392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88397ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+5:2398:x1876178888564096:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1789263708.603269:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 23 00000100:00100000:1.0:1789263708.603281:0:8394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88397ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+5:2397:x1876178888564224:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1789263708.603322:0:8394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88397ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+5:2397:x1876178888564224:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 41us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263708.603330:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 23 00000100:00100000:3.0:1789263708.603489:0:8392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88397ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+5:2398:x1876178888564096:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 241us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263708.603498:0:8392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 22 00000100:00100000:1.0:1789263709.229330:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898051712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789263709.229348:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898051968:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789263709.229550:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1876178898052096:0@lo:400:kworker.0 00000100:00100000:0.0:1789263709.229637:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:66a76ccf-c64c-4b18-8369-a2861ec3956c:3619:1876178898051840:0@lo:400:kworker.0 00000100:00100000:0.0:1789263709.229683:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263709.229689:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263709.229753:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263709.229764:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263709.229802:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898051840 00000100:00100000:1.0:1789263709.229803:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898051968 00000100:00100000:1.0:1789263709.229810:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898051968 00000100:00100000:2.0:1789263709.229811:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898051840 00000100:00100000:1.0:1789263709.229858:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898051712 00000100:00100000:1.0:1789263709.229862:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898051712 00000100:00100000:2.0:1789263709.229863:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1789263709.229876:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd991564c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+24:3619:x1876178898051840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789263709.229886:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789263709.229896:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898051968:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789263709.229921:0:8397:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789263709.229926:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd991564c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+24:3619:x1876178898051840:12345-0@lo:400:kworker.0 Request processed in 50us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263709.229952:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1789263709.229961:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898051968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263709.229980:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789263709.229999:0:8512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789263709.230008:0:8512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882610380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876178898051712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789263709.230018:0:8512:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789263709.230045:0:8512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882610380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876178898051712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 39us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263709.230115:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:66a76ccf-c64c-4b18-8369-a2861ec3956c:3619:1876178898051840:0@lo:400:kworker.0 00010000:00080000:3.0:1789263709.230118:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd88397dc00 x1876178898051968/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789263725 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263709.230128:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1876178898052352:0@lo:400:kworker.0 00000100:00100000:3.0:1789263709.230138:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898051968:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789263709.230159:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263709.230163:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1876178898052480:0@lo:400:kworker.0 00000100:00100000:0.0:1789263709.230185:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876178898052864:0@lo:400:kworker.0 00000100:00100000:3.0:1789263709.230196:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263709.230220:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898052992:0@lo:400:kworker.0 00000100:00100000:3.0:1789263709.230263:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263709.230283:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898053504:0@lo:400:kworker.0 00000100:00100000:3.0:1789263709.230313:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263709.230345:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898052096 00000100:00100000:3.0:1789263709.230349:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898052096 00000100:00100000:3.0:1789263709.230374:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898052352 00000100:00100000:3.0:1789263709.230377:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898052352 00000100:00100000:3.0:1789263709.230392:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898052480 00000100:00100000:3.0:1789263709.230396:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898052480 00000100:00100000:3.0:1789263709.230408:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789263709.230412:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1876178898052096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263709.230452:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1876178898052096:12345-0@lo:400:kworker.0 Request processed in 38us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263709.230458:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789263709.230472:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789263709.230478:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883f5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1876178898052352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263709.230504:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883f5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1876178898052352:12345-0@lo:400:kworker.0 Request processed in 27us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263709.230511:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789263709.230522:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789263709.230527:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1876178898052480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263709.230551:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1876178898052480:12345-0@lo:400:kworker.0 Request processed in 25us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263709.230556:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789263709.230571:0:8511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898052992 00000100:00100000:3.0:1789263709.230574:0:8511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898052992 00000100:00100000:3.0:1789263709.230593:0:8511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898053504 00000100:00100000:3.0:1789263709.230595:0:8511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898053504 00000100:00100000:3.0:1789263709.230608:0:8511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789263709.230614:0:8511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3620:x1876178898052992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263709.230645:0:8511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3620:x1876178898052992:12345-0@lo:400:kworker.0 Request processed in 32us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263709.230651:0:8511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789263709.230661:0:8511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789263709.230666:0:8511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88397dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3620:x1876178898053504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263709.230684:0:8511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88397dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3620:x1876178898053504:12345-0@lo:400:kworker.0 Request processed in 19us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263709.230688:0:8511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789263709.230716:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1876178898052096:0@lo:400:kworker.0 00000100:00100000:3.0:1789263709.230723:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3621:1876178898052608:0@lo:400:kworker.0 00000100:00100000:3.0:1789263709.230741:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263709.230755:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3621:1876178898053120:0@lo:400:kworker.0 00000100:00100000:3.0:1789263709.230776:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263709.230799:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898052608 00000100:00100000:3.0:1789263709.230801:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898052608 00000100:00100000:3.0:1789263709.230814:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898053120 00000100:00100000:3.0:1789263709.230816:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898053120 00000100:00100000:3.0:1789263709.230827:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789263709.230831:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaa8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1876178898052608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263709.230857:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaa8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1876178898052608:12345-0@lo:400:kworker.0 Request processed in 26us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263709.230863:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789263709.230874:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789263709.230881:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1876178898053120:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789263709.230888:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789263709.230895:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789263709.230898:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789263709.230901:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789263709.230909:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1876178898053120:12345-0@lo:400:kworker.0 Request processed in 28us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263709.230921:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:1.0:1789263709.230944:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd883f5ce00 x1876178898051712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789263725 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1789263709.230954:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd9bfa70000 x1876178898052608/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263725 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789263709.230964:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898051712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789263709.230967:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3621:1876178898052608:0@lo:400:kworker.0 00000100:00100000:3.0:1789263709.230980:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3621:1876178898053120:0@lo:400:kworker.0 00000100:00100000:1.0:1789263709.230986:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898052224:0@lo:400:kworker.0 00000100:00100000:3.0:1789263709.231005:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1876178898052480:0@lo:400:kworker.0 00010000:00080000:3.0:1789263709.231017:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd9bfa73800 x1876178898052992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789263725 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263709.231025:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898052992:0@lo:400:kworker.0 00010000:00080000:3.0:1789263709.231032:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd9bfa73b80 x1876178898053504/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789263725 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263709.231039:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898053504:0@lo:400:kworker.0 00000100:00100000:2.0:1789263709.231285:0:8512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789263709.231376:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263709.231406:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898052224 00000100:00100000:0.0:1789263709.231412:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898052224 00000100:00100000:1.0:1789263709.231419:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898052736:0@lo:400:kworker.0 00000100:00100000:2.0:1789263709.231427:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263709.231452:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898052864 00000100:00100000:0.0:1789263709.231456:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898052864 00000100:00100000:2.0:1789263709.231465:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898053376:0@lo:400:kworker.0 00000100:00100000:1.0:1789263709.231473:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263709.231477:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789263709.231487:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882610000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1876178898052224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789263709.231504:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263709.231504:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1876178898053248:0@lo:400:kworker.0 00000100:00100000:3.0:1789263709.231519:0:8499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789263709.231531:0:8499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1876178898052864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263709.231545:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882610000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1876178898052224:12345-0@lo:400:kworker.0 Request processed in 58us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263709.231546:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263709.231556:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789263709.231559:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1876178898052352:0@lo:400:kworker.0 00000100:00100000:1.0:1789263709.231588:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898052224:0@lo:400:kworker.0 00000100:00100000:2.0:1789263709.231590:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876178898052864:0@lo:400:kworker.0 00000100:00100000:3.0:1789263709.231596:0:8499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1876178898052864:12345-0@lo:400:kworker.0 Request processed in 66us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263709.231598:0:8511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898052736 00000100:00100000:0.0:1789263709.231604:0:8511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898052736 00000100:00100000:3.0:1789263709.231609:0:8499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789263709.231627:0:8395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898053376 00000100:00100000:1.0:1789263709.231628:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898053248 00000100:00100000:2.0:1789263709.231633:0:8395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898053376 00000100:00100000:1.0:1789263709.231634:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898053248 00000100:00080000:3.0:1789263709.231647:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789263709.231654:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789263709.231660:0:8511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789263709.231672:0:8511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882610a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1876178898052736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789263709.231679:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789263709.231680:0:8395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789263709.231694:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883968700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1876178898053248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789263709.231696:0:8395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1876178898053376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263709.231719:0:8511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882610a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1876178898052736:12345-0@lo:400:kworker.0 Request processed in 50us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263709.231727:0:8511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789263709.231749:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883968700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1876178898053248:12345-0@lo:400:kworker.0 Request processed in 58us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263709.231757:0:8395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1876178898053376:12345-0@lo:400:kworker.0 Request processed in 64us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263709.231764:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789263709.231768:0:8395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1789263709.231789:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd9bfa71880 x1876178898052736/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789263725 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1789263709.231792:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd9bfa73100 x1876178898053376/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789263725 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263709.231823:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898053376:0@lo:400:kworker.0 00000100:00100000:0.0:1789263709.231823:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898052736:0@lo:400:kworker.0 00010000:00080000:0.0:1789263709.231833:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd9bfa71c00 x1876178898053248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263725 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263709.231842:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1876178898053248:0@lo:400:kworker.0 00010000:00010000:1.0:1789263709.613497:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789263709.741349:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898053760:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789263709.741440:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263709.741504:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898053760 00000100:00100000:0.0:1789263709.741508:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789263709.741512:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898053760 00000100:00100000:0.0:1789263709.741517:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898053888:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789263709.741552:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263709.741567:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898053632:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789263709.741581:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898053888 00000100:00100000:2.0:1789263709.741586:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898053888 00000100:00100000:0.0:1789263709.741595:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789263709.741614:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789263709.741614:0:8396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883f5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876178898053760:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789263709.741615:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263709.741628:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883f5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876178898053888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789263709.741648:0:8396:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00002000:00000024:2.0:1789263709.741657:0:8397:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789263709.741694:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898053632 00000100:00100000:3.0:1789263709.741699:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898053632 00000100:00100000:2.0:1789263709.741726:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883f5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876178898053888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263709.741728:0:8396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883f5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876178898053760:12345-0@lo:13:osp-pre-0-1.0 Request processed in 122us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263709.741741:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789263709.741744:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789263709.741752:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789263709.741754:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1876178898053632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789263709.741781:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00010000:00080000:0.0:1789263709.741801:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd9bfa71500 x1876178898053888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789263725 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263709.741823:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898053888:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789263709.741835:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1876178898053632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (222us total) trans 0 rc 0/0 00010000:00080000:0.0:1789263709.741842:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd9bfa70700 x1876178898053760/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789263725 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263709.741846:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789263709.741862:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898053632:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789263709.741865:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898053760:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789263710.638273:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789263711.278440:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789263711.278469:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898054016:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789263711.278536:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263711.278583:0:8499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898054016 00000100:00100000:2.0:1789263711.278591:0:8499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898054016 00000100:00100000:2.0:1789263711.278642:0:8499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789263711.278652:0:8499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883f5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1876178898054016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789263711.278683:0:8499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789263711.278730:0:8499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883f5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1876178898054016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263711.278737:0:8499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789263711.278858:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898054016:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789263711.662266:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263712.685280:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789263713.639285:0:11956:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 21:41:53 (1789263713) === 00010000:00010000:3.0:1789263713.710398:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789263713.723159:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263713.723214:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888564352 00000100:00100000:0.0:1789263713.723224:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888564352 00000100:00100000:3.0:1789263713.723253:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263713.723295:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 253 00000100:00100000:3.0:1789263713.723299:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263713.723301:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888564480 00000100:00100000:1.0:1789263713.723306:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888564480 00000100:00100000:0.0:1789263713.723311:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd991567850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+10:2399:x1876178888564352:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1789263713.723328:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263713.723338:0:8394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888564736 00000100:00100000:2.0:1789263713.723345:0:8394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888564736 00000100:00100000:1.0:1789263713.723360:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888564608 00000100:00100000:1.0:1789263713.723365:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888564608 00000100:00100000:3.0:1789263713.723373:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263713.723388:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd991567850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+10:2399:x1876178888564352:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 81us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263713.723393:0:8394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888564864 00000100:00100000:2.0:1789263713.723399:0:8394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888564864 00000100:00100000:0.0:1789263713.723399:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 253 00000100:00100000:1.0:1789263713.723406:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 53 00000100:00100000:1.0:1789263713.723416:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+6:2400:x1876178888564480:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789263713.723438:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 28 00000100:00100000:2.0:1789263713.723449:0:8394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaa9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+5:2400:x1876178888564736:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1789263713.723456:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+6:2400:x1876178888564480:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 39us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263713.723464:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 53 00000100:00100000:1.0:1789263713.723479:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 54 00000100:00100000:1.0:1789263713.723488:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+5:2399:x1876178888564608:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789263713.723492:0:8394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaa9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+5:2400:x1876178888564736:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 42us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263713.723502:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 28 00000100:00100000:1.0:1789263713.723517:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+5:2399:x1876178888564608:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 30us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263713.723525:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 54 00000100:00100000:2.0:1789263713.723529:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 29 00000100:00100000:2.0:1789263713.723552:0:8394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaa8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+5:2399:x1876178888564864:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789263713.723585:0:8394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaa8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+5:2399:x1876178888564864:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 48us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263713.723600:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 29 00000100:00080000:3.0:1789263713.723824:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789263713.723828:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789263713.723829:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789263713.723830:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789263713.838867:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263713.838922:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888564992 00000100:00100000:0.0:1789263713.838936:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888564992 00000100:00100000:0.0:1789263713.838996:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 254 00000100:00100000:0.0:1789263713.839007:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd991565050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+10:8698:x1876178888564992:12345-192.168.203.20@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789263713.839024:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263713.839042:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd883e73400/0xce1582440fb1d9d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11bdc expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263713.839071:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd883e73400/0xce1582440fb1d9d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11bdc expref: 11 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263713.839129:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd883e73400/0xce1582440fb1d9d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11bdc expref: 11 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263713.839139:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd883e73400, rc 0) 00000100:00100000:0.0:1789263713.839202:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd991565050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+11:8698:x1876178888564992:12345-192.168.203.20@tcp:101:mount.lustre.0 Request processed in 197us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263713.839284:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 254 00000100:00100000:0.0:1789263713.840957:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263713.841004:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888565120 00000100:00100000:3.0:1789263713.841012:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888565120 00000100:00100000:3.0:1789263713.841055:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 255 00000100:00100000:3.0:1789263713.841072:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd991566450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+11:8698:x1876178888565120:12345-192.168.203.20@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789263713.841259:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd991566450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+11:8698:x1876178888565120:12345-192.168.203.20@tcp:501:mount.lustre.0 Request processed in 195us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263713.841268:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 255 00000100:00100000:1.0:1789263713.842151:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263713.842224:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888565248 00000100:00100000:0.0:1789263713.842230:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888565248 00000100:00100000:0.0:1789263713.842262:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 256 00000100:00100000:0.0:1789263713.842270:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd988441050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+11:8698:x1876178888565248:12345-192.168.203.20@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789263713.842361:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd988441050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+11:8698:x1876178888565248:12345-192.168.203.20@tcp:503:mount.lustre.0 Request processed in 92us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263713.842367:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 256 00000100:00100000:2.0:1789263713.843750:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263713.843848:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888565376 00000100:00100000:3.0:1789263713.843855:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888565376 00000100:00100000:3.0:1789263713.843896:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 257 00000100:00100000:3.0:1789263713.843906:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd988442050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+11:8702:x1876178888565376:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789263713.844026:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd988442050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+11:8702:x1876178888565376:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 121us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263713.844034:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 257 00000100:00100000:2.0:1789263713.853842:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263713.853903:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888565504 00000100:00100000:0.0:1789263713.853912:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888565504 00000100:00100000:0.0:1789263713.853972:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 258 00000100:00100000:0.0:1789263713.853983:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd988442c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+11:8702:x1876178888565504:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789263713.854182:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd988442c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+11:8702:x1876178888565504:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 200us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263713.854190:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 258 00000100:00100000:1.0:1789263713.856163:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263713.856288:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888565632 00000100:00100000:3.0:1789263713.856297:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888565632 00000100:00100000:3.0:1789263713.856346:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 259 00000100:00100000:3.0:1789263713.856355:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a07450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+11:8702:x1876178888565632:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789263713.856479:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a07450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+11:8702:x1876178888565632:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 121us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263713.856487:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 259 00000100:00100000:2.0:1789263713.857741:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263713.857790:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888565760 00000100:00100000:0.0:1789263713.857796:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888565760 00000100:00100000:0.0:1789263713.857838:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 260 00000100:00100000:0.0:1789263713.857846:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a07050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+11:8698:x1876178888565760:12345-192.168.203.20@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789263713.857858:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263713.857873:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd883e72400/0xce1582440fb1d9dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11c0d expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263713.857893:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd883e72400/0xce1582440fb1d9dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11c0d expref: 12 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263713.857914:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd883e72400/0xce1582440fb1d9dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11c0d expref: 12 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263713.857933:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd883e72400, rc 0) 00000100:00100000:0.0:1789263713.857968:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a07050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+12:8698:x1876178888565760:12345-192.168.203.20@tcp:101:mount.lustre.0 Request processed in 124us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263713.857977:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 260 00000100:00100000:0.0:1789263713.859632:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263713.859693:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888565888 00000100:00100000:2.0:1789263713.859702:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888565888 00000100:00100000:2.0:1789263713.859749:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 261 00000100:00100000:2.0:1789263713.859757:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a05850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+12:8698:x1876178888565888:12345-192.168.203.20@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789263713.859776:0:6480:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789263713.859792:0:6480:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789263713.859926:0:6480:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789263713.859930:0:6480:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789263713.859933:0:6480:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1789263713.859936:0:6480:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:2.0:1789263713.861245:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a05850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+12:8698:x1876178888565888:12345-192.168.203.20@tcp:256:mount.lustre.0 Request processed in 1481us (1612us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263713.861253:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 261 00000100:00100000:3.0:1789263713.863403:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263713.863456:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888566016 00000100:00100000:0.0:1789263713.863464:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888566016 00000100:00100000:0.0:1789263713.863509:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 262 00000100:00100000:0.0:1789263713.863520:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a07850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+12:8698:x1876178888566016:12345-192.168.203.20@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789263713.863536:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263713.863551:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd883e73e00/0xce1582440fb1d9e4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11c14 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263713.863574:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd883e73e00/0xce1582440fb1d9e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11c14 expref: 13 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263713.863583:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd883e73e00/0xce1582440fb1d9e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11c14 expref: 13 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263713.863590:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd883e73e00, rc 0) 00000100:00100000:0.0:1789263713.863636:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a07850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+13:8698:x1876178888566016:12345-192.168.203.20@tcp:101:mount.lustre.0 Request processed in 119us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263713.863643:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 262 00000100:00100000:0.0:1789263713.864502:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263713.864559:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888566144 00000100:00100000:2.0:1789263713.864566:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888566144 00000100:00100000:2.0:1789263713.864605:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 263 00000100:00100000:2.0:1789263713.864614:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a04050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+13:8698:x1876178888566144:12345-192.168.203.20@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789263713.864730:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a04050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+13:8698:x1876178888566144:12345-192.168.203.20@tcp:501:mount.lustre.0 Request processed in 117us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263713.864738:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 263 00000100:00100000:1.0:1789263713.865551:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263713.865609:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888566272 00000100:00100000:0.0:1789263713.865616:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888566272 00000100:00100000:0.0:1789263713.865648:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 264 00000100:00100000:0.0:1789263713.865657:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a04850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+13:8698:x1876178888566272:12345-192.168.203.20@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789263713.865758:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a04850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+13:8698:x1876178888566272:12345-192.168.203.20@tcp:503:mount.lustre.0 Request processed in 101us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263713.865766:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 264 00000100:00100000:3.0:1789263713.868113:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263713.868280:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888566400 00000100:00100000:2.0:1789263713.868287:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888566400 00000100:00100000:2.0:1789263713.868340:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 265 00000100:00100000:2.0:1789263713.868349:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a06850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+13:8704:x1876178888566400:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789263713.868475:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a06850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+13:8704:x1876178888566400:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 127us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263713.868481:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 265 00000100:00100000:2.0:1789263713.870644:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263713.871130:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888566528 00000100:00100000:0.0:1789263713.871139:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888566528 00000100:00100000:0.0:1789263713.871183:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 266 00000100:00100000:0.0:1789263713.871193:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a04450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+13:8704:x1876178888566528:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789263713.871321:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a04450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+13:8704:x1876178888566528:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 129us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263713.871329:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 266 00000100:00100000:1.0:1789263713.872968:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263713.873052:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888566656 00000100:00100000:2.0:1789263713.873059:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888566656 00000100:00100000:2.0:1789263713.873130:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 15 00000100:00100000:2.0:1789263713.873138:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88396ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2396:x1876178888566656:12345-192.168.203.20@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789263713.873166:0:7434:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 857a0866-badb-47ac-9591-fbf273e4680e@192.168.203.20@tcp t0 exp 0000000000000000 cur 156 last 0 00000020:00000080:2.0:1789263713.873206:0:7434:0:(genops.c:1385:class_connect()) connect: client 857a0866-badb-47ac-9591-fbf273e4680e, cookie 0xce1582440fb1d9eb 00000004:00100000:2.0:1789263713.873234:0:7434:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789263713.873332:0:7434:0:(import.c:65:import_set_state_nolock()) ffff9dd883fac000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789263713.873394:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88396ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:857a0866-badb-47ac-9591-fbf273e4680e+6:2396:x1876178888566656:12345-192.168.203.20@tcp:38:mount.lustre.0 Request processed in 255us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263713.873401:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 15 00000100:00100000:3.0:1789263713.873534:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263713.873739:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888566912 00000100:00100000:1.0:1789263713.873743:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888566912 00000100:00100000:1.0:1789263713.873764:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 16 00000100:00100000:1.0:1789263713.873768:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2396:x1876178888566912:12345-192.168.203.20@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789263713.873780:0:8417:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 857a0866-badb-47ac-9591-fbf273e4680e@192.168.203.20@tcp t0 exp 0000000000000000 cur 156 last 0 00000020:00000080:1.0:1789263713.873796:0:8417:0:(genops.c:1385:class_connect()) connect: client 857a0866-badb-47ac-9591-fbf273e4680e, cookie 0xce1582440fb1d9f2 00000004:00100000:1.0:1789263713.873805:0:8417:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789263713.873855:0:8417:0:(import.c:65:import_set_state_nolock()) ffff9dd9bfa30000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789263713.873969:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:857a0866-badb-47ac-9591-fbf273e4680e+6:2396:x1876178888566912:12345-192.168.203.20@tcp:38:mount.lustre.0 Request processed in 198us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263713.873990:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 16 00000100:00100000:3.0:1789263713.875546:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263713.875650:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263713.875944:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263713.876102:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888567168 00000100:00100000:1.0:1789263713.876109:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888567168 00000100:00100000:1.0:1789263713.876166:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888567040 00000100:00100000:1.0:1789263713.876170:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888567040 00000100:00080000:0.0:1789263713.876173:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789263713.876179:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789263713.876208:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 17 00000100:00100000:0.0:1789263713.876218:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 18 00000100:00100000:1.0:1789263713.876220:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:857a0866-badb-47ac-9591-fbf273e4680e+6:8698:x1876178888567168:12345-192.168.203.20@tcp:41:mount.lustre.0 00000100:00100000:0.0:1789263713.876233:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:857a0866-badb-47ac-9591-fbf273e4680e+6:0:x1876178888567040:12345-192.168.203.20@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789263713.876251:0:6487:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000004:00000024:0.0:1789263713.876255:0:7434:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789263713.876338:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:857a0866-badb-47ac-9591-fbf273e4680e+6:0:x1876178888567040:12345-192.168.203.20@tcp:41:mount.lustre.0 Request processed in 110us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263713.876346:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 18 00000100:00100000:1.0:1789263713.876394:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:857a0866-badb-47ac-9591-fbf273e4680e+6:8698:x1876178888567168:12345-192.168.203.20@tcp:41:mount.lustre.0 Request processed in 177us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263713.876402:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 17 00000100:00100000:2.0:1789263713.876637:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888566784 00000100:00100000:2.0:1789263713.876642:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888566784 00000100:00100000:1.0:1789263713.876683:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 19 00000100:00100000:1.0:1789263713.876690:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:857a0866-badb-47ac-9591-fbf273e4680e+6:0:x1876178888566784:12345-192.168.203.20@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789263713.876703:0:8417:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789263713.876738:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:857a0866-badb-47ac-9591-fbf273e4680e+6:0:x1876178888566784:12345-192.168.203.20@tcp:41:mount.lustre.0 Request processed in 48us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263713.876749:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 19 00000100:00100000:3.0:1789263713.877854:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263713.877909:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888567296 00000100:00100000:1.0:1789263713.877915:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888567296 00000100:00100000:1.0:1789263713.877962:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 20 00000100:00100000:1.0:1789263713.877973:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:857a0866-badb-47ac-9591-fbf273e4680e+6:8698:x1876178888567296:12345-192.168.203.20@tcp:40:mount.lustre.0 00000100:00100000:1.0:1789263713.878025:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:857a0866-badb-47ac-9591-fbf273e4680e+6:8698:x1876178888567296:12345-192.168.203.20@tcp:40:mount.lustre.0 Request processed in 49us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263713.878033:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 20 00000100:00100000:3.0:1789263713.879906:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263713.879967:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263713.880005:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263713.880121:0:8394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888567424 00000100:00100000:0.0:1789263713.880121:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888567680 00000100:00100000:2.0:1789263713.880133:0:8394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888567424 00000100:00100000:0.0:1789263713.880133:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888567680 00000100:00100000:1.0:1789263713.880137:0:8511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888567552 00000100:00100000:1.0:1789263713.880150:0:8511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888567552 00000100:00100000:2.0:1789263713.880179:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 18 00000100:00100000:0.0:1789263713.880186:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 5 00000100:00100000:1.0:1789263713.880191:0:8511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 19 00000100:00100000:2.0:1789263713.880192:0:8394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c08ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2396:x1876178888567424:12345-192.168.203.20@tcp:8:mount.lustre.0 00000100:00100000:1.0:1789263713.880203:0:8511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bb95c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2396:x1876178888567552:12345-192.168.203.20@tcp:8:mount.lustre.0 00000100:00100000:0.0:1789263713.880209:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:857a0866-badb-47ac-9591-fbf273e4680e+6:8698:x1876178888567680:12345-192.168.203.20@tcp:900:mount.lustre.0 00010000:00080000:2.0:1789263713.880236:0:8394:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 857a0866-badb-47ac-9591-fbf273e4680e@192.168.203.20@tcp t0 exp 0000000000000000 cur 156 last 0 00010000:00080000:1.0:1789263713.880239:0:8511:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 857a0866-badb-47ac-9591-fbf273e4680e@192.168.203.20@tcp t0 exp 0000000000000000 cur 156 last 0 00000020:00000080:2.0:1789263713.880277:0:8394:0:(genops.c:1385:class_connect()) connect: client 857a0866-badb-47ac-9591-fbf273e4680e, cookie 0xce1582440fb1d9f9 00000020:00000080:1.0:1789263713.880277:0:8511:0:(genops.c:1385:class_connect()) connect: client 857a0866-badb-47ac-9591-fbf273e4680e, cookie 0xce1582440fb1da00 00000100:00100000:0.0:1789263713.880282:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:857a0866-badb-47ac-9591-fbf273e4680e+6:8698:x1876178888567680:12345-192.168.203.20@tcp:900:mount.lustre.0 Request processed in 76us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263713.880291:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 5 00002000:00100000:2.0:1789263713.880293:0:8394:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 857a0866-badb-47ac-9591-fbf273e4680e/ffff9dd883fae000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789263713.880295:0:8511:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 857a0866-badb-47ac-9591-fbf273e4680e/ffff9dd9bfa33800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789263713.880319:0:8394:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00100000:1.0:1789263713.880319:0:8511:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789263713.880428:0:8511:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789263713.880455:0:8511:0:(import.c:65:import_set_state_nolock()) ffff9dd882a28000 : changing import state from RECOVER to FULL 00002000:00080000:2.0:1789263713.880468:0:8394:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789263713.880489:0:8394:0:(import.c:65:import_set_state_nolock()) ffff9dd883faf800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789263713.880507:0:8511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bb95c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:857a0866-badb-47ac-9591-fbf273e4680e+6:2396:x1876178888567552:12345-192.168.203.20@tcp:8:mount.lustre.0 Request processed in 302us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263713.880514:0:8511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 19 00000100:00100000:2.0:1789263713.880524:0:8394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c08ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:857a0866-badb-47ac-9591-fbf273e4680e+6:2396:x1876178888567424:12345-192.168.203.20@tcp:8:mount.lustre.0 Request processed in 332us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263713.880533:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 18 00000100:00100000:3.0:1789263713.882015:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263713.882111:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888567808 00000100:00100000:0.0:1789263713.882120:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888567808 00000100:00100000:0.0:1789263713.882171:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 1 00000100:00100000:0.0:1789263713.882181:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:857a0866-badb-47ac-9591-fbf273e4680e+6:8698:x1876178888567808:12345-192.168.203.20@tcp:33:mount.lustre.0 00000004:00200000:0.0:1789263713.882259:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1789263713.882339:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:857a0866-badb-47ac-9591-fbf273e4680e+6:8698:x1876178888567808:12345-192.168.203.20@tcp:33:mount.lustre.0 Request processed in 158us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263713.882347:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 1 00000100:00100000:3.0:1789263714.349812:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789263714.349837:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898054144:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789263714.349945:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263714.350013:0:8512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898054144 00000100:00100000:3.0:1789263714.350021:0:8512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898054144 00000100:00100000:3.0:1789263714.350132:0:8512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789263714.350143:0:8512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898054144:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789263714.350165:0:8512:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789263714.350213:0:8512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898054144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263714.350222:0:8512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789263714.350253:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898054528:0@lo:400:kworker.0 00000100:00100000:3.0:1789263714.350305:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263714.350306:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1876178898054400:0@lo:400:kworker.0 00000100:00100000:2.0:1789263714.350341:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789263714.350346:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd99f9a5500 x1876178898054144/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789263730 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789263714.350365:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3619:1876178898054912:0@lo:400:kworker.0 00000100:00100000:3.0:1789263714.350368:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898054144:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789263714.350394:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898055040:0@lo:400:kworker.0 00000100:00100000:2.0:1789263714.350400:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263714.350423:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3619:1876178898055424:0@lo:400:kworker.0 00000100:00100000:3.0:1789263714.350441:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263714.350453:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263714.350468:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1876178898055552:0@lo:400:kworker.0 00000100:00100000:2.0:1789263714.350495:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789263714.350500:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263714.350504:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:66a76ccf-c64c-4b18-8369-a2861ec3956c:3619:1876178898054272:0@lo:400:kworker.0 00000100:00100000:2.0:1789263714.350547:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263714.350549:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789263714.350560:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1876178898054656:0@lo:400:kworker.0 00000100:00100000:1.0:1789263714.350572:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898054400 00000100:00100000:2.0:1789263714.350583:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1876178898054784:0@lo:400:kworker.0 00000100:00100000:1.0:1789263714.350586:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898054400 00000100:00100000:3.0:1789263714.350627:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789263714.350733:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789263714.350753:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898055808:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789263714.350767:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898055168:0@lo:400:kworker.0 00000100:00100000:0.0:1789263714.350829:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263714.350831:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263714.350872:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898055680:0@lo:400:kworker.0 00000100:00100000:3.0:1789263714.350898:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263714.350929:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898054528 00000100:00100000:3.0:1789263714.350935:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898054528 00000100:00100000:3.0:1789263714.350961:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898055168 00000100:00100000:3.0:1789263714.350964:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898055168 00000100:00100000:3.0:1789263714.350977:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789263714.350982:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898054528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263714.351018:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898054528:12345-0@lo:400:kworker.0 Request processed in 35us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263714.351024:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789263714.351037:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789263714.351043:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1876178898055168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263714.351066:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1876178898055168:12345-0@lo:400:kworker.0 Request processed in 24us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263714.351112:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789263714.352102:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898054912 00000100:00100000:1.0:1789263714.352111:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898054912 00000100:00100000:2.0:1789263714.352116:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898055424 00000100:00100000:2.0:1789263714.352125:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898055424 00000100:00100000:1.0:1789263714.352157:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898055552 00000100:00100000:1.0:1789263714.352164:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898055552 00000100:00100000:2.0:1789263714.352169:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898054656 00000100:00100000:2.0:1789263714.352175:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898054656 00000100:00100000:1.0:1789263714.352195:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789263714.352213:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1876178898054400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789263714.352221:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789263714.352234:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1876178898054912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789263714.352289:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1876178898054912:12345-0@lo:400:kworker.0 Request processed in 58us (1893us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263714.352297:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789263714.352325:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789263714.352332:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1876178898055424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789263714.352368:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1876178898055424:12345-0@lo:400:kworker.0 Request processed in 35us (1914us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263714.352376:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789263714.352396:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789263714.352405:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789263714.352411:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1876178898055552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789263714.352422:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1876178898054656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263714.352485:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1876178898055552:12345-0@lo:400:kworker.0 Request processed in 76us (1984us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263714.352488:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1876178898054656:12345-0@lo:400:kworker.0 Request processed in 73us (1862us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263714.352504:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789263714.352511:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789263714.352540:0:8396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898055808 00000100:00100000:0.0:1789263714.352546:0:8396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898055808 00000100:00100000:2.0:1789263714.352547:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898054272 00000100:00100000:2.0:1789263714.352554:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898054272 00000100:00100000:0.0:1789263714.352592:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789263714.352601:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1789263714.352606:0:8396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883f5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876178898055808:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789263714.352617:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a07c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+24:3619:x1876178898054272:12345-0@lo:400:kworker.0 00002000:00000024:0.0:1789263714.352628:0:8396:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789263714.352664:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a07c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+24:3619:x1876178898054272:12345-0@lo:400:kworker.0 Request processed in 51us (2119us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263714.352672:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1789263714.352697:0:8396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883f5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876178898055808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (1874us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263714.352706:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789263714.352717:0:8394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898055040 00000100:00100000:2.0:1789263714.352723:0:8394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898055040 00000100:00100000:2.0:1789263714.352760:0:8394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898055680 00000100:00100000:2.0:1789263714.352764:0:8394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898055680 00010000:00080000:0.0:1789263714.352773:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd883f5dc00 x1876178898055808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789263730 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789263714.352791:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789263714.352798:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898055808:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789263714.352808:0:8394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898055040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263714.352844:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263714.352858:0:8394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898055040:12345-0@lo:400:kworker.0 Request processed in 56us (2417us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263714.352866:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789263714.352879:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789263714.352894:0:8394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1876178898055680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263714.352934:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898054784 00000100:00100000:1.0:1789263714.352942:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1876178898054400:12345-0@lo:400:kworker.0 Request processed in 731us (2594us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263714.352944:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898054784 00000100:00100000:2.0:1789263714.352945:0:8394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1876178898055680:12345-0@lo:400:kworker.0 Request processed in 50us (2044us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263714.352964:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789263714.352969:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789263714.352997:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789263714.353009:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883f5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1876178898054784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789263714.353062:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883f5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1876178898054784:12345-0@lo:400:kworker.0 Request processed in 54us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263714.353114:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789263714.353149:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1876178898054656:0@lo:400:kworker.0 00000100:00080000:1.0:1789263714.353164:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789263714.353172:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789263714.353176:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898055168:0@lo:400:kworker.0 00000100:00080000:1.0:1789263714.353179:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789263714.353188:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1789263714.353201:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd9bfa73100 x1876178898055680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789263730 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263714.353214:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898055680:0@lo:400:kworker.0 00010000:00080000:3.0:1789263714.353239:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd9bfa71f80 x1876178898055040/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789263730 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263714.353248:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898055040:0@lo:400:kworker.0 00010000:00080000:3.0:1789263714.353264:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd9bfa71880 x1876178898055552/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263730 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263714.353272:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1876178898055552:0@lo:400:kworker.0 00000100:00100000:3.0:1789263714.353289:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898054528:0@lo:400:kworker.0 00000100:00100000:0.0:1789263714.354414:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1876178898054784:0@lo:400:kworker.0 00000100:00100000:0.0:1789263714.354429:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876178898055296:0@lo:400:kworker.0 00000100:00100000:0.0:1789263714.354469:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263714.354504:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1876178898054400:0@lo:400:kworker.0 00000100:00100000:3.0:1789263714.354523:0:8394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898055296 00010000:00080000:0.0:1789263714.354527:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd9bfa70000 x1876178898054912/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263730 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263714.354538:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3619:1876178898054912:0@lo:400:kworker.0 00000100:00100000:0.0:1789263714.354550:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3619:1876178898055424:0@lo:400:kworker.0 00000100:00100000:0.0:1789263714.354577:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:66a76ccf-c64c-4b18-8369-a2861ec3956c:3619:1876178898054272:0@lo:400:kworker.0 00000100:00100000:3.0:1789263714.354594:0:8394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898055296 00000100:00080000:0.0:1789263714.354629:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789263714.354654:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789263714.354662:0:8394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883f5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1876178898055296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263714.354733:0:8394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883f5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1876178898055296:12345-0@lo:400:kworker.0 Request processed in 72us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263714.354741:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1789263714.355434:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd9bfa71500 x1876178898055296/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789263730 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263714.355447:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876178898055296:0@lo:400:kworker.0 00010000:00010000:0.0:1789263714.733197:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789263714.861429:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9907a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898055936:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789263714.861508:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263714.861574:0:8512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898055936 00000100:00100000:0.0:1789263714.861581:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789263714.861582:0:8512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898055936 00000100:00100000:0.0:1789263714.861593:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898056064:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789263714.861621:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263714.861666:0:8512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898056064 00000100:00100000:3.0:1789263714.861670:0:8512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898056064 00000100:00100000:3.0:1789263714.861691:0:8512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789263714.861701:0:8512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883f5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1876178898055936:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789263714.861722:0:8512:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789263714.861770:0:8512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883f5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1876178898055936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263714.861778:0:8512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789263714.861797:0:8512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789263714.861810:0:8512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883f5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1876178898056064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789263714.861820:0:8512:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789263714.861847:0:8512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883f5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1876178898056064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 38us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263714.861853:0:8512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1789263714.861884:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd9907a6300 x1876178898055936/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789263730 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263714.861902:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9907a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898055936:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789263714.862298:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789263714.862396:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898056192:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789263714.862430:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263714.862506:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898056192 00000100:00100000:3.0:1789263714.862510:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898056192 00010000:00080000:0.0:1789263714.862533:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd9bfa67b80 x1876178898056064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789263730 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263714.862556:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898056064:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789263714.862562:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789263714.862569:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88396aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1876178898056192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789263714.862588:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789263714.862626:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88396aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1876178898056192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 59us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263714.862630:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789263714.862688:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898056192:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789263715.757360:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789263716.091681:0:12148:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg320-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:1.0:1789263716.398268:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898056320:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789263716.398337:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263716.398458:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898056320 00000100:00100000:0.0:1789263716.398466:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898056320 00000100:00100000:0.0:1789263716.398510:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789263716.398519:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883969f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1876178898056320:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789263716.398549:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789263716.398598:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883969f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1876178898056320:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263716.398605:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789263716.398636:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898056320:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789263716.783447:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263717.806449:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263718.829282:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789263719.209683:0:12463:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789263719.209899:0:12463:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1789263719.355665:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263719.355709:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263719.355794:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888567936 00000100:00100000:3.0:1789263719.355804:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888567936 00000100:00100000:1.0:1789263719.355843:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888568192 00000100:00100000:1.0:1789263719.355849:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888568192 00000100:00100000:3.0:1789263719.355870:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 268 00000100:00100000:3.0:1789263719.355893:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a05c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+13:2398:x1876178888567936:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789263719.355929:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 61 00000100:00100000:2.0:1789263719.355939:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9907a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+5:2398:x1876178888568192:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1789263719.355963:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a05c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+13:2398:x1876178888567936:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 81us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263719.355972:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 268 00000100:00100000:2.0:1789263719.355978:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9907a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+5:2398:x1876178888568192:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 38us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263719.355987:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 61 00000100:00080000:2.0:1789263719.356050:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789263719.356709:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263719.356940:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888568064 00000100:00100000:1.0:1789263719.356946:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888568064 00000100:00100000:1.0:1789263719.356994:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 62 00000100:00100000:1.0:1789263719.357002:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+6:2398:x1876178888568064:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1789263719.357059:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+6:2398:x1876178888568064:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 58us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263719.357066:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 62 00000100:00080000:3.0:1789263719.357417:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789263719.362412:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263719.362454:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263719.362466:0:8392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888568320 00000100:00100000:3.0:1789263719.362477:0:8392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888568320 00000100:00100000:0.0:1789263719.362477:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263719.362501:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263719.362522:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263719.362566:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888568576 00000100:00100000:1.0:1789263719.362571:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888568576 00000100:00100000:1.0:1789263719.362604:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888568704 00000100:00100000:1.0:1789263719.362606:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888568704 00000100:00100000:1.0:1789263719.362652:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 63 00000100:00100000:1.0:1789263719.362660:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883f5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:857a0866-badb-47ac-9591-fbf273e4680e+6:2397:x1876178888568576:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1789263719.362727:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883f5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:857a0866-badb-47ac-9591-fbf273e4680e+6:2397:x1876178888568576:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 67us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263719.362734:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 63 00000100:00100000:1.0:1789263719.362749:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 64 00000100:00100000:1.0:1789263719.362754:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c09f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:857a0866-badb-47ac-9591-fbf273e4680e+6:2398:x1876178888568704:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1789263719.362773:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c09f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:857a0866-badb-47ac-9591-fbf273e4680e+6:2398:x1876178888568704:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 19us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263719.362779:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 64 00000100:00100000:3.0:1789263719.362967:0:8392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888568448 00000100:00100000:3.0:1789263719.362972:0:8392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888568448 00000100:00100000:3.0:1789263719.362998:0:8392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888568960 00000100:00100000:3.0:1789263719.363002:0:8392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888568960 00000100:00100000:3.0:1789263719.363025:0:8392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 33 00000100:00100000:0.0:1789263719.363030:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263719.363049:0:8392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c09f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:857a0866-badb-47ac-9591-fbf273e4680e+6:2398:x1876178888568960:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1789263719.363104:0:8392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c09f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:857a0866-badb-47ac-9591-fbf273e4680e+6:2398:x1876178888568960:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 69us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263719.363113:0:8392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 33 00000100:00100000:3.0:1789263719.363131:0:8392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888568832 00000100:00100000:3.0:1789263719.363135:0:8392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888568832 00000100:00100000:1.0:1789263719.363220:0:8511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 20 00000100:00100000:1.0:1789263719.363229:0:8511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883f5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+5:2396:x1876178888568320:12345-192.168.203.20@tcp:9:kworker.0 00000020:00000080:1.0:1789263719.363249:0:8511:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1d8e8 00000100:00080000:1.0:1789263719.363263:0:8511:0:(import.c:65:import_set_state_nolock()) ffff9dd883892800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1789263719.363270:0:8392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 34 00000100:00100000:3.0:1789263719.363279:0:8392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c09f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:857a0866-badb-47ac-9591-fbf273e4680e+6:2398:x1876178888568832:12345-192.168.203.20@tcp:400:kworker.0 00010000:00010000:0.0:1789263719.363304:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1789263719.363310:0:8511:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1789263719.363356:0:8392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c09f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:857a0866-badb-47ac-9591-fbf273e4680e+6:2398:x1876178888568832:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 77us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263719.363365:0:8392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 34 00000100:00100000:3.0:1789263719.363382:0:8392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 21 00000100:00100000:3.0:1789263719.363390:0:8392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c09f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+5:2396:x1876178888568448:12345-192.168.203.20@tcp:9:kworker.0 00000020:00000080:3.0:1789263719.363405:0:8392:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1d8e1 00000100:00080000:3.0:1789263719.363419:0:8392:0:(import.c:65:import_set_state_nolock()) ffff9dd882a35000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789263719.363450:0:8392:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1789263719.363516:0:8511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883f5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+2:2396:x1876178888568320:12345-192.168.203.20@tcp:9:kworker.0 Request processed in 287us (1110us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263719.363525:0:8511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 20 00010000:00010000:0.0:1789263719.363586:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789263719.363591:0:8392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c09f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+2:2396:x1876178888568448:12345-192.168.203.20@tcp:9:kworker.0 Request processed in 200us (1112us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263719.363601:0:8392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 21 00000100:00080000:1.0:1789263719.363739:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789263719.363743:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789263719.363745:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789263719.363747:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:1.0:1789263719.364587:0:8388:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3ce90ea2-917f-4b54-98b0-25e051f2317f 00000020:00000080:1.0:1789263719.364592:0:8388:0:(genops.c:885:class_export_put()) final put ffff9dd883891000/3ce90ea2-917f-4b54-98b0-25e051f2317f 00000001:00100000:3.0:1789263719.364603:0:9479:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3ce90ea2-917f-4b54-98b0-25e051f2317f 00000020:00000080:3.0:1789263719.364607:0:9479:0:(genops.c:885:class_export_put()) final put ffff9dd882a33800/3ce90ea2-917f-4b54-98b0-25e051f2317f 00000001:00100000:1.0:1789263719.364609:0:8388:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 857a0866-badb-47ac-9591-fbf273e4680e 00000001:00100000:3.0:1789263719.364616:0:9479:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 857a0866-badb-47ac-9591-fbf273e4680e 00000020:00000080:0.0:1789263719.364620:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd883891000/3ce90ea2-917f-4b54-98b0-25e051f2317f for lustre-OST0000 00000020:00000080:0.0:1789263719.364661:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd882a33800/3ce90ea2-917f-4b54-98b0-25e051f2317f for lustre-OST0001 00000020:00000080:0.0:1789263719.364683:0:479:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd883892800 for lustre-OST0000 00000020:00000080:0.0:1789263719.364687:0:479:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd882a35000 for lustre-OST0001 00000100:00100000:0.0:1789263719.469290:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8840b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876178898056832:0@lo:400:kworker.0 00000100:00100000:2.0:1789263719.469330:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9907a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1876178898056576:0@lo:400:kworker.0 00000100:00100000:0.0:1789263719.469360:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263719.469380:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9907a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898056704:0@lo:400:kworker.0 00000100:00100000:1.0:1789263719.469394:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263719.469416:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263719.469432:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8840b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1876178898057088:0@lo:400:kworker.0 00000100:00100000:0.0:1789263719.469435:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8840b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898057344:0@lo:400:kworker.0 00000100:00100000:2.0:1789263719.469458:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8840b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898057216:0@lo:400:kworker.0 00000100:00100000:1.0:1789263719.469475:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263719.469482:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263719.469499:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263719.469503:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88297d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1876178898057600:0@lo:400:kworker.0 00000100:00100000:0.0:1789263719.469513:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88297dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898057856:0@lo:400:kworker.0 00000100:00100000:2.0:1789263719.469529:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88297c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3621:1876178898057728:0@lo:400:kworker.0 00000100:00100000:1.0:1789263719.469536:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263719.469548:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263719.469568:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263719.469582:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1789263719.469591:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9907a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:66a76ccf-c64c-4b18-8369-a2861ec3956c:3618:1876178898056448:0@lo:400:kworker.0 00000100:00100000:1.0:1789263719.469596:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898056832 00000100:00100000:1.0:1789263719.469604:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898056832 00000100:00100000:2.0:1789263719.469621:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898056704 00000100:00100000:0.0:1789263719.469623:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263719.469628:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898056704 00000100:00100000:1.0:1789263719.469643:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898056576 00000100:00100000:1.0:1789263719.469647:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898056576 00000100:00100000:0.0:1789263719.469663:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8840b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1876178898056960:0@lo:400:kworker.0 00000100:00100000:2.0:1789263719.469668:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898057344 00000100:00100000:2.0:1789263719.469673:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898057344 00000100:00100000:1.0:1789263719.469676:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898057088 00000100:00100000:1.0:1789263719.469681:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898057088 00000100:00100000:0.0:1789263719.469691:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263719.469700:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789263719.469707:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8840b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898057472:0@lo:400:kworker.0 00000100:00100000:2.0:1789263719.469713:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1876178898056704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789263719.469723:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898057600 00000100:00100000:1.0:1789263719.469729:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898057600 00000100:00100000:0.0:1789263719.469738:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263719.469755:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898057728 00000100:00100000:1.0:1789263719.469759:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898057728 00000100:00100000:0.0:1789263719.469763:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88297f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898057984:0@lo:400:kworker.0 00000100:00100000:1.0:1789263719.469784:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898056960 00000100:00100000:1.0:1789263719.469788:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898056960 00000100:00100000:2.0:1789263719.469790:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1876178898056704:12345-0@lo:400:kworker.0 Request processed in 81us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263719.469800:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263719.469807:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789263719.469811:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789263719.469821:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c09f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876178898056832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789263719.469834:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789263719.469841:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789263719.469846:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c09f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1876178898057344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263719.469856:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88396a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1876178898056576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789263719.469866:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c09f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876178898056832:12345-0@lo:400:kworker.0 Request processed in 47us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263719.469875:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789263719.469895:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c09f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1876178898057344:12345-0@lo:400:kworker.0 Request processed in 52us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263719.469895:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789263719.469904:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883968a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1876178898057088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789263719.469906:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789263719.469912:0:8392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898057216 00000100:00100000:0.0:1789263719.469912:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88396a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1876178898056576:12345-0@lo:400:kworker.0 Request processed in 58us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263719.469916:0:8392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898057216 00000100:00100000:0.0:1789263719.469925:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789263719.469936:0:8511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898057856 00000100:00100000:2.0:1789263719.469942:0:8511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898057856 00000100:00100000:1.0:1789263719.469948:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883968a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1876178898057088:12345-0@lo:400:kworker.0 Request processed in 46us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263719.469949:0:8392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898057472 00000100:00100000:3.0:1789263719.469953:0:8392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898057472 00000100:00100000:0.0:1789263719.469954:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789263719.469968:0:8511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898057984 00000100:00100000:1.0:1789263719.469969:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789263719.469975:0:8511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898057984 00000100:00100000:0.0:1789263719.469976:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883968e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1876178898057600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263719.469980:0:8392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789263719.469985:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789263719.469993:0:8392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1876178898057216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789263719.469993:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1876178898057728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789263719.470006:0:8511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789263719.470018:0:8511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c09f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1876178898057856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263719.470032:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883968e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1876178898057600:12345-0@lo:400:kworker.0 Request processed in 61us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263719.470050:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789263719.470058:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1876178898057728:12345-0@lo:400:kworker.0 Request processed in 65us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263719.470061:0:8392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1876178898057216:12345-0@lo:400:kworker.0 Request processed in 71us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263719.470065:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789263719.470068:0:8392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789263719.470073:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789263719.470108:0:8392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789263719.470110:0:8511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c09f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1876178898057856:12345-0@lo:400:kworker.0 Request processed in 93us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263719.470119:0:8392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaa7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1876178898057472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789263719.470122:0:8511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789263719.470138:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c09f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876178898056960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789263719.470146:0:8511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1789263719.470149:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789263719.470155:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789263719.470157:0:8392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaa7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1876178898057472:12345-0@lo:400:kworker.0 Request processed in 40us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263719.470159:0:8511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaa4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1876178898057984:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789263719.470159:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789263719.470163:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789263719.470184:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c09f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876178898056960:12345-0@lo:400:kworker.0 Request processed in 50us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263719.470192:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789263719.470204:0:8511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaa4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1876178898057984:12345-0@lo:400:kworker.0 Request processed in 50us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263719.470307:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8840b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1876178898056960:0@lo:400:kworker.0 00010000:00080000:0.0:1789263719.470323:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd8840b1c00 x1876178898057472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789263735 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263719.470332:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8840b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898057472:0@lo:400:kworker.0 00010000:00080000:0.0:1789263719.470342:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd88297f480 x1876178898057984/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789263735 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263719.470350:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88297f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898057984:0@lo:400:kworker.0 00000100:00100000:0.0:1789263719.470360:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8840b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898057344:0@lo:400:kworker.0 00010000:00080000:0.0:1789263719.470368:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd88297dc00 x1876178898057856/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789263735 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263719.470376:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88297dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898057856:0@lo:400:kworker.0 00000100:00100000:0.0:1789263719.470387:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8840b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876178898056832:0@lo:400:kworker.0 00000100:00100000:3.0:1789263719.470758:0:8392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789263719.470821:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898058112:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789263719.470822:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898056448 00000100:00100000:0.0:1789263719.470834:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898056448 00000100:00100000:0.0:1789263719.470870:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1789263719.470871:0:8511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789263719.470879:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263719.470884:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a04c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+24:3618:x1876178898056448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263719.470916:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9907a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1876178898056576:0@lo:400:kworker.0 00000100:00100000:2.0:1789263719.470926:0:8512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898058112 00000100:00100000:2.0:1789263719.470932:0:8512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898058112 00010000:00080000:3.0:1789263719.470934:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd8840b1f80 x1876178898057088/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263735 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263719.470946:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a04c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+24:3618:x1876178898056448:12345-0@lo:400:kworker.0 Request processed in 67us (1322us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263719.470947:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8840b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1876178898057088:0@lo:400:kworker.0 00000100:00100000:0.0:1789263719.470963:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1789263719.470968:0:8512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789263719.470970:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88297d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1876178898057600:0@lo:400:kworker.0 00000100:00100000:2.0:1789263719.470981:0:8512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898058112:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789263719.470993:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789263719.471011:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898058240:0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789263719.471012:0:8512:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789263719.471017:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9907a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898056704:0@lo:400:kworker.0 00010000:00080000:0.0:1789263719.471045:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd8840b1880 x1876178898057216/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789263735 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263719.471057:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8840b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898057216:0@lo:400:kworker.0 00000100:00100000:3.0:1789263719.471064:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263719.471103:0:8512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898058112:12345-0@lo:13:osp-pre-1-1.0 Request processed in 100us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263719.471110:0:8512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1789263719.471119:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd9bfa66680 x1876178898058112/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789263735 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789263719.471125:0:8512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898058240 00000100:00100000:2.0:1789263719.471129:0:8512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898058240 00010000:00080000:0.0:1789263719.471130:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd88297c700 x1876178898057728/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263735 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263719.471137:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898058112:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789263719.471147:0:8512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789263719.471149:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88297c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3621:1876178898057728:0@lo:400:kworker.0 00000100:00100000:2.0:1789263719.471158:0:8512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1876178898058240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789263719.471170:0:8512:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789263719.471191:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9907a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:66a76ccf-c64c-4b18-8369-a2861ec3956c:3618:1876178898056448:0@lo:400:kworker.0 00000100:00100000:2.0:1789263719.471207:0:8512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1876178898058240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263719.471213:0:8512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1789263719.471245:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd9bfaa5c00 x1876178898058240/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789263735 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789263719.471256:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898058240:0@lo:13:osp-pre-1-0.0 00000001:00100000:3.0:1789263719.472511:0:6466:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 857a0866-badb-47ac-9591-fbf273e4680e 00000001:00100000:3.0:1789263719.472761:0:7417:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 857a0866-badb-47ac-9591-fbf273e4680e 00010000:00010000:3.0:1789263719.854235:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789263719.981323:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898058368:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789263719.981323:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876178898058496:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789263719.981395:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263719.981398:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263719.981462:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898058368 00000100:00100000:0.0:1789263719.981466:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898058496 00000100:00100000:3.0:1789263719.981470:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898058368 00000100:00100000:0.0:1789263719.981472:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898058496 00000100:00100000:0.0:1789263719.981518:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789263719.981527:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789263719.981529:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaa5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1876178898058496:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789263719.981538:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1876178898058368:12345-0@lo:41:osp-pre-1-0.0 00002000:00000024:0.0:1789263719.981559:0:8397:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000004:00000024:3.0:1789263719.981561:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789263719.981605:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1876178898058368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 71us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263719.981611:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789263719.981616:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaa5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1876178898058496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263719.981624:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789263719.981661:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898058368:0@lo:41:osp-pre-1-0.0 00010000:00080000:0.0:1789263719.981678:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd9bfaa6a00 x1876178898058496/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789263735 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263719.981704:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876178898058496:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789263719.982440:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88297c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898058624:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789263719.982478:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263719.982565:0:8396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898058624 00000100:00100000:2.0:1789263719.982571:0:8396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898058624 00000100:00100000:2.0:1789263719.982612:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789263719.982622:0:8396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaa6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898058624:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789263719.982636:0:8396:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789263719.982683:0:8396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaa6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898058624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 63us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263719.982690:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1789263719.982896:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd88297c700 x1876178898058624/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789263735 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789263719.982913:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88297c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898058624:0@lo:13:osp-pre-0-1.0 00000020:00000004:1.0:1789263720.008221:0:12560:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789263720.008384:0:12560:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:0.0:1789263720.823340:0:12657:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789263720.823504:0:12657:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789263720.877186:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789263721.518262:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789263721.518285:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898058752:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789263721.518347:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263721.518531:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898058752 00000100:00100000:1.0:1789263721.518539:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898058752 00000100:00100000:1.0:1789263721.518590:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789263721.518599:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaa4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898058752:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789263721.518632:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789263721.518689:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaa4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898058752:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263721.518697:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789263721.518732:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898058752:0@lo:41:osp-pre-0-1.0 00000020:00000004:3.0:1789263721.695119:0:12755:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789263721.695344:0:12755:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789263721.901306:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789263722.475916:0:12852:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789263722.476159:0:12852:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789263722.925326:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789263723.890071:0:12996:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1789263723.949230:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789263724.475213:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263724.475241:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888569088 00000100:00100000:3.0:1789263724.475251:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888569088 00000100:00100000:3.0:1789263724.475297:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 270 00000100:00100000:3.0:1789263724.475308:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a05050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+13:2397:x1876178888569088:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1789263724.475385:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a05050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+13:2397:x1876178888569088:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 79us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263724.475393:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 270 00000100:00100000:3.0:1789263724.476041:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263724.476103:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263724.476127:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263724.476144:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263724.476158:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263724.476176:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263724.476188:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888569216 00000100:00100000:0.0:1789263724.476194:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888569216 00000100:00100000:3.0:1789263724.476198:0:8392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888569728 00000100:00100000:3.0:1789263724.476203:0:8392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888569728 00000100:00100000:3.0:1789263724.476240:0:8392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888569856 00000100:00100000:3.0:1789263724.476243:0:8392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888569856 00000100:00100000:0.0:1789263724.476245:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888569472 00000100:00100000:0.0:1789263724.476251:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888569472 00000100:00100000:3.0:1789263724.476270:0:8392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 39 00000100:00100000:0.0:1789263724.476273:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888569344 00000100:00100000:0.0:1789263724.476277:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888569344 00000100:00100000:3.0:1789263724.476282:0:8392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:857a0866-badb-47ac-9591-fbf273e4680e+5:2398:x1876178888569728:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789263724.476292:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888569600 00000100:00100000:0.0:1789263724.476295:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888569600 00000100:00100000:0.0:1789263724.476318:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 71 00000100:00100000:0.0:1789263724.476326:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+6:2397:x1876178888569216:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789263724.476378:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+6:2397:x1876178888569216:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 51us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263724.476379:0:8392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:857a0866-badb-47ac-9591-fbf273e4680e+5:2398:x1876178888569728:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 99us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263724.476394:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 71 00000100:00100000:3.0:1789263724.476395:0:8392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 39 00000100:00100000:3.0:1789263724.476411:0:8392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 40 00000100:00100000:0.0:1789263724.476424:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 72 00000100:00100000:3.0:1789263724.476425:0:8392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:857a0866-badb-47ac-9591-fbf273e4680e+5:2398:x1876178888569856:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789263724.476436:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:857a0866-badb-47ac-9591-fbf273e4680e+5:2398:x1876178888569472:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1789263724.476453:0:8392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:857a0866-badb-47ac-9591-fbf273e4680e+5:2398:x1876178888569856:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 34us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263724.476461:0:8392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 40 00000100:00100000:0.0:1789263724.476470:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:857a0866-badb-47ac-9591-fbf273e4680e+5:2398:x1876178888569472:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 37us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263724.476475:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 72 00000100:00100000:3.0:1789263724.476485:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 73 00000100:00100000:0.0:1789263724.476495:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 74 00000100:00100000:3.0:1789263724.476497:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+5:2398:x1876178888569344:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789263724.476508:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:857a0866-badb-47ac-9591-fbf273e4680e+5:2398:x1876178888569600:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1789263724.476538:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+5:2398:x1876178888569344:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 44us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263724.476546:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:857a0866-badb-47ac-9591-fbf273e4680e+5:2398:x1876178888569600:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 41us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263724.476549:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 73 00000100:00100000:0.0:1789263724.476560:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 74 00000100:00080000:0.0:1789263724.476585:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789263724.476589:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789263724.476591:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789263724.476593:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789263724.589367:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898058880:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789263724.589434:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263724.589491:0:8512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898058880 00000100:00100000:2.0:1789263724.589499:0:8512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898058880 00000100:00080000:0.0:1789263724.589523:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789263724.589551:0:8512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789263724.589562:0:8512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaa5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876178898058880:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789263724.589590:0:8512:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789263724.589636:0:8512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaa5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876178898058880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263724.589644:0:8512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:0.0:1789263724.589674:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd9bfa64e00 x1876178898058880/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789263740 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263724.589702:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898058880:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789263724.590227:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898059136:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789263724.590227:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1876178898059264:0@lo:400:kworker.0 00000100:00100000:2.0:1789263724.590259:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263724.590288:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898059392:0@lo:400:kworker.0 00000100:00100000:2.0:1789263724.590292:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1876178898059648:0@lo:400:kworker.0 00000100:00100000:1.0:1789263724.590299:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263724.590303:0:8396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898059136 00000100:00100000:0.0:1789263724.590315:0:8396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898059136 00000100:00100000:1.0:1789263724.590338:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9907a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3621:1876178898059776:0@lo:400:kworker.0 00000100:00100000:2.0:1789263724.590346:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263724.590347:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263724.590359:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789263724.590369:0:8396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1876178898059136:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789263724.590377:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898060160:0@lo:400:kworker.0 00000100:00100000:3.0:1789263724.590382:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9907a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898059904:0@lo:400:kworker.0 00002000:00000024:0.0:1789263724.590382:0:8396:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789263724.590405:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263724.590411:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263724.590424:0:8499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898059392 00000100:00100000:3.0:1789263724.590428:0:8499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898059392 00000100:00100000:1.0:1789263724.590441:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3621:1876178898060288:0@lo:400:kworker.0 00000100:00100000:0.0:1789263724.590448:0:8396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1876178898059136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (186us total) trans 0 rc 0/0 00010000:00080000:2.0:1789263724.590451:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd9bfaa4700 x1876178898059136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789263740 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263724.590465:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789263724.590470:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898059136:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789263724.590478:0:8499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789263724.590489:0:8499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1876178898059392:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789263724.590491:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789263724.590497:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263724.590506:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898059264 00000100:00100000:2.0:1789263724.590511:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898059264 00000100:00100000:0.0:1789263724.590526:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898059648 00000100:00100000:0.0:1789263724.590533:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898059648 00000100:00100000:3.0:1789263724.590543:0:8499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1876178898059392:12345-0@lo:400:kworker.0 Request processed in 56us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263724.590547:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898059776 00000100:00100000:2.0:1789263724.590552:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898059776 00000100:00100000:3.0:1789263724.590553:0:8499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789263724.590566:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898060288 00000100:00100000:1.0:1789263724.590572:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898060288 00000100:00100000:0.0:1789263724.590573:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789263724.590590:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789263724.590600:0:8392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898060160 00000100:00100000:2.0:1789263724.590601:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1876178898059648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263724.590602:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88396b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1876178898059264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263724.590607:0:8392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898060160 00000100:00100000:1.0:1789263724.590614:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789263724.590625:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1876178898059776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789263724.590645:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1876178898059648:12345-0@lo:400:kworker.0 Request processed in 47us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263724.590651:0:8392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789263724.590653:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789263724.590664:0:8392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1876178898060160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263724.590666:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88396b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1876178898059264:12345-0@lo:400:kworker.0 Request processed in 81us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263724.590675:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1876178898059776:12345-0@lo:400:kworker.0 Request processed in 50us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263724.590676:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789263724.590685:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789263724.590689:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1876178898060288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789263724.590695:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:0.0:1789263724.590711:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789263724.590716:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789263724.590719:0:8392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1876178898060160:12345-0@lo:400:kworker.0 Request processed in 58us (307us total) trans 0 rc 0/0 00000100:00080000:0.0:1789263724.590721:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789263724.590729:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:66a76ccf-c64c-4b18-8369-a2861ec3956c:3619:1876178898059008:0@lo:400:kworker.0 00000100:00100000:3.0:1789263724.590731:0:8392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789263724.590748:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1876178898060288:12345-0@lo:400:kworker.0 Request processed in 61us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263724.590755:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789263724.590762:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263724.590781:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1789263724.590789:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd9bfa71500 x1876178898060160/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789263740 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263724.590796:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1876178898060416:0@lo:400:kworker.0 00000100:00100000:0.0:1789263724.590803:0:8395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898059904 00000100:00100000:2.0:1789263724.590806:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898060160:0@lo:400:kworker.0 00000100:00100000:0.0:1789263724.590808:0:8395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898059904 00000100:00100000:1.0:1789263724.590821:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1876178898059520:0@lo:400:kworker.0 00000100:00100000:2.0:1789263724.590829:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1876178898059648:0@lo:400:kworker.0 00000100:00100000:3.0:1789263724.590831:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263724.590858:0:8395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789263724.590859:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263724.590870:0:8395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1876178898059904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263724.590875:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898059392:0@lo:400:kworker.0 00000100:00100000:2.0:1789263724.590882:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898060416 00000100:00100000:2.0:1789263724.590888:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898060416 00000100:00100000:1.0:1789263724.590889:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9907a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876178898060032:0@lo:400:kworker.0 00000100:00100000:2.0:1789263724.590924:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898059520 00000100:00100000:3.0:1789263724.590930:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898059008 00000100:00100000:1.0:1789263724.590931:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263724.590932:0:8395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1876178898059904:12345-0@lo:400:kworker.0 Request processed in 61us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263724.590939:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898059520 00000100:00100000:0.0:1789263724.590944:0:8395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789263724.590955:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876178898060544:0@lo:400:kworker.0 00000100:00100000:3.0:1789263724.590958:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898059008 00000100:00080000:0.0:1789263724.590966:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789263724.590972:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789263724.590973:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789263724.590984:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1876178898060416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789263724.590998:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263724.591010:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1789263724.591023:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a06050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+24:3619:x1876178898059008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789263724.591045:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1876178898060416:12345-0@lo:400:kworker.0 Request processed in 62us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263724.591053:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789263724.591054:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898060032 00000100:00100000:1.0:1789263724.591060:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898060032 00000100:00100000:2.0:1789263724.591071:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789263724.591106:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a06050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+24:3619:x1876178898059008:12345-0@lo:400:kworker.0 Request processed in 86us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263724.591109:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1876178898059520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789263724.591116:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789263724.591121:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1789263724.591131:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1876178898060032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789263724.591151:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1876178898059520:12345-0@lo:400:kworker.0 Request processed in 44us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263724.591158:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00080000:3.0:1789263724.591162:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd9907a6300 x1876178898059904/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789263740 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263724.591171:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9907a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898059904:0@lo:400:kworker.0 00000100:00100000:1.0:1789263724.591180:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1876178898060032:12345-0@lo:400:kworker.0 Request processed in 52us (251us total) trans 0 rc 0/0 00010000:00080000:3.0:1789263724.591184:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd9bfa71c00 x1876178898060416/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263740 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789263724.591193:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789263724.591195:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1876178898060416:0@lo:400:kworker.0 00000100:00100000:2.0:1789263724.591198:0:8392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898060544 00000100:00100000:2.0:1789263724.591203:0:8392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898060544 00000100:00100000:2.0:1789263724.591235:0:8392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1789263724.591244:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd9907a4000 x1876178898059776/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263740 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789263724.591253:0:8392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1876178898060544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263724.591258:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9907a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3621:1876178898059776:0@lo:400:kworker.0 00000100:00100000:0.0:1789263724.591279:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:66a76ccf-c64c-4b18-8369-a2861ec3956c:3619:1876178898059008:0@lo:400:kworker.0 00000100:00100000:3.0:1789263724.591280:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3621:1876178898060288:0@lo:400:kworker.0 00000100:00100000:2.0:1789263724.591294:0:8392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1876178898060544:12345-0@lo:400:kworker.0 Request processed in 43us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263724.591301:0:8392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789263724.591307:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1876178898059520:0@lo:400:kworker.0 00000100:00100000:3.0:1789263724.591313:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1876178898059264:0@lo:400:kworker.0 00000100:00100000:0.0:1789263724.591325:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9907a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876178898060032:0@lo:400:kworker.0 00010000:00080000:0.0:1789263724.591338:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd9bfa70000 x1876178898060544/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789263740 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263724.591354:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876178898060544:0@lo:400:kworker.0 00010000:00010000:1.0:1789263724.973761:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789263725.101174:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898060672:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789263725.101239:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898060800:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789263725.101252:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263725.101360:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898060928:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789263725.101545:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263725.101576:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898060800 00000100:00100000:2.0:1789263725.101585:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898060800 00000100:00100000:1.0:1789263725.101612:0:8512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898060672 00000100:00100000:1.0:1789263725.101618:0:8512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898060672 00000100:00100000:2.0:1789263725.101638:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789263725.101650:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1876178898060800:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789263725.101656:0:8512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789263725.101668:0:8512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898060672:12345-0@lo:13:osp-pre-0-1.0 00000004:00000024:2.0:1789263725.101684:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00002000:00000024:1.0:1789263725.101690:0:8512:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789263725.101742:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1876178898060800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263725.101744:0:8512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898060672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263725.101762:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789263725.101762:0:8512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:1.0:1789263725.101809:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd9bfa29180 x1876178898060672/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789263741 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263725.101814:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898060800:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789263725.101832:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898060672:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789263725.102274:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263725.102481:0:8396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898060928 00000100:00100000:0.0:1789263725.102490:0:8396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898060928 00000100:00100000:0.0:1789263725.102556:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789263725.102572:0:8396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaa4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876178898060928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789263725.102599:0:8396:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789263725.102660:0:8396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaa4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876178898060928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263725.102666:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1789263725.102705:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd9bfaa5180 x1876178898060928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789263741 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263725.102724:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898060928:0@lo:13:osp-pre-0-0.0 00000020:00000080:3.0:1789263725.229773:0:13144:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd485e4960 20000000:00000080:3.0:1789263725.229790:0:13144:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9dd9c0bfd000 uarg=0000000000000000 20000000:01000000:3.0:1789263725.229830:0:13144:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789263725.229841:0:13144:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789263725.229846:0:13144:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1789263725.230245:0:13145:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1789263725.230308:0:13144:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1789263725.234374:0:13144:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789263725.234402:0:13144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dd883e72a00/0xce1582440fb1da07 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263725.234423:0:13144:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd9bfa23a00/0xce1582440fb1d93c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d935 expref: 23 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263725.234430:0:13144:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd9bfa23600/0xce1582440fb1d966 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d95f expref: 23 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263725.234437:0:13144:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd990433800/0xce1582440fb1d990 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d989 expref: 23 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263725.234455:0:13144:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd981683800/0xce1582440fb1d9ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1d9b3 expref: 23 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263725.234464:0:13144:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd883f58c00/0xce1582440fb1d9cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11bd5 expref: 12 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263725.234471:0:13144:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd883e73e00/0xce1582440fb1d9e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11c14 expref: 12 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263725.234478:0:13144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dd883e72a00/0xce1582440fb1da07 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263725.234520:0:13144:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd883e73e00/0xce1582440fb1d9e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11c14 expref: 12 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263725.234532:0:13144:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dd883e73e00/0xce1582440fb1d9e4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11c14 expref: 12 pid: 6481 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263725.234543:0:13144:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13144:1876178898061056:192.168.203.20@tcp:104: 00010000:00010000:0.0:1789263725.234717:0:13144:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd883f58c00/0xce1582440fb1d9cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11bd5 expref: 12 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263725.234726:0:13144:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dd883f58c00/0xce1582440fb1d9cf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11bd5 expref: 12 pid: 6480 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263725.234735:0:13144:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13144:1876178898061184:192.168.203.20@tcp:104: 00010000:00010000:0.0:1789263725.234767:0:13144:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd981683800/0xce1582440fb1d9ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce1582440fb1d9b3 expref: 23 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263725.234786:0:13144:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dd981683800/0xce1582440fb1d9ba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce1582440fb1d9b3 expref: 23 pid: 6481 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263725.234796:0:13144:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8840b1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13144:1876178898061312:0@lo:104: 00000100:00100000:0.0:1789263725.234840:0:13144:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789263725.234878:0:13144:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd990433800/0xce1582440fb1d990 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce1582440fb1d989 expref: 23 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263725.234885:0:13144:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dd990433800/0xce1582440fb1d990 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce1582440fb1d989 expref: 23 pid: 6482 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263725.234893:0:13144:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8840b2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13144:1876178898061440:0@lo:104: 00000100:00100000:0.0:1789263725.234914:0:13144:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263725.234917:0:9488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898061312 00000100:00100000:2.0:1789263725.234927:0:9488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898061312 00010000:00010000:0.0:1789263725.234938:0:13144:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd9bfa23600/0xce1582440fb1d966 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce1582440fb1d95f expref: 23 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263725.234947:0:13144:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dd9bfa23600/0xce1582440fb1d966 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce1582440fb1d95f expref: 23 pid: 6481 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263725.234958:0:13144:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8840b1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13144:1876178898061568:0@lo:104: 00000100:00100000:3.0:1789263725.234960:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898061440 00000100:00100000:3.0:1789263725.234967:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898061440 00000100:00100000:0.0:1789263725.234988:0:13144:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263725.235007:0:9488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789263725.235020:0:9488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8840b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:66a76ccf-c64c-4b18-8369-a2861ec3956c+4:13144:x1876178898061312:12345-0@lo:104: 00010000:00010000:0.0:1789263725.235025:0:13144:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd9bfa23a00/0xce1582440fb1d93c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce1582440fb1d935 expref: 23 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263725.235034:0:9488:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff9dd990432200/0xce1582440fb1d9b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1d9ba expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263725.235036:0:13144:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dd9bfa23a00/0xce1582440fb1d93c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce1582440fb1d935 expref: 23 pid: 6481 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263725.235058:0:13144:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8840b2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13144:1876178898061696:0@lo:104: 00000100:00100000:1.0:1789263725.235067:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898061568 00000100:00100000:1.0:1789263725.235071:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898061568 00000100:00100000:3.0:1789263725.235097:0:6471:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789263725.235116:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789263725.235126:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8840b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:66a76ccf-c64c-4b18-8369-a2861ec3956c+5:13144:x1876178898061440:12345-0@lo:104: 00010000:00010000:3.0:1789263725.235136:0:6471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff9dd981682200/0xce1582440fb1d989 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1d990 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263725.235137:0:9488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789263725.235149:0:9488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8840b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:66a76ccf-c64c-4b18-8369-a2861ec3956c+5:13144:x1876178898061312:12345-0@lo:104: Request processed in 131us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263725.235158:0:9488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:3.0:1789263725.235187:0:6471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789263725.235193:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8840b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:66a76ccf-c64c-4b18-8369-a2861ec3956c+4:13144:x1876178898061440:12345-0@lo:104: Request processed in 71us (279us total) trans 0 rc 0/0 00010000:00010000:2.0:1789263725.235196:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:3.0:1789263725.235203:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:2.0:1789263725.235206:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd990432200/0xce1582440fb1d9b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1d9ba expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263725.235217:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd990432200 already unused, calling callback (ffffffffc12b1c20) 10000000:00010000:2.0:1789263725.235228:0:6476:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd990432200/0xce1582440fb1d9b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xce1582440fb1d9ba expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263725.235235:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789263725.235245:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c0ae5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:66a76ccf-c64c-4b18-8369-a2861ec3956c+3:13144:x1876178898061568:12345-0@lo:104: 00010000:00010000:2.0:1789263725.235245:0:6476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd990432200/0xce1582440fb1d9b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xce1582440fb1d9ba expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263725.235256:0:6471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff9dd9813fde00/0xce1582440fb1d95f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1d966 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789263725.235258:0:6476:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd990432200/0xce1582440fb1d9b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xce1582440fb1d9ba expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789263725.235269:0:6476:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1789263725.235284:0:13144:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263725.235313:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898061696 00000100:00100000:0.0:1789263725.235317:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898061696 00000100:00100000:1.0:1789263725.235320:0:13144:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd8838ea180 going to sleep for 11 seconds 00010000:00010000:2.0:1789263725.235323:0:6476:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff9dd990432200/0xce1582440fb1d9b3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d9ba expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263725.235331:0:6476:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789263725.235335:0:6471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789263725.235342:0:13144:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8840b1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13144:1876178898061312:0@lo:104: 00000100:00100000:3.0:1789263725.235343:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c0ae5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:66a76ccf-c64c-4b18-8369-a2861ec3956c+4:13144:x1876178898061568:12345-0@lo:104: Request processed in 100us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263725.235347:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789263725.235354:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa29180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:66a76ccf-c64c-4b18-8369-a2861ec3956c+4:13144:x1876178898061696:12345-0@lo:104: 00000100:00100000:1.0:1789263725.235356:0:13144:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8840b2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13144:1876178898061440:0@lo:104: 00010000:00010000:2.0:1789263725.235357:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd990432200/0xce1582440fb1d9b3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d9ba expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263725.235362:0:6470:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff9dd981683600/0xce1582440fb1d935 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1d93c expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263725.235364:0:13144:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8840b1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13144:1876178898061568:0@lo:104: 00010000:00010000:2.0:1789263725.235371:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd990432200/0xce1582440fb1d9b3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d9ba expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263725.235388:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789263725.235393:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd981682200/0xce1582440fb1d989 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1d990 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263725.235400:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981682200 already unused, calling callback (ffffffffc12b1c20) 10000000:00010000:2.0:1789263725.235403:0:6476:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd981682200/0xce1582440fb1d989 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xce1582440fb1d990 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263725.235405:0:6470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789263725.235414:0:13144:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8840b2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13144:1876178898061696:0@lo:104: 00000100:00100000:0.0:1789263725.235415:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa29180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:66a76ccf-c64c-4b18-8369-a2861ec3956c+4:13144:x1876178898061696:12345-0@lo:104: Request processed in 61us (133us total) trans 0 rc 0/0 00010000:00010000:2.0:1789263725.235416:0:6476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd981682200/0xce1582440fb1d989 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xce1582440fb1d990 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263725.235426:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789263725.235437:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789263725.235444:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 10000000:00010000:2.0:1789263725.235452:0:6476:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd981682200/0xce1582440fb1d989 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xce1582440fb1d990 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263725.235458:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88297c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:66a76ccf-c64c-4b18-8369-a2861ec3956c:3618:1876178898061824:0@lo:103:ldlm_bl.0 10000000:01000000:2.0:1789263725.235460:0:6476:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789263725.235461:0:7427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789263725.235469:0:7427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd9813fde00/0xce1582440fb1d95f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1d966 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263725.235478:0:7427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9813fde00 already unused, calling callback (ffffffffc12b1c20) 00010000:00010000:3.0:1789263725.235481:0:6475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:00010000:0.0:1789263725.235482:0:7427:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd9813fde00/0xce1582440fb1d95f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xce1582440fb1d966 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263725.235491:0:6476:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff9dd981682200/0xce1582440fb1d989 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d990 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263725.235493:0:7427:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd9813fde00/0xce1582440fb1d95f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xce1582440fb1d966 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263725.235503:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789263725.235508:0:6476:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:0.0:1789263725.235510:0:7427:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd9813fde00/0xce1582440fb1d95f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xce1582440fb1d966 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789263725.235518:0:7427:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789263725.235529:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd981682200/0xce1582440fb1d989 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d990 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263725.235536:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd981682200/0xce1582440fb1d989 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d990 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263725.235538:0:7427:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff9dd9813fde00/0xce1582440fb1d95f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d966 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263725.235539:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898061824 00000100:00100000:1.0:1789263725.235543:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898061824 00010000:00010000:0.0:1789263725.235545:0:7427:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789263725.235555:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789263725.235559:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263725.235560:0:7427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd9813fde00/0xce1582440fb1d95f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d966 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263725.235561:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd981683800/0xce1582440fb1d9ba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1d9b3 expref: 24 pid: 6481 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263725.235566:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263725.235569:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd9813fde00/0xce1582440fb1d95f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d966 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263725.235581:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789263725.235584:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:66a76ccf-c64c-4b18-8369-a2861ec3956c:3620:1876178898061952:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789263725.235584:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263725.235589:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789263725.235592:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789263725.235600:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a76ccf-c64c-4b18-8369-a2861ec3956c+24:3618:x1876178898061824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789263725.235611:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789263725.235614:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8840b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:66a76ccf-c64c-4b18-8369-a2861ec3956c:3621:1876178898062080:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789263725.235617:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd981683800/0xce1582440fb1d9ba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1d9b3 expref: 24 pid: 6481 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263725.235626:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd981683800/0xce1582440fb1d9ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce1582440fb1d9b3 expref: 24 pid: 6481 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263725.235638:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789263725.235640:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd981683800/0xce1582440fb1d9ba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce1582440fb1d9b3 expref: 24 pid: 6481 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263725.235643:0:13146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263725.235653:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd981683600/0xce1582440fb1d935 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1d93c expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263725.235655:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789263725.235671:0:7428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898061952 00010000:00010000:3.0:1789263725.235674:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981683600 already unused, calling callback (ffffffffc12b1c20) 00000100:00100000:0.0:1789263725.235676:0:7428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898061952 10000000:00010000:3.0:1789263725.235679:0:6475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd981683600/0xce1582440fb1d935 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xce1582440fb1d93c expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263725.235689:0:6475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd981683600/0xce1582440fb1d935 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xce1582440fb1d93c expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263725.235691:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a76ccf-c64c-4b18-8369-a2861ec3956c+24:3618:x1876178898061824:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (189us total) trans 0 rc 0/0 00010000:00010000:0.0:1789263725.235693:0:7428:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd990433800/0xce1582440fb1d990 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1d989 expref: 24 pid: 6482 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263725.235695:0:13146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789263725.235699:0:13146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789263725.235707:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 10000000:00010000:3.0:1789263725.235710:0:6475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd981683600/0xce1582440fb1d935 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xce1582440fb1d93c expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789263725.235716:0:6475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1789263725.235722:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789263725.235731:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa64e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a76ccf-c64c-4b18-8369-a2861ec3956c+23:3620:x1876178898061952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789263725.235740:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789263725.235744:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd990433800/0xce1582440fb1d990 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1d989 expref: 23 pid: 6482 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263725.235751:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789263725.235753:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd990433800/0xce1582440fb1d990 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce1582440fb1d989 expref: 23 pid: 6482 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263725.235766:0:6475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff9dd981683600/0xce1582440fb1d935 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d93c expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263725.235766:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd990433800/0xce1582440fb1d990 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce1582440fb1d989 expref: 23 pid: 6482 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263725.235786:0:6475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789263725.235790:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898062080 00000100:00100000:2.0:1789263725.235795:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898062080 00000100:00100000:0.0:1789263725.235802:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88297c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:66a76ccf-c64c-4b18-8369-a2861ec3956c:3618:1876178898061824:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789263725.235803:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd981683600/0xce1582440fb1d935 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d93c expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263725.235806:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789263725.235814:0:6472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd9bfa23600/0xce1582440fb1d966 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1d95f expref: 23 pid: 6481 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263725.235815:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd981683600/0xce1582440fb1d935 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1d93c expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263725.235822:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:66a76ccf-c64c-4b18-8369-a2861ec3956c:3618:1876178898062208:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789263725.235835:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa64e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a76ccf-c64c-4b18-8369-a2861ec3956c+23:3620:x1876178898061952:12345-0@lo:103:ldlm_bl.0 Request processed in 106us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263725.235844:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:3.0:1789263725.235845:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263725.235848:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263725.235851:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789263725.235858:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263725.235864:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789263725.235876:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8840b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a76ccf-c64c-4b18-8369-a2861ec3956c+22:3621:x1876178898062080:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789263725.235876:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898062208 00000100:00100000:1.0:1789263725.235881:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898062208 00010000:00010000:2.0:1789263725.235888:0:6472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789263725.235897:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd9bfa23a00/0xce1582440fb1d93c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1d935 expref: 23 pid: 6481 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263725.235903:0:6472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd9bfa23600/0xce1582440fb1d966 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1d95f expref: 23 pid: 6481 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263725.235907:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:66a76ccf-c64c-4b18-8369-a2861ec3956c:3620:1876178898061952:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789263725.235922:0:6472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd9bfa23600/0xce1582440fb1d966 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce1582440fb1d95f expref: 23 pid: 6481 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263725.235927:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789263725.235938:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd987240c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a76ccf-c64c-4b18-8369-a2861ec3956c+23:3618:x1876178898062208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789263725.235940:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd9bfa23600/0xce1582440fb1d966 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce1582440fb1d95f expref: 23 pid: 6481 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263725.235948:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789263725.235954:0:6472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789263725.235955:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd9bfa23a00/0xce1582440fb1d93c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1d935 expref: 22 pid: 6481 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263725.235966:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd9bfa23a00/0xce1582440fb1d93c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce1582440fb1d935 expref: 22 pid: 6481 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263725.235975:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd9bfa23a00/0xce1582440fb1d93c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce1582440fb1d935 expref: 22 pid: 6481 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263725.235983:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789263725.235994:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8840b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a76ccf-c64c-4b18-8369-a2861ec3956c+21:3621:x1876178898062080:12345-0@lo:103:ldlm_bl.0 Request processed in 121us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263725.236016:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789263725.236023:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8840b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:66a76ccf-c64c-4b18-8369-a2861ec3956c:3621:1876178898062080:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789263725.236024:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd987240c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a76ccf-c64c-4b18-8369-a2861ec3956c+21:3618:x1876178898062208:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263725.236031:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789263725.236047:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:66a76ccf-c64c-4b18-8369-a2861ec3956c:3618:1876178898062208:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789263725.236273:0:13144:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13144:1876178898061056:192.168.203.20@tcp:104: 00000100:00100000:1.0:1789263725.237169:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263725.237200:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263725.237213:0:10303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888569984 00000100:00100000:0.0:1789263725.237220:0:10303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888569984 00010000:00010000:0.0:1789263725.237244:0:10303:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd883e73e00/0xce1582440fb1d9e4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11c14 expref: 13 pid: 6481 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263725.237249:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888570112 00000100:00100000:2.0:1789263725.237256:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888570112 00010000:00010000:2.0:1789263725.237277:0:8409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd883f58c00/0xce1582440fb1d9cf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11bd5 expref: 14 pid: 6480 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263725.237302:0:10303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 39 00000100:00100000:0.0:1789263725.237312:0:10303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+14:2398:x1876178888569984:12345-192.168.203.20@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1789263725.237319:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 40 00010000:00010000:0.0:1789263725.237325:0:10303:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789263725.237331:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa29500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+14:2398:x1876178888570112:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789263725.237333:0:10303:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd883e73e00/0xce1582440fb1d9e4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11c14 expref: 14 pid: 6481 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263725.237345:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789263725.237349:0:10303:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd883e73e00/0xce1582440fb1d9e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11c14 expref: 14 pid: 6481 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263725.237361:0:8409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd883f58c00/0xce1582440fb1d9cf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11bd5 expref: 14 pid: 6480 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263725.237367:0:10303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd883e73e00/0xce1582440fb1d9e4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11c14 expref: 14 pid: 6481 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263725.237381:0:13144:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13144:1876178898061184:192.168.203.20@tcp:104: 00010000:00010000:2.0:1789263725.237388:0:8409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd883f58c00/0xce1582440fb1d9cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11bd5 expref: 13 pid: 6480 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263725.237397:0:10303:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789263725.237404:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd883f58c00/0xce1582440fb1d9cf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11bd5 expref: 13 pid: 6480 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263725.237430:0:8409:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dd883e72a00/0xce1582440fb1da07 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263725.237438:0:8409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd883e72a00/0xce1582440fb1da07 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263725.237501:0:10303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+12:2398:x1876178888569984:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 137us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263725.237511:0:10303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 39 00010000:00010000:3.0:1789263725.237512:0:13144:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dd883e72a00/0xce1582440fb1da07 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263725.237512:0:8409:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd883e72a00/0xce1582440fb1da07 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263725.237532:0:8409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd883e72a00/0xce1582440fb1da07 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263725.237555:0:8409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dd883e72a00/0xce1582440fb1da07 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263725.237561:0:8409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dd883e72a00/0xce1582440fb1da07 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263725.237564:0:13144:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGS lock: ffff9dd883e72a00/0xce1582440fb1da07 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263725.237566:0:8409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883e72a00 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:2.0:1789263725.237572:0:8409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dd883e72a00/0xce1582440fb1da07 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263725.237580:0:8409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dd883e72a00/0xce1582440fb1da07 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263725.237585:0:13144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dd883e72a00/0xce1582440fb1da07 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263725.237607:0:8409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dd883e72a00/0xce1582440fb1da07 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263725.237616:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd883e72a00/0xce1582440fb1da07 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263725.237639:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789263725.237658:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa29500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+11:2398:x1876178888570112:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 332us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263725.237664:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 40 00010000:00010000:2.0:1789263725.997268:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789263726.509139:0:6484:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789263726.509146:0:6484:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dd882a29800 from 7 10000000:01000000:0.0:1789263726.509151:0:6484:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789263726.509193:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883e72c00/0xce1582440fb1da0e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263726.509204:0:6484:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd883e72c00/0xce1582440fb1da0e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263726.509215:0:6484:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd883e72c00/0xce1582440fb1da0e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263726.509254:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8840b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898062336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789263726.509317:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263726.509369:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd8838eacc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789263726.509390:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898062336 00000100:00100000:2.0:1789263726.509399:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898062336 00000100:00100000:2.0:1789263726.509452:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1789263726.509463:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a06c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+20:6484:x1876178898062336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789263726.509477:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263726.509490:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd9bfa22000/0xce1582440fb1da15 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1da0e expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263726.509513:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd9bfa22000/0xce1582440fb1da15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1da0e expref: 21 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263726.509524:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd9bfa22000/0xce1582440fb1da15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1da0e expref: 21 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263726.509533:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bfa22000, rc 0) 00000100:00100000:2.0:1789263726.509579:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a06c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+21:6484:x1876178898062336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263726.509586:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1789263726.509682:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8840b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898062336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789263726.509694:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd883e72c00/0xce1582440fb1da0e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1da15 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263726.509703:0:6484:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd883e72c00/0xce1582440fb1da0e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1da15 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263726.509761:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8840b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898062464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789263726.509789:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263726.509810:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd8838eacc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789263726.509840:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898062464 00000100:00100000:1.0:1789263726.509851:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898062464 00000100:00100000:1.0:1789263726.509887:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1789263726.509896:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a06450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+21:6484:x1876178898062464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789263726.510024:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a06450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+21:6484:x1876178898062464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 129us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263726.510032:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1789263726.510070:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8840b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898062464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789263726.510139:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa66680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898062592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789263726.510184:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263726.510676:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898062592 00000100:00100000:3.0:1789263726.510681:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898062592 00000100:00100000:2.0:1789263726.510688:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd883e96300 going to sleep for 11 seconds 00000100:00100000:3.0:1789263726.510714:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1789263726.510722:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a05450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+21:6484:x1876178898062592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789263726.510808:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a05450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+21:6484:x1876178898062592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 87us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263726.510816:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1789263726.510831:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa66680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898062592:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789263726.511549:0:13313:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1789263726.511639:0:6484:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1789263726.511663:0:6484:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789263726.511671:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883e72c00/0xce1582440fb1da0e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1da15 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263726.511681:0:6484:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd883e72c00/0xce1582440fb1da0e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1da15 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789263726.511689:0:6484:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789263726.511691:0:6484:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dd9c1b57000 from 7 10000000:01000000:3.0:1789263726.511693:0:6484:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789263726.511725:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd981530400/0xce1582440fb1da1c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263726.511733:0:6484:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd981530400/0xce1582440fb1da1c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263726.511748:0:6484:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd981530400/0xce1582440fb1da1c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263726.511762:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898062720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789263726.511791:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263726.511824:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd884041d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789263726.511878:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898062720 00000100:00100000:2.0:1789263726.511883:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898062720 00000100:00100000:2.0:1789263726.511913:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1789263726.511920:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+21:6484:x1876178898062720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789263726.511942:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263726.511954:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd9bfa22400/0xce1582440fb1da23 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1da1c expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263726.511977:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd9bfa22400/0xce1582440fb1da23 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1da1c expref: 22 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263726.511999:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd9bfa22400/0xce1582440fb1da23 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1da1c expref: 22 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263726.512008:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bfa22400, rc 0) 00000100:00100000:2.0:1789263726.512147:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+22:6484:x1876178898062720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 227us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263726.512155:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1789263726.512531:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898062720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789263726.512545:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd981530400/0xce1582440fb1da1c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1da23 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263726.512555:0:6484:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd981530400/0xce1582440fb1da1c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1da23 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263726.512608:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898062848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789263726.512632:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263726.512652:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd884041d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789263726.512665:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898062848 00000100:00100000:0.0:1789263726.512671:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898062848 00000100:00100000:0.0:1789263726.512709:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1789263726.512718:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+22:6484:x1876178898062848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789263726.512819:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+22:6484:x1876178898062848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 101us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263726.512827:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898062848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789263726.512829:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1789263726.512856:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898062976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789263726.512888:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263726.512905:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd884041d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789263726.513005:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898062976 00000100:00100000:2.0:1789263726.513011:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898062976 00000100:00100000:2.0:1789263726.513040:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1789263726.513048:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+22:6484:x1876178898062976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789263726.513157:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+22:6484:x1876178898062976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 109us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263726.513165:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1789263726.513170:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898062976:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789263726.513886:0:13314:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789263726.514132:0:6484:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789263726.514153:0:6484:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789263726.514159:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd981530400/0xce1582440fb1da1c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1da23 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263726.514166:0:6484:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd981530400/0xce1582440fb1da1c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1da23 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789263726.514173:0:6484:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789263726.514174:0:6484:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dd9c0889800 from 7 10000000:01000000:2.0:1789263726.514176:0:6484:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789263726.514194:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23000/0xce1582440fb1da2a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263726.514199:0:6484:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23000/0xce1582440fb1da2a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263726.514205:0:6484:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23000/0xce1582440fb1da2a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263726.514216:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa66680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898063104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789263726.514246:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263726.514269:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd883e960c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789263726.514278:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898063104 00000100:00100000:0.0:1789263726.514283:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898063104 00000100:00100000:0.0:1789263726.514316:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1789263726.514323:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+22:6484:x1876178898063104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789263726.514332:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263726.514349:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd883e73e00/0xce1582440fb1da31 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1da2a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263726.514372:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd883e73e00/0xce1582440fb1da31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1da2a expref: 23 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263726.514383:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd883e73e00/0xce1582440fb1da31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1da2a expref: 23 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263726.514390:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd883e73e00, rc 0) 00000100:00100000:0.0:1789263726.514432:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+23:6484:x1876178898063104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263726.514439:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1789263726.514505:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa66680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898063104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789263726.514517:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23000/0xce1582440fb1da2a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1da31 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263726.514526:0:6484:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23000/0xce1582440fb1da2a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1da31 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263726.514582:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa66680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898063232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789263726.514602:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263726.514620:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd883e960c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789263726.514636:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898063232 00000100:00100000:3.0:1789263726.514640:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898063232 00000100:00100000:3.0:1789263726.514677:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1789263726.514685:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+23:6484:x1876178898063232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789263726.514809:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+23:6484:x1876178898063232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 125us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263726.514813:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1789263726.514842:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa66680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898063232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789263726.514863:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa66680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898063360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789263726.514888:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263726.514901:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd883e960c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789263726.514921:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898063360 00000100:00100000:0.0:1789263726.514924:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898063360 00000100:00100000:0.0:1789263726.514948:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1789263726.514953:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+23:6484:x1876178898063360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789263726.515028:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+23:6484:x1876178898063360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 73us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263726.515036:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1789263726.515044:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa66680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898063360:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789263726.515912:0:13316:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1789263726.515982:0:6484:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1789263726.516012:0:6484:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789263726.516022:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23000/0xce1582440fb1da2a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1da31 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263726.516032:0:6484:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23000/0xce1582440fb1da2a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1da31 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789263726.516048:0:6484:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789263726.516051:0:6484:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dd9896b8000 from 7 10000000:01000000:3.0:1789263726.516053:0:6484:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789263726.516073:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd981531a00/0xce1582440fb1da38 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263726.516101:0:6484:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd981531a00/0xce1582440fb1da38 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263726.516118:0:6484:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd981531a00/0xce1582440fb1da38 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263726.516135:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898063488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789263726.516185:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263726.516216:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898063488 00000100:00100000:3.0:1789263726.516220:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd8840416c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789263726.516222:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898063488 00000100:00100000:0.0:1789263726.516264:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1789263726.516276:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+23:6484:x1876178898063488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789263726.516285:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263726.516295:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd883e72a00/0xce1582440fb1da3f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1da38 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263726.516325:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd883e72a00/0xce1582440fb1da3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1da38 expref: 24 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263726.516343:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd883e72a00/0xce1582440fb1da3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1da38 expref: 24 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263726.516352:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd883e72a00, rc 0) 00000100:00100000:0.0:1789263726.516387:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+24:6484:x1876178898063488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263726.516393:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1789263726.516414:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898063488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789263726.516435:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd981531a00/0xce1582440fb1da38 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1da3f expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263726.516443:0:6484:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd981531a00/0xce1582440fb1da38 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1da3f expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263726.516505:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898063616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789263726.516531:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263726.516550:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd8840416c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789263726.516624:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898063616 00000100:00100000:0.0:1789263726.516628:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898063616 00000100:00100000:0.0:1789263726.516656:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1789263726.516662:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+24:6484:x1876178898063616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789263726.516743:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+24:6484:x1876178898063616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 81us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263726.516750:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1789263726.517203:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898063616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789263726.517240:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898063744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789263726.517281:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263726.517316:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898063744 00000100:00100000:3.0:1789263726.517319:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd8840416c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789263726.517322:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898063744 00000100:00100000:0.0:1789263726.517396:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1789263726.517402:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+24:6484:x1876178898063744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789263726.517484:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+24:6484:x1876178898063744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263726.517492:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1789263726.517523:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898063744:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789263726.518179:0:13318:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789263726.518252:0:6484:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789263726.518274:0:6484:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789263726.518283:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd981531a00/0xce1582440fb1da38 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1da3f expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263726.518307:0:6484:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd981531a00/0xce1582440fb1da38 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1da3f expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:02000400:2.0:1789263726.605653:0:13343:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg320-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1789263726.638310:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8840b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898063872:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789263726.638383:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263726.638461:0:8499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898063872 00000100:00100000:0.0:1789263726.638468:0:8499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898063872 00000100:00100000:0.0:1789263726.638522:0:8499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789263726.638532:0:8499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8840b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1876178898063872:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789263726.638566:0:8499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789263726.638616:0:8499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8840b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1876178898063872:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263726.638624:0:8499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789263726.638670:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8840b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898063872:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789263727.021272:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789263727.099485:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263727.099554:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888570240 00000100:00100000:2.0:1789263727.099563:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888570240 00000100:00100000:2.0:1789263727.099622:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 284 00000100:00100000:2.0:1789263727.099633:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+11:6155:x1876178888570240:12345-192.168.203.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789263727.099651:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263727.099668:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd9bfa23e00/0xce1582440fb1da46 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11c45 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263727.099710:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd9bfa23e00/0xce1582440fb1da46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11c45 expref: 12 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263727.099722:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd9bfa23e00/0xce1582440fb1da46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11c45 expref: 12 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263727.099732:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bfa23e00, rc 0) 00000100:00100000:2.0:1789263727.099791:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+12:6155:x1876178888570240:12345-192.168.203.20@tcp:101:ll_cfg_requeue.0 Request processed in 159us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263727.099803:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 284 00000100:00100000:1.0:1789263727.101048:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263727.101199:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888570368 00000100:00100000:0.0:1789263727.101218:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888570368 00000100:00100000:0.0:1789263727.101315:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 285 00000100:00100000:0.0:1789263727.101338:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+12:6155:x1876178888570368:12345-192.168.203.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789263727.101574:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+12:6155:x1876178888570368:12345-192.168.203.20@tcp:501:ll_cfg_requeue.0 Request processed in 242us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263727.101585:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 285 00000100:00100000:1.0:1789263727.102857:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263727.102964:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888570496 00000100:00100000:2.0:1789263727.102973:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888570496 00000100:00100000:2.0:1789263727.103034:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 286 00000100:00100000:2.0:1789263727.103052:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+12:6155:x1876178888570496:12345-192.168.203.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789263727.103202:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+12:6155:x1876178888570496:12345-192.168.203.20@tcp:503:ll_cfg_requeue.0 Request processed in 152us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263727.103211:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 286 00000100:00100000:2.0:1789263727.105196:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263727.105266:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888570624 00000100:00100000:0.0:1789263727.105277:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888570624 00000100:00100000:0.0:1789263727.105330:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 287 00000100:00100000:0.0:1789263727.105340:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+12:6155:x1876178888570624:12345-192.168.203.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789263727.105357:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263727.105380:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd883e73c00/0xce1582440fb1da4d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11c4c expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263727.105415:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd883e73c00/0xce1582440fb1da4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11c4c expref: 13 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263727.105448:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd883e73c00/0xce1582440fb1da4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11c4c expref: 13 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263727.105467:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd883e73c00, rc 0) 00000100:00100000:0.0:1789263727.105525:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+13:6155:x1876178888570624:12345-192.168.203.20@tcp:101:ll_cfg_requeue.0 Request processed in 186us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263727.105532:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 287 00000100:00100000:1.0:1789263727.106343:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263727.106396:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888570752 00000100:00100000:2.0:1789263727.106404:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888570752 00000100:00100000:2.0:1789263727.106448:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 288 00000100:00100000:2.0:1789263727.106458:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+13:6155:x1876178888570752:12345-192.168.203.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789263727.106587:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+13:6155:x1876178888570752:12345-192.168.203.20@tcp:501:ll_cfg_requeue.0 Request processed in 125us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263727.106597:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 288 00000100:00100000:1.0:1789263727.107773:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263727.107836:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888570880 00000100:00100000:0.0:1789263727.107841:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888570880 00000100:00100000:0.0:1789263727.107872:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 289 00000100:00100000:0.0:1789263727.107877:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+13:6155:x1876178888570880:12345-192.168.203.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789263727.107967:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+13:6155:x1876178888570880:12345-192.168.203.20@tcp:503:ll_cfg_requeue.0 Request processed in 88us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263727.107974:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 289 00010000:00010000:3.0:1789263728.047195:0:13146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789263728.578142:0:13491:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 21:42:08 (1789263728) === 00000100:00100000:0.0:1789263728.649873:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263728.649922:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888571008 00000100:00100000:2.0:1789263728.649932:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888571008 00000100:00080000:0.0:1789263728.649989:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789263728.650006:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 2 00000100:00100000:2.0:1789263728.650018:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8840b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:3ce90ea2-917f-4b54-98b0-25e051f2317f+6:10460:x1876178888571008:12345-192.168.203.20@tcp:700:mkdir.0 00000100:00100000:2.0:1789263728.650121:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8840b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:3ce90ea2-917f-4b54-98b0-25e051f2317f+6:10460:x1876178888571008:12345-192.168.203.20@tcp:700:mkdir.0 Request processed in 105us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263728.650129:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 2 00000100:00100000:1.0:1789263728.651032:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263728.651115:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888571264 00000100:00100000:2.0:1789263728.651121:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888571264 00000100:00100000:2.0:1789263728.651162:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 21 00000100:00100000:2.0:1789263728.651170:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+6:10460:x1876178888571264:12345-192.168.203.20@tcp:36:mkdir.0 00010000:00010000:2.0:1789263728.651208:0:8417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789263728.651272:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1d8f6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11bc0 expref: 6 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.651289:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd98a473900) 00010000:00010000:2.0:1789263728.651307:0:8417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789263728.651386:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22c00/0xce1582440fb1da54 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.651399:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22c00/0xce1582440fb1da54 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.651409:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22c00/0xce1582440fb1da54 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.651431:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22600/0xce1582440fb1da5b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.651460:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22600/0xce1582440fb1da5b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.651467:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22600/0xce1582440fb1da5b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.651896:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23200/0xce1582440fb1da62 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.651905:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23200/0xce1582440fb1da62 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.651912:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23200/0xce1582440fb1da62 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789263728.651925:0:8417:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c3425d01 reply state 0000000008c407cf transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23200/0xce1582440fb1da62 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.651936:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23200/0xce1582440fb1da62 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.651943:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9dd9bb584100) 00010000:00010000:2.0:1789263728.651945:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789263728.651948:0:8417:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789263728.651952:0:8417:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789263728.651958:0:8417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22c00/0xce1582440fb1da54 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.651963:0:8417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22c00/0xce1582440fb1da54 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.651967:0:8417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22c00/0xce1582440fb1da54 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.651990:0:8417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bfa22c00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263728.651993:0:8417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22c00/0xce1582440fb1da54 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.651998:0:8417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22c00/0xce1582440fb1da54 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.652004:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd9bb584a00) 00010000:00010000:2.0:1789263728.652006:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789263728.652008:0:8417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22c00/0xce1582440fb1da54 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.652012:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22c00/0xce1582440fb1da54 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789263728.652021:0:8417:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c3425d01 reply state 0000000008c407cf transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22600/0xce1582440fb1da5b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.652026:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22600/0xce1582440fb1da5b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.652029:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9dd9bb584400) 00010000:00010000:2.0:1789263728.652031:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789263728.652032:0:8417:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1789263728.652235:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+7:10460:x1876178888571264:12345-192.168.203.20@tcp:36:mkdir.0 Request processed in 1064us (1204us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1789263728.652241:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 21 00000100:00100000:1.0:1789263728.658000:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263728.658050:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888571392 00000100:00100000:2.0:1789263728.658060:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888571392 00000100:00100000:2.0:1789263728.658146:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 22 00000100:00100000:2.0:1789263728.658172:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+7:10461:x1876178888571392:12345-192.168.203.20@tcp:101:chmod.0 00010000:00010000:2.0:1789263728.658193:0:7434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263728.658214:0:7434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22a00/0xce1582440fb1da69 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11c53 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.658283:0:7434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22e00/0xce1582440fb1da70 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.658296:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22e00/0xce1582440fb1da70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.658307:0:7434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22e00/0xce1582440fb1da70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789263728.658345:0:7434:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789263728.658348:0:7434:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789263728.658382:0:7434:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22e00/0xce1582440fb1da70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.658406:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22a00/0xce1582440fb1da69 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11c53 expref: 9 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.658422:0:7434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22e00/0xce1582440fb1da70 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11c53 expref: 8 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.658547:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd9bb584500) 00010000:00010000:2.0:1789263728.658550:0:7434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789263728.658560:0:7434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bfa22e00, rc 0) 00000100:00100000:2.0:1789263728.658625:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+8:10461:x1876178888571392:12345-192.168.203.20@tcp:101:chmod.0 Request processed in 454us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263728.658645:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 22 00000100:00100000:0.0:1789263728.659840:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263728.659952:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888571648 00000100:00100000:1.0:1789263728.659960:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888571648 00000100:00100000:1.0:1789263728.660014:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 23 00000100:00100000:1.0:1789263728.660023:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8840b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+8:10461:x1876178888571648:12345-192.168.203.20@tcp:36:chmod.0 00010000:00010000:1.0:1789263728.660061:0:6488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789263728.660117:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22e00/0xce1582440fb1da70 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11c53 expref: 8 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263728.660133:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd9bb584500) 00010000:00010000:1.0:1789263728.660142:0:6488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789263728.660162:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1da77 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263728.660172:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1da77 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263728.660181:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1da77 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789263728.660363:0:6488:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bf13e19e reply state 00000000acbdbcff transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1da77 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263728.660375:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1da77 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263728.660382:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd883dd9100) 00010000:00010000:1.0:1789263728.660384:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1789263728.660386:0:6488:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789263728.660392:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1789263728.660470:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8840b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+9:10461:x1876178888571648:12345-192.168.203.20@tcp:36:chmod.0 Request processed in 448us (633us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1789263728.660478:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 23 00000100:00100000:1.0:1789263728.671795:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263728.671859:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888571776 00000100:00100000:2.0:1789263728.671868:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888571776 00000100:00100000:2.0:1789263728.671925:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 24 00000100:00100000:2.0:1789263728.671935:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+9:10462:x1876178888571776:12345-192.168.203.20@tcp:101:chown.0 00010000:00010000:2.0:1789263728.671957:0:8417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263728.671985:0:8417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22a00/0xce1582440fb1da7e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11c5a expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.672044:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22c00/0xce1582440fb1da85 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.672058:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22c00/0xce1582440fb1da85 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.672068:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22c00/0xce1582440fb1da85 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789263728.672133:0:8417:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789263728.672137:0:8417:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789263728.672171:0:8417:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22c00/0xce1582440fb1da85 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.672193:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22a00/0xce1582440fb1da7e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11c5a expref: 11 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.672209:0:8417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22c00/0xce1582440fb1da85 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11c5a expref: 10 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.672231:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd883dd9100) 00010000:00010000:2.0:1789263728.672234:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789263728.672237:0:8417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bfa22c00, rc 0) 00000100:00100000:2.0:1789263728.672284:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+10:10462:x1876178888571776:12345-192.168.203.20@tcp:101:chown.0 Request processed in 351us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263728.672292:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 24 00000100:00100000:0.0:1789263728.673372:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263728.673409:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888571904 00000100:00100000:2.0:1789263728.673415:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888571904 00000100:00100000:2.0:1789263728.673448:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 25 00000100:00100000:2.0:1789263728.673455:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8840b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+10:10462:x1876178888571904:12345-192.168.203.20@tcp:101:chown.0 00010000:00010000:2.0:1789263728.673464:0:7434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263728.673472:0:7434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23600/0xce1582440fb1da8c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11c61 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.673502:0:7434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23a00/0xce1582440fb1da93 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.673510:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23a00/0xce1582440fb1da93 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.673516:0:7434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23a00/0xce1582440fb1da93 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.673522:0:7434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23800/0xce1582440fb1da9a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.673526:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23800/0xce1582440fb1da9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.673540:0:7434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23800/0xce1582440fb1da9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.673592:0:7434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22e00/0xce1582440fb1daa1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.673597:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22e00/0xce1582440fb1daa1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.673601:0:7434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22e00/0xce1582440fb1daa1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789263728.673619:0:7434:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789263728.673621:0:7434:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789263728.673629:0:7434:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22e00/0xce1582440fb1daa1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.673636:0:7434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23a00/0xce1582440fb1da93 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.673640:0:7434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23a00/0xce1582440fb1da93 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.673644:0:7434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23a00/0xce1582440fb1da93 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.673648:0:7434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bfa23a00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263728.673651:0:7434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23a00/0xce1582440fb1da93 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.673656:0:7434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23a00/0xce1582440fb1da93 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.673668:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd883dd9100) 00010000:00010000:2.0:1789263728.673670:0:7434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789263728.673673:0:7434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23a00/0xce1582440fb1da93 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.673677:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23a00/0xce1582440fb1da93 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.673683:0:7434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23800/0xce1582440fb1da9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.673686:0:7434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23800/0xce1582440fb1da9a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.673690:0:7434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23800/0xce1582440fb1da9a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.673693:0:7434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bfa23800 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263728.673695:0:7434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23800/0xce1582440fb1da9a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.673698:0:7434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23800/0xce1582440fb1da9a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.673702:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9dd9bb584400) 00010000:00010000:2.0:1789263728.673703:0:7434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789263728.673705:0:7434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23800/0xce1582440fb1da9a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.673708:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23800/0xce1582440fb1da9a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.673737:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23600/0xce1582440fb1da8c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11c61 expref: 12 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.673749:0:7434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22e00/0xce1582440fb1daa1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11c61 expref: 11 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.673755:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9dd9bb584100) 00010000:00010000:2.0:1789263728.673757:0:7434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789263728.673760:0:7434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bfa22e00, rc 0) 00000100:00100000:2.0:1789263728.673792:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8840b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+11:10462:x1876178888571904:12345-192.168.203.20@tcp:101:chown.0 Request processed in 338us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263728.673797:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 25 00000100:00100000:0.0:1789263728.674767:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263728.674818:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888572032 00000100:00100000:2.0:1789263728.674824:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888572032 00000100:00100000:2.0:1789263728.674862:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 6 00000100:00100000:2.0:1789263728.674870:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8840b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:3ce90ea2-917f-4b54-98b0-25e051f2317f+11:10462:x1876178888572032:12345-192.168.203.20@tcp:900:chown.0 00000100:00100000:2.0:1789263728.674914:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8840b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:3ce90ea2-917f-4b54-98b0-25e051f2317f+11:10462:x1876178888572032:12345-192.168.203.20@tcp:900:chown.0 Request processed in 46us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263728.674923:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 6 00000100:00100000:1.0:1789263728.675849:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263728.675895:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888572288 00000100:00100000:2.0:1789263728.675901:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888572288 00000100:00100000:2.0:1789263728.675931:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 26 00000100:00100000:2.0:1789263728.675936:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+11:10462:x1876178888572288:12345-192.168.203.20@tcp:36:chown.0 00010000:00010000:2.0:1789263728.675965:0:6488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789263728.675995:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22e00/0xce1582440fb1daa1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11c61 expref: 11 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.676019:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9dd9bb584100) 00010000:00010000:2.0:1789263728.676023:0:6488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789263728.676053:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1daa8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.676065:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1daa8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.676072:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1daa8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789263728.677329:0:6466:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00010000:00010000:0.0:1789263728.677388:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22600/0xce1582440fb1da5b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263728.677399:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22600/0xce1582440fb1da5b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263728.677407:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22600/0xce1582440fb1da5b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789263728.677409:0:6488:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000272fd17f reply state 000000006b153791 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1daa8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263728.677432:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bfa22600 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263728.677437:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1daa8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263728.677437:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22600/0xce1582440fb1da5b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263728.677457:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22600/0xce1582440fb1da5b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.677459:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9dd9bb584100) 00010000:00010000:2.0:1789263728.677465:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1789263728.677470:0:6488:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789263728.677474:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9dd9bb584400) 00000004:00200000:2.0:1789263728.677479:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789263728.677479:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789263728.677482:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22600/0xce1582440fb1da5b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263728.677489:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22600/0xce1582440fb1da5b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263728.677505:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23200/0xce1582440fb1da62 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263728.677511:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23200/0xce1582440fb1da62 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263728.677517:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23200/0xce1582440fb1da62 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263728.677522:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bfa23200 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:0.0:1789263728.677525:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23200/0xce1582440fb1da62 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263728.677531:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23200/0xce1582440fb1da62 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263728.677550:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9dd9bb584100) 00010000:00010000:0.0:1789263728.677553:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00080000:2.0:1789263728.677555:0:6488:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00010000:00010000:0.0:1789263728.677556:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23200/0xce1582440fb1da62 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263728.677564:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23200/0xce1582440fb1da62 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263728.677577:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1da77 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263728.677582:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+8:10462:x1876178888572288:12345-192.168.203.20@tcp:36:chown.0 Request processed in 1642us (1732us total) trans 4294967301 rc 0/0 00010000:00010000:0.0:1789263728.677587:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1da77 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263728.677596:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 26 00010000:00010000:0.0:1789263728.677597:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1da77 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263728.677604:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883f59000 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:0.0:1789263728.677607:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1da77 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263728.677614:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1da77 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263728.677623:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd883dd9100) 00010000:00010000:0.0:1789263728.677626:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789263728.677629:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1da77 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263728.677633:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1da77 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263728.677692:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1daa8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263728.677767:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1daa8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263728.677774:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1daa8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263728.677779:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bb804400 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263728.677783:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1daa8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263728.677795:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1daa8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263728.677806:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9dd9bb584100) 00010000:00010000:3.0:1789263728.677809:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789263728.677812:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1daa8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263728.677818:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1daa8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263728.685547:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263728.685622:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888572416 00000100:00100000:2.0:1789263728.685631:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888572416 00000100:00100000:2.0:1789263728.685713:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 27 00000100:00100000:2.0:1789263728.685723:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8840b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+6:10463:x1876178888572416:12345-192.168.203.20@tcp:101:touch.500 00010000:00010000:2.0:1789263728.685758:0:8417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263728.685776:0:8417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805000/0xce1582440fb1daaf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11c68 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789263728.686430:0:8417:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 608us 00010000:00010000:2.0:1789263728.693062:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805e00/0xce1582440fb1dab6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.693103:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805e00/0xce1582440fb1dab6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.693115:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805e00/0xce1582440fb1dab6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.693133:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805200/0xce1582440fb1dabd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.693140:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805200/0xce1582440fb1dabd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.693148:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805200/0xce1582440fb1dabd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.693264:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804600/0xce1582440fb1dac4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.693273:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804600/0xce1582440fb1dac4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.693286:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804600/0xce1582440fb1dac4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789263728.693325:0:8417:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789263728.693328:0:8417:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789263728.693356:0:8417:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804600/0xce1582440fb1dac4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.693368:0:8417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805e00/0xce1582440fb1dab6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.693375:0:8417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805e00/0xce1582440fb1dab6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.693383:0:8417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805e00/0xce1582440fb1dab6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.693389:0:8417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bb805e00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263728.693393:0:8417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805e00/0xce1582440fb1dab6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.693401:0:8417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805e00/0xce1582440fb1dab6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.693415:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd883dd9100) 00010000:00010000:2.0:1789263728.693418:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789263728.693423:0:8417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805e00/0xce1582440fb1dab6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.693429:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805e00/0xce1582440fb1dab6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.693441:0:8417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805200/0xce1582440fb1dabd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.693459:0:8417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805200/0xce1582440fb1dabd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.693465:0:8417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805200/0xce1582440fb1dabd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.693470:0:8417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bb805200 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263728.693473:0:8417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805200/0xce1582440fb1dabd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.693479:0:8417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805200/0xce1582440fb1dabd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.693488:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9dd9bb584a00) 00010000:00010000:2.0:1789263728.693490:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789263728.693494:0:8417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805200/0xce1582440fb1dabd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.693501:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805200/0xce1582440fb1dabd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.693538:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805000/0xce1582440fb1daaf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11c68 expref: 8 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.693553:0:8417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804600/0xce1582440fb1dac4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11c68 expref: 7 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.693559:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9dd9bb584300) 00010000:00010000:2.0:1789263728.693561:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789263728.693568:0:8417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bb804600, rc 0) 00000100:00100000:2.0:1789263728.693634:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8840b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+7:10463:x1876178888572416:12345-192.168.203.20@tcp:101:touch.500 Request processed in 7910us (8096us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263728.693641:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 27 00000100:00100000:1.0:1789263728.695219:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263728.695316:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888572672 00000100:00100000:2.0:1789263728.695331:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888572672 00000100:00100000:2.0:1789263728.695421:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 28 00000100:00100000:2.0:1789263728.695435:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+7:10463:x1876178888572672:12345-192.168.203.20@tcp:101:touch.500 00010000:00010000:2.0:1789263728.695459:0:7434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263728.695481:0:7434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804200/0xce1582440fb1dacb lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11c6f expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.695621:0:7434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805c00/0xce1582440fb1dad2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.695633:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805c00/0xce1582440fb1dad2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.695657:0:7434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805c00/0xce1582440fb1dad2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.696896:0:7434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804a00/0xce1582440fb1dad9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xf79bc41e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.696913:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804a00/0xce1582440fb1dad9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xf79bc41e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.696929:0:7434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804a00/0xce1582440fb1dad9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xf79bc41e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789263728.697323:0:7434:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:2.0:1789263728.697481:0:7434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804c00/0xce1582440fb1dae0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.697491:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804c00/0xce1582440fb1dae0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.697499:0:7434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804c00/0xce1582440fb1dae0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.697522:0:7434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805c00/0xce1582440fb1dad2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.697527:0:7434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805c00/0xce1582440fb1dad2 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.697531:0:7434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805c00/0xce1582440fb1dad2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.697537:0:7434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bb805c00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263728.697540:0:7434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805c00/0xce1582440fb1dad2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.697547:0:7434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805c00/0xce1582440fb1dad2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.697558:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9dd9bb584300) 00010000:00010000:2.0:1789263728.697561:0:7434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789263728.697564:0:7434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805c00/0xce1582440fb1dad2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.697571:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805c00/0xce1582440fb1dad2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789263728.697593:0:7434:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004905400a reply state 000000008c8d5cbc transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804a00/0xce1582440fb1dad9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xf79bc41e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.697604:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804a00/0xce1582440fb1dad9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xf79bc41e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.697610:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xf79bc41e (ffff9dd9bb584000) 00010000:00010000:2.0:1789263728.697612:0:7434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789263728.697615:0:7434:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789263728.697647:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804200/0xce1582440fb1dacb lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11c6f expref: 10 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.697662:0:7434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804c00/0xce1582440fb1dae0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11c6f expref: 9 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.697669:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9dd9bb584e00) 00010000:00010000:2.0:1789263728.697672:0:7434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789263728.697674:0:7434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bb804c00, rc 0) 00000100:00100000:2.0:1789263728.697750:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+10:10463:x1876178888572672:12345-192.168.203.20@tcp:101:touch.500 Request processed in 2318us (2533us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1789263728.697759:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 28 00000100:00100000:2.0:1789263728.699595:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263728.699654:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888572928 00000100:00100000:1.0:1789263728.699665:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888572928 00000100:00100000:1.0:1789263728.699712:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 29 00000100:00100000:1.0:1789263728.699723:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+10:10463:x1876178888572928:12345-192.168.203.20@tcp:36:touch.500 00010000:00010000:1.0:1789263728.699780:0:6488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789263728.699801:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804c00/0xce1582440fb1dae0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11c6f expref: 10 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263728.699825:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9dd9bb584e00) 00010000:00010000:1.0:1789263728.699832:0:6488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789263728.699871:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59400/0xce1582440fb1daee lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263728.699888:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59400/0xce1582440fb1daee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263728.699895:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59400/0xce1582440fb1daee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789263728.699996:0:6488:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f8a70dec reply state 0000000043dd9b5d transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59400/0xce1582440fb1daee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263728.700007:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59400/0xce1582440fb1daee lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263728.700013:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9dd883dd9c00) 00010000:00010000:1.0:1789263728.700016:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789263728.700018:0:6488:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789263728.700113:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+11:10463:x1876178888572928:12345-192.168.203.20@tcp:36:touch.500 Request processed in 389us (521us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1789263728.700122:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 29 00000100:00100000:0.0:1789263728.701383:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263728.701472:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888573056 00000100:00100000:2.0:1789263728.701479:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888573056 00000100:00100000:2.0:1789263728.701517:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 30 00000100:00100000:2.0:1789263728.701526:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+11:10463:x1876178888573056:12345-192.168.203.20@tcp:101:touch.500 00010000:00010000:2.0:1789263728.701541:0:8417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263728.701564:0:8417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805000/0xce1582440fb1daf5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11c76 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.701602:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805000/0xce1582440fb1daf5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11c76 expref: 12 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.701613:0:8417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805000/0xce1582440fb1daf5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11c76 expref: 12 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.701628:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9dd883dd9c00) 00010000:00010000:2.0:1789263728.701631:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789263728.701634:0:8417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bb805000, rc 0) 00000100:00100000:2.0:1789263728.701676:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+12:10463:x1876178888573056:12345-192.168.203.20@tcp:101:touch.500 Request processed in 150us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263728.701682:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 30 00000100:00100000:0.0:1789263728.703299:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263728.703389:0:8511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888573184 00000100:00100000:3.0:1789263728.703405:0:8511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888573184 00000100:00100000:3.0:1789263728.703436:0:8511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 22 00000100:00100000:3.0:1789263728.703442:0:8511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2396:x1876178888573184:12345-192.168.203.20@tcp:8:touch.500 00010000:00080000:3.0:1789263728.703468:0:8511:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 3ce90ea2-917f-4b54-98b0-25e051f2317f@192.168.203.20@tcp t0 exp 0000000000000000 cur 170 last 0 00000020:00000080:3.0:1789263728.703501:0:8511:0:(genops.c:1385:class_connect()) connect: client 3ce90ea2-917f-4b54-98b0-25e051f2317f, cookie 0xce1582440fb1dafc 00002000:00100000:3.0:1789263728.703514:0:8511:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3ce90ea2-917f-4b54-98b0-25e051f2317f/ffff9dd883f8d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789263728.703532:0:8511:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789263728.703597:0:8511:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789263728.703624:0:8511:0:(import.c:65:import_set_state_nolock()) ffff9dd883f8c000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789263728.703691:0:8511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+6:2396:x1876178888573184:12345-192.168.203.20@tcp:8:touch.500 Request processed in 247us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263728.703699:0:8511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 22 00000100:00100000:1.0:1789263728.704764:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263728.704819:0:8394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888573312 00000100:00100000:3.0:1789263728.704825:0:8394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888573312 00000100:00080000:0.0:1789263728.704862:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789263728.704872:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 23 00000100:00100000:3.0:1789263728.704890:0:8394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+6:0:x1876178888573312:12345-192.168.203.20@tcp:2:touch.500 00000001:00080000:0.0:1789263728.708452:0:8388:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00100000:0.0:1789263728.708465:0:8388:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3ce90ea2-917f-4b54-98b0-25e051f2317f 00000100:00100000:3.0:1789263728.708598:0:8394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+5:0:x1876178888573312:12345-192.168.203.20@tcp:2:touch.500 Request processed in 3704us (3831us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1789263728.708609:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 23 00000100:00100000:0.0:1789263728.709937:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263728.710012:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888573568 00000100:00100000:2.0:1789263728.710021:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888573568 00000100:00100000:2.0:1789263728.710135:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 2 00000100:00100000:2.0:1789263728.710146:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+12:10463:x1876178888573568:12345-192.168.203.20@tcp:35:touch.500 00000100:00100000:2.0:1789263728.710391:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+13:10463:x1876178888573568:12345-192.168.203.20@tcp:35:touch.500 Request processed in 247us (459us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1789263728.710399:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 2 00000100:00100000:0.0:1789263728.717849:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263728.718136:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888573696 00000100:00100000:2.0:1789263728.718146:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888573696 00000100:00100000:2.0:1789263728.718206:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 31 00000100:00100000:2.0:1789263728.718217:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+13:10464:x1876178888573696:12345-192.168.203.20@tcp:101:rm.0 00010000:00010000:2.0:1789263728.718240:0:7434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263728.718284:0:7434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804200/0xce1582440fb1db03 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11c7d expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.718345:0:7434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805c00/0xce1582440fb1db0a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.718359:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805c00/0xce1582440fb1db0a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.718372:0:7434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805c00/0xce1582440fb1db0a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789263728.718411:0:7434:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789263728.718415:0:7434:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789263728.718449:0:7434:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805c00/0xce1582440fb1db0a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.718478:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804200/0xce1582440fb1db03 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11c7d expref: 15 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.718494:0:7434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805c00/0xce1582440fb1db0a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11c7d expref: 14 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.718502:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9dd9bb584300) 00010000:00010000:2.0:1789263728.718506:0:7434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789263728.718509:0:7434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bb805c00, rc 0) 00000100:00100000:2.0:1789263728.718579:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+14:10464:x1876178888573696:12345-192.168.203.20@tcp:101:rm.0 Request processed in 364us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263728.718587:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 31 00000100:00100000:0.0:1789263728.723376:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263728.723465:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888573952 00000100:00100000:1.0:1789263728.723478:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888573952 00000100:00100000:1.0:1789263728.723548:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 32 00000100:00100000:1.0:1789263728.723560:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+14:10464:x1876178888573952:12345-192.168.203.20@tcp:101:rm.0 00010000:00010000:1.0:1789263728.723586:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263728.723611:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1db11 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11c84 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789263728.723743:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789263728.723874:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1db11 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11c84 expref: 16 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263728.723910:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd883dd9100) 00010000:00010000:1.0:1789263728.723913:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789263728.723919:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1db11 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11c84 expref: 16 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263728.723934:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd883f59800, rc 0) 00000100:00100000:1.0:1789263728.724014:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+15:10464:x1876178888573952:12345-192.168.203.20@tcp:101:rm.0 Request processed in 456us (652us total) trans 4294967305 rc 301/301 00000100:00100000:1.0:1789263728.724022:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 32 00000100:00100000:0.0:1789263728.726216:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263728.726269:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888574080 00000100:00100000:2.0:1789263728.726296:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888574080 00000100:00100000:2.0:1789263728.726351:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 3 00000100:00100000:2.0:1789263728.726362:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+15:10464:x1876178888574080:12345-192.168.203.20@tcp:37:rm.0 00000100:00100000:2.0:1789263728.728736:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+15:10464:x1876178888574080:12345-192.168.203.20@tcp:37:rm.0 Request processed in 2369us (2518us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263728.728748:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 3 00000100:00100000:0.0:1789263728.730717:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263728.730766:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888574336 00000100:00100000:1.0:1789263728.730776:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888574336 00000100:00100000:1.0:1789263728.730829:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 4 00000100:00100000:1.0:1789263728.730840:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a38050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+15:10464:x1876178888574336:12345-192.168.203.20@tcp:35:rm.0 00000100:00100000:1.0:1789263728.731036:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a38050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+16:10464:x1876178888574336:12345-192.168.203.20@tcp:35:rm.0 Request processed in 199us (326us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1789263728.731049:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 4 00000100:00100000:0.0:1789263728.732612:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263728.732661:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888574592 00000100:00100000:2.0:1789263728.732673:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888574592 00000100:00100000:2.0:1789263728.732728:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 33 00000100:00100000:2.0:1789263728.732737:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+16:10464:x1876178888574592:12345-192.168.203.20@tcp:101:rm.0 00010000:00010000:2.0:1789263728.732764:0:8417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263728.732784:0:8417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804200/0xce1582440fb1db1f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11c8b expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.732856:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805200/0xce1582440fb1db26 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.732866:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805200/0xce1582440fb1db26 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.732874:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805200/0xce1582440fb1db26 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789263728.732882:0:8417:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789263728.732961:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804200/0xce1582440fb1db1f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11c8b expref: 19 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.732990:0:8417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805200/0xce1582440fb1db26 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11c8b expref: 18 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.733015:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9dd9bb584300) 00010000:00010000:2.0:1789263728.733018:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789263728.733022:0:8417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bb805200, rc 0) 00000100:00100000:2.0:1789263728.733069:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+18:10464:x1876178888574592:12345-192.168.203.20@tcp:101:rm.0 Request processed in 332us (462us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1789263728.733096:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 33 00000100:00100000:0.0:1789263728.734613:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263728.734666:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888574720 00000100:00100000:2.0:1789263728.734673:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888574720 00000100:00100000:2.0:1789263728.734713:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 34 00000100:00100000:2.0:1789263728.734721:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+18:10464:x1876178888574720:12345-192.168.203.20@tcp:41:rm.0 00000004:00000024:2.0:1789263728.734761:0:7434:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:2.0:1789263728.734804:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+18:10464:x1876178888574720:12345-192.168.203.20@tcp:41:rm.0 Request processed in 82us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263728.734813:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 34 00000100:00100000:0.0:1789263728.735655:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263728.735712:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888574848 00000100:00100000:1.0:1789263728.735718:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888574848 00000100:00100000:1.0:1789263728.735752:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 35 00000100:00100000:1.0:1789263728.735761:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+18:10464:x1876178888574848:12345-192.168.203.20@tcp:101:rm.0 00010000:00010000:1.0:1789263728.735773:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263728.735787:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1db34 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11c92 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263728.735833:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1db3b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263728.735856:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1db3b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263728.735866:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1db3b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263728.735876:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58e00/0xce1582440fb1db42 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xf79bc41e bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263728.735884:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58e00/0xce1582440fb1db42 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xf79bc41e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263728.735891:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58e00/0xce1582440fb1db42 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xf79bc41e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263728.735968:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1db49 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263728.735990:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1db49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263728.735996:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1db49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789263728.736025:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789263728.736030:0:6488:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789263728.736043:0:6488:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1db49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263728.736054:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1db49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263728.736072:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1db3b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263728.736106:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1db3b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263728.736113:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1db3b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263728.736120:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883f58800 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263728.736124:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1db3b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263728.736131:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1db3b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263728.736142:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9dd9bb584300) 00010000:00010000:1.0:1789263728.736145:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263728.736149:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1db3b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263728.736155:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1db3b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263728.736166:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58e00/0xce1582440fb1db42 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xf79bc41e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263728.736172:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58e00/0xce1582440fb1db42 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xf79bc41e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263728.736178:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58e00/0xce1582440fb1db42 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xf79bc41e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263728.736190:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883f58e00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263728.736194:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58e00/0xce1582440fb1db42 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xf79bc41e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263728.736200:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58e00/0xce1582440fb1db42 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xf79bc41e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263728.736209:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xf79bc41e (ffff9dd9bb584000) 00010000:00010000:1.0:1789263728.736211:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263728.736214:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58e00/0xce1582440fb1db42 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xf79bc41e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263728.736221:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58e00/0xce1582440fb1db42 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xf79bc41e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263728.736242:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1db34 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11c92 expref: 20 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263728.736251:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1db49 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11c92 expref: 19 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263728.736255:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9dd883dd9c00) 00010000:00010000:1.0:1789263728.736257:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789263728.736258:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd883f58a00, rc 0) 00000100:00100000:1.0:1789263728.736291:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+19:10464:x1876178888574848:12345-192.168.203.20@tcp:101:rm.0 Request processed in 532us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263728.736297:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 35 00000100:00100000:0.0:1789263728.737656:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263728.737693:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888575104 00000100:00100000:2.0:1789263728.737698:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888575104 00000100:00100000:2.0:1789263728.737728:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 36 00000100:00100000:2.0:1789263728.737735:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+19:10464:x1876178888575104:12345-192.168.203.20@tcp:36:rm.0 00010000:00010000:2.0:1789263728.737793:0:8417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789263728.737811:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1db49 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11c92 expref: 19 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.737827:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805000/0xce1582440fb1daf5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11c76 expref: 18 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.737849:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9dd883dd9c00) 00010000:00010000:2.0:1789263728.737859:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805c00/0xce1582440fb1db0a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11c7d expref: 17 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.737867:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9dd9bb584300) 00010000:00010000:2.0:1789263728.737870:0:8417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789263728.737891:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805e00/0xce1582440fb1db50 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.737901:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805e00/0xce1582440fb1db50 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.737909:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805e00/0xce1582440fb1db50 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.737918:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804e00/0xce1582440fb1db57 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xf79bc41e bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.737931:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804e00/0xce1582440fb1db57 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xf79bc41e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.737941:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804e00/0xce1582440fb1db57 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xf79bc41e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.738012:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804800/0xce1582440fb1db5e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.738021:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804800/0xce1582440fb1db5e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.738037:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804800/0xce1582440fb1db5e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789263728.738269:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1789263728.738279:0:8417:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 171028201803ns, next at 172028199733ns, rc = 0 00010000:00010000:2.0:1789263728.738323:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1db65 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.738332:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1db65 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.738339:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1db65 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.738346:0:8417:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1db65 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.738352:0:8417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1db65 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.738358:0:8417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1db65 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.738379:0:8417:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789263728.738402:0:8417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804800/0xce1582440fb1db5e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263728.738408:0:6475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789263728.738409:0:8417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804800/0xce1582440fb1db5e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263728.738416:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1db65 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.738420:0:8417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804800/0xce1582440fb1db5e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263728.738424:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bb805800 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:3.0:1789263728.738427:0:6475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1db65 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.738444:0:8417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bb804800 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263728.738445:0:6475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1db65 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.738450:0:8417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804800/0xce1582440fb1db5e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263728.738458:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9dd883dd9c00) 00010000:00010000:3.0:1789263728.738463:0:6475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789263728.738467:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1db65 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.738468:0:8417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804800/0xce1582440fb1db5e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263728.738483:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1db65 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.738489:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9dd883dd9c00) 00010000:00010000:2.0:1789263728.738493:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789263728.738496:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789263728.738497:0:8417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804800/0xce1582440fb1db5e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263728.738498:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263728.738501:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789263728.738507:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804800/0xce1582440fb1db5e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.738522:0:8417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805e00/0xce1582440fb1db50 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.738527:0:8417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805e00/0xce1582440fb1db50 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.738534:0:8417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805e00/0xce1582440fb1db50 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.738538:0:8417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bb805e00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263728.738541:0:8417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805e00/0xce1582440fb1db50 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.738546:0:8417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805e00/0xce1582440fb1db50 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.738562:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9dd9bb584300) 00010000:00010000:2.0:1789263728.738564:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789263728.738567:0:8417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805e00/0xce1582440fb1db50 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.738572:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805e00/0xce1582440fb1db50 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789263728.738579:0:8417:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000056421459 reply state 00000000fe936a86 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804e00/0xce1582440fb1db57 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xf79bc41e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.738588:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804e00/0xce1582440fb1db57 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xf79bc41e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.738595:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xf79bc41e (ffff9dd9bb584000) 00010000:00010000:2.0:1789263728.738596:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789263728.738599:0:8417:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789263728.738658:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+18:10464:x1876178888575104:12345-192.168.203.20@tcp:36:rm.0 Request processed in 922us (1005us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1789263728.738665:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 36 00000100:00100000:0.0:1789263728.740673:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263728.740780:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888575360 00000100:00100000:2.0:1789263728.740789:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888575360 00000100:00100000:2.0:1789263728.740831:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 5 00000100:00100000:2.0:1789263728.740841:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+18:10464:x1876178888575360:12345-192.168.203.20@tcp:35:rm.0 00000100:00100000:2.0:1789263728.741035:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+19:10464:x1876178888575360:12345-192.168.203.20@tcp:35:rm.0 Request processed in 191us (364us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1789263728.741043:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 5 00000100:00100000:0.0:1789263728.742489:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263728.742525:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888575616 00000100:00100000:2.0:1789263728.742542:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888575616 00000100:00100000:2.0:1789263728.742580:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 37 00000100:00100000:2.0:1789263728.742586:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+19:10464:x1876178888575616:12345-192.168.203.20@tcp:36:rm.0 00010000:00010000:2.0:1789263728.742616:0:7434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789263728.742638:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805200/0xce1582440fb1db26 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11c8b expref: 19 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.742658:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804600/0xce1582440fb1dac4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11c68 expref: 18 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.742669:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9dd9bb584300) 00010000:00010000:2.0:1789263728.742683:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22c00/0xce1582440fb1da85 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11c5a expref: 17 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.742698:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd883dd9100) 00010000:00010000:2.0:1789263728.742709:0:7434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789263728.742729:0:7434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805a00/0xce1582440fb1db6c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.742738:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805a00/0xce1582440fb1db6c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.742744:0:7434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805a00/0xce1582440fb1db6c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.742753:0:7434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805400/0xce1582440fb1db73 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.742760:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805400/0xce1582440fb1db73 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.742777:0:7434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805400/0xce1582440fb1db73 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.742839:0:7434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804000/0xce1582440fb1db7a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.742847:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804000/0xce1582440fb1db7a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.742854:0:7434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804000/0xce1582440fb1db7a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789263728.743036:0:7434:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789263728.743049:0:7434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804000/0xce1582440fb1db7a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.743056:0:7434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804000/0xce1582440fb1db7a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.743063:0:7434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804000/0xce1582440fb1db7a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.743069:0:7434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bb804000 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263728.743072:0:7434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804000/0xce1582440fb1db7a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.743109:0:7434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804000/0xce1582440fb1db7a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.743119:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9dd9bb584f00) 00010000:00010000:2.0:1789263728.743123:0:7434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789263728.743133:0:7434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804000/0xce1582440fb1db7a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.743140:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804000/0xce1582440fb1db7a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.743157:0:7434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805a00/0xce1582440fb1db6c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.743163:0:7434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805a00/0xce1582440fb1db6c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.743169:0:7434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805a00/0xce1582440fb1db6c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.743175:0:7434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bb805a00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263728.743177:0:7434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805a00/0xce1582440fb1db6c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.743183:0:7434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805a00/0xce1582440fb1db6c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.743190:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd9bb584a00) 00010000:00010000:2.0:1789263728.743192:0:7434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789263728.743194:0:7434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805a00/0xce1582440fb1db6c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.743199:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805a00/0xce1582440fb1db6c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789263728.743209:0:7434:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000142d82b5 reply state 00000000f3bfa7a5 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805400/0xce1582440fb1db73 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.743240:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805400/0xce1582440fb1db73 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263728.743246:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9dd9bb584600) 00010000:00010000:2.0:1789263728.743249:0:7434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789263728.743251:0:7434:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789263728.743307:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+18:10464:x1876178888575616:12345-192.168.203.20@tcp:36:rm.0 Request processed in 720us (822us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1789263728.743326:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 37 00010000:00010000:2.0:1789263729.069280:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789263729.594412:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263729.594533:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263729.594568:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263729.594607:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888575744 00000100:00100000:3.0:1789263729.594617:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888575744 00000100:00100000:1.0:1789263729.594668:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263729.594674:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 290 00000100:00100000:3.0:1789263729.594687:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+13:2398:x1876178888575744:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1789263729.594713:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263729.594766:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+13:2398:x1876178888575744:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 82us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263729.594774:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 290 00000100:00100000:2.0:1789263729.594837:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888575872 00000100:00100000:2.0:1789263729.594842:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888575872 00000100:00100000:2.0:1789263729.594878:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888576000 00000100:00100000:2.0:1789263729.594881:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888576000 00000100:00100000:2.0:1789263729.594918:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 81 00000100:00100000:2.0:1789263729.594926:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+18:2397:x1876178888575872:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789263729.594982:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+18:2397:x1876178888575872:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 57us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263729.594990:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 81 00000100:00100000:2.0:1789263729.595008:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 82 00000100:00100000:2.0:1789263729.595015:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+5:2398:x1876178888576000:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789263729.595050:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+5:2398:x1876178888576000:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 35us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263729.595067:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 82 00000100:00080000:2.0:1789263729.595105:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789263729.595179:0:8395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888576128 00000100:00100000:2.0:1789263729.595189:0:8395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888576128 00000100:00100000:2.0:1789263729.595218:0:8395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 44 00000100:00100000:2.0:1789263729.595225:0:8395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+5:2397:x1876178888576128:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789263729.595260:0:8395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+5:2397:x1876178888576128:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 35us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263729.595267:0:8395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 44 00000100:00100000:1.0:1789263729.595579:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263729.595596:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888576256 00000100:00100000:2.0:1789263729.595602:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888576256 00000100:00100000:1.0:1789263729.595607:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263729.595640:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888576384 00000100:00100000:2.0:1789263729.595645:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888576384 00000100:00100000:1.0:1789263729.595653:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263729.595674:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 83 00000100:00100000:1.0:1789263729.595680:0:8394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888576512 00000100:00100000:2.0:1789263729.595686:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:857a0866-badb-47ac-9591-fbf273e4680e+5:2398:x1876178888576256:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1789263729.595686:0:8394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888576512 00000100:00100000:1.0:1789263729.595724:0:8394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888576640 00000100:00100000:1.0:1789263729.595729:0:8394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888576640 00000100:00100000:2.0:1789263729.595730:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:857a0866-badb-47ac-9591-fbf273e4680e+5:2398:x1876178888576256:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 47us (1033us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263729.595739:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 83 00000100:00100000:1.0:1789263729.595757:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 45 00000100:00100000:2.0:1789263729.595764:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 84 00000100:00100000:1.0:1789263729.595770:0:8394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaa5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:857a0866-badb-47ac-9591-fbf273e4680e+5:2398:x1876178888576512:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789263729.595779:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:857a0866-badb-47ac-9591-fbf273e4680e+5:2397:x1876178888576384:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1789263729.595805:0:8394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaa5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:857a0866-badb-47ac-9591-fbf273e4680e+5:2398:x1876178888576512:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 40us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263729.595816:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 45 00000100:00100000:2.0:1789263729.595820:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:857a0866-badb-47ac-9591-fbf273e4680e+5:2397:x1876178888576384:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 41us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263729.595829:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 84 00000100:00100000:1.0:1789263729.595834:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 46 00000100:00100000:1.0:1789263729.595845:0:8394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaa5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:857a0866-badb-47ac-9591-fbf273e4680e+5:2397:x1876178888576640:12345-192.168.203.20@tcp:400:kworker.0 00000100:00080000:2.0:1789263729.595862:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789263729.595868:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789263729.595871:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789263729.595874:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789263729.595875:0:8394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaa5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:857a0866-badb-47ac-9591-fbf273e4680e+5:2397:x1876178888576640:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 33us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263729.595884:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 46 00000100:00100000:3.0:1789263729.709243:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898064128:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789263729.709243:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898064000:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789263729.709316:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263729.709400:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:66a76ccf-c64c-4b18-8369-a2861ec3956c:3618:1876178898064256:0@lo:400:kworker.0 00000100:00100000:3.0:1789263729.709412:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263729.709446:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263729.709450:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8838f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1876178898064640:0@lo:400:kworker.0 00000100:00100000:1.0:1789263729.709483:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8838f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1876178898064768:0@lo:400:kworker.0 00000100:00100000:3.0:1789263729.709490:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263729.709513:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8838f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898064512:0@lo:400:kworker.0 00000100:00100000:3.0:1789263729.709524:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8838f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898065152:0@lo:400:kworker.0 00000100:00100000:1.0:1789263729.709524:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263729.709555:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8838f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898065280:0@lo:400:kworker.0 00000100:00100000:2.0:1789263729.709558:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263729.709577:0:8512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898064000 00000100:00100000:3.0:1789263729.709585:0:8512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898064000 00000100:00100000:1.0:1789263729.709604:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263729.709606:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8838f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898065024:0@lo:400:kworker.0 00000100:00100000:1.0:1789263729.709637:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8838f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898065792:0@lo:400:kworker.0 00000100:00100000:2.0:1789263729.709643:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263729.709646:0:8512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898064128 00000100:00100000:3.0:1789263729.709651:0:8512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898064128 00000100:00100000:2.0:1789263729.709674:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8838f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1876178898065536:0@lo:400:kworker.0 00000100:00100000:1.0:1789263729.709675:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263729.709677:0:8511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898065280 00000100:00100000:3.0:1789263729.709684:0:8512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789263729.709685:0:8511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898065280 00000100:00100000:1.0:1789263729.709706:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789263729.709710:0:8512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1876178898064000:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789263729.709714:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263729.709718:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876178898064384:0@lo:400:kworker.0 00000100:00100000:0.0:1789263729.709728:0:8511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898065024 00000100:00100000:0.0:1789263729.709733:0:8511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898065024 00002000:00000024:3.0:1789263729.709746:0:8512:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789263729.709751:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898064512 00000100:00100000:1.0:1789263729.709756:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263729.709757:0:8511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898065792 00000100:00100000:2.0:1789263729.709762:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898064512 00000100:00100000:0.0:1789263729.709763:0:8511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898065792 00000100:00100000:1.0:1789263729.709788:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8838f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1876178898064896:0@lo:400:kworker.0 00000100:00100000:0.0:1789263729.709791:0:8511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789263729.709800:0:8512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1876178898064000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263729.709806:0:8511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8838f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1876178898065280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263729.709812:0:8512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789263729.709812:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789263729.709820:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263729.709827:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898064512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263729.709840:0:8512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789263729.709845:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8838f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1876178898065408:0@lo:400:kworker.0 00000100:00100000:3.0:1789263729.709852:0:8512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1876178898064128:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789263729.709867:0:8512:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789263729.709867:0:8511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8838f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1876178898065280:12345-0@lo:400:kworker.0 Request processed in 66us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263729.709882:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263729.709884:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898064512:12345-0@lo:400:kworker.0 Request processed in 57us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263729.709896:0:8511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789263729.709897:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:1.0:1789263729.709909:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd8838f0a80 x1876178898065280/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789263745 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263729.709917:0:8512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1876178898064128:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263729.709922:0:8511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789263729.709925:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8838f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898065280:0@lo:400:kworker.0 00000100:00100000:2.0:1789263729.709938:0:8395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789263729.709938:0:8511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898065024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263729.709944:0:8512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789263729.709953:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898064256 00000100:00100000:2.0:1789263729.709954:0:8395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8838f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1876178898065792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789263729.709957:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898064256 00000100:00100000:3.0:1789263729.709990:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898064640 00000100:00100000:0.0:1789263729.710001:0:8511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898065024:12345-0@lo:400:kworker.0 Request processed in 67us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263729.710003:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898064640 00000100:00100000:1.0:1789263729.710016:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1789263729.710016:0:8511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789263729.710021:0:8395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8838f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1876178898065792:12345-0@lo:400:kworker.0 Request processed in 70us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263729.710032:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+24:3618:x1876178898064256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789263729.710033:0:8395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789263729.710034:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898064768 00000100:00100000:3.0:1789263729.710040:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898064768 00000100:00100000:2.0:1789263729.710062:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898065536 00000100:00100000:3.0:1789263729.710066:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898064384 00000100:00100000:2.0:1789263729.710068:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898065536 00000100:00100000:3.0:1789263729.710070:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898064384 00000100:00100000:1.0:1789263729.710100:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+24:3618:x1876178898064256:12345-0@lo:400:kworker.0 Request processed in 49us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263729.710106:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898064896 00000100:00100000:1.0:1789263729.710109:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1789263729.710111:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898064896 00000100:00100000:2.0:1789263729.710123:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898065408 00000100:00100000:2.0:1789263729.710130:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898065408 00000100:00100000:0.0:1789263729.710130:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789263729.710143:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1876178898064640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263729.710153:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789263729.710162:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:66a76ccf-c64c-4b18-8369-a2861ec3956c:3618:1876178898064256:0@lo:400:kworker.0 00000100:00100000:3.0:1789263729.710165:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8838f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876178898064768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789263729.710172:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789263729.710185:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8838f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876178898064384:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1789263729.710186:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd8838f2d80 x1876178898065792/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789263745 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263729.710191:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1876178898064640:12345-0@lo:400:kworker.0 Request processed in 49us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263729.710207:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789263729.710210:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8838f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898065792:0@lo:400:kworker.0 00000100:00100000:3.0:1789263729.710221:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8838f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876178898064768:12345-0@lo:400:kworker.0 Request processed in 58us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263729.710232:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789263729.710239:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8838f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876178898064384:12345-0@lo:400:kworker.0 Request processed in 57us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263729.710240:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789263729.710245:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88397e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1876178898065536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789263729.710251:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876178898064384:0@lo:400:kworker.0 00000100:00100000:3.0:1789263729.710264:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789263729.710272:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789263729.710275:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8838f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1876178898064768:0@lo:400:kworker.0 00000100:00100000:3.0:1789263729.710278:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8838f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876178898064896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263729.710294:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88397e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1876178898065536:12345-0@lo:400:kworker.0 Request processed in 52us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263729.710299:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789263729.710306:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789263729.710310:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8838f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1876178898065408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263729.710347:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8838f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876178898064896:12345-0@lo:400:kworker.0 Request processed in 74us (525us total) trans 0 rc 0/0 00000100:00080000:1.0:1789263729.710349:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789263729.710352:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8838f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1876178898065408:12345-0@lo:400:kworker.0 Request processed in 44us (472us total) trans 0 rc 0/0 00000100:00080000:1.0:1789263729.710355:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789263729.710361:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789263729.710364:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:1.0:1789263729.710365:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789263729.710370:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789263729.710384:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263729.710411:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8838f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898065664:0@lo:400:kworker.0 00000100:00100000:0.0:1789263729.710413:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898065152 00000100:00100000:0.0:1789263729.710418:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898065152 00000100:00100000:2.0:1789263729.710437:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8838f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898064512:0@lo:400:kworker.0 00000100:00100000:1.0:1789263729.710445:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1789263729.710454:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd8838f1c00 x1876178898065024/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789263745 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263729.710458:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789263729.710471:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8838f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898065024:0@lo:400:kworker.0 00000100:00100000:0.0:1789263729.710472:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8838f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1876178898065152:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1789263729.710477:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd9bfa71880 x1876178898064128/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789263745 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1789263729.710491:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd8838f2a00 x1876178898065536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263745 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789263729.710497:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898064128:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789263729.710501:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8838f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1876178898065536:0@lo:400:kworker.0 00010000:00080000:2.0:1789263729.710521:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd9bfa66300 x1876178898064000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789263745 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263729.710522:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8838f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1876178898065152:12345-0@lo:400:kworker.0 Request processed in 53us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263729.710529:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8838f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1876178898064640:0@lo:400:kworker.0 00000100:00100000:0.0:1789263729.710540:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789263729.710543:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8838f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898065152:0@lo:400:kworker.0 00000100:00100000:2.0:1789263729.710551:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898064000:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789263729.710569:0:8511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898065664 00000100:00100000:0.0:1789263729.710574:0:8511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898065664 00010000:00080000:1.0:1789263729.710586:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd8838f0e00 x1876178898064896/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263745 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789263729.710597:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8838f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1876178898064896:0@lo:400:kworker.0 00000100:00100000:1.0:1789263729.710611:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8838f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1876178898065408:0@lo:400:kworker.0 00000100:00100000:0.0:1789263729.710617:0:8511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789263729.710627:0:8511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8838f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1876178898065664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263729.710665:0:8511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8838f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1876178898065664:12345-0@lo:400:kworker.0 Request processed in 41us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263729.710672:0:8511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:1.0:1789263729.710684:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd8838f2300 x1876178898065664/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789263745 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789263729.710694:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8838f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898065664:0@lo:400:kworker.0 00010000:00010000:0.0:1789263730.094222:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789263730.221224:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8838f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898066048:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789263730.221226:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898066176:0@lo:41:osp-pre-1-0.0 00000004:00080000:2.0:1789263730.221229:0:8509:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 172511150696ns, next at 173511147881ns, rc = 0 00000100:00100000:2.0:1789263730.221272:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898065920:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789263730.221305:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263730.221313:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263730.221341:0:8499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898066176 00000100:00100000:2.0:1789263730.221348:0:8499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898066176 00000100:00100000:3.0:1789263730.221351:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263730.221399:0:8499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789263730.221410:0:8499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1876178898066176:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789263730.221413:0:8512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898066048 00000100:00100000:3.0:1789263730.221414:0:8396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898065920 00000100:00100000:1.0:1789263730.221420:0:8512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898066048 00000100:00100000:3.0:1789263730.221421:0:8396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898065920 00000004:00000024:2.0:1789263730.221447:0:8499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789263730.221468:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789263730.221478:0:8396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1876178898065920:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789263730.221489:0:8499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1876178898066176:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263730.221495:0:8499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00002000:00000024:3.0:1789263730.221499:0:8396:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789263730.221543:0:8396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1876178898065920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263730.221725:0:8512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789263730.221733:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789263730.221739:0:8512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8838f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1876178898066048:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789263730.221753:0:8512:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789263730.221777:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898066176:0@lo:41:osp-pre-1-0.0 00010000:00080000:3.0:1789263730.221780:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd88397ea00 x1876178898065920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789263746 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263730.221809:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898065920:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789263730.221813:0:8512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8838f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1876178898066048:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263730.221823:0:8512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:0.0:1789263730.221827:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd8838f2300 x1876178898066048/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789263746 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263730.221843:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8838f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898066048:0@lo:13:osp-pre-0-1.0 00000001:02000400:0.0:1789263730.255284:0:13638:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000020:00000080:3.0:1789263730.675616:0:13686:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd2cc36aa0 20000000:00000080:3.0:1789263730.675632:0:13686:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9dd884203c00 uarg=0000000000000000 20000000:01000000:3.0:1789263730.675671:0:13686:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1789263730.675676:0:13686:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1789263730.675681:0:13686:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1789263730.676058:0:13687:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1789263730.676189:0:13686:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1789263730.678739:0:13686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1789263730.678773:0:13686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1789263730.678788:0:13686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1789263730.678802:0:13686:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789263730.678820:0:13686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dd883e72000/0xce1582440fb1db81 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263730.678838:0:13686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd9bfa22000/0xce1582440fb1da15 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1da0e expref: 23 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263730.678846:0:13686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd9bfa22400/0xce1582440fb1da23 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1da1c expref: 23 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263730.678854:0:13686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd883e73e00/0xce1582440fb1da31 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1da2a expref: 23 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263730.678870:0:13686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd883e72a00/0xce1582440fb1da3f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1da38 expref: 23 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263730.678879:0:13686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd9bfa23e00/0xce1582440fb1da46 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11c45 expref: 12 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263730.678885:0:13686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd883e73c00/0xce1582440fb1da4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11c4c expref: 12 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263730.678892:0:13686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dd883e72000/0xce1582440fb1db81 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263730.678926:0:13686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd883e73c00/0xce1582440fb1da4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11c4c expref: 12 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263730.678941:0:13686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dd883e73c00/0xce1582440fb1da4d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11c4c expref: 12 pid: 6480 timeout: 272 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263730.678955:0:13686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa8ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13686:1876178898066304:192.168.203.20@tcp:104: 00010000:00010000:0.0:1789263730.679066:0:13686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd9bfa23e00/0xce1582440fb1da46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11c45 expref: 12 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263730.679073:0:13686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dd9bfa23e00/0xce1582440fb1da46 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11c45 expref: 12 pid: 6481 timeout: 272 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263730.679113:0:13686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa8f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13686:1876178898066432:192.168.203.20@tcp:104: 00010000:00010000:0.0:1789263730.679158:0:13686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd883e72a00/0xce1582440fb1da3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce1582440fb1da38 expref: 23 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263730.679173:0:13686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dd883e72a00/0xce1582440fb1da3f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce1582440fb1da38 expref: 23 pid: 6480 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263730.679180:0:13686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa8ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13686:1876178898066560:0@lo:104: 00000100:00100000:0.0:1789263730.679226:0:13686:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789263730.679259:0:13686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd883e73e00/0xce1582440fb1da31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce1582440fb1da2a expref: 23 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263730.679268:0:13686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dd883e73e00/0xce1582440fb1da31 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce1582440fb1da2a expref: 23 pid: 6481 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263730.679277:0:13686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa8ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13686:1876178898066688:0@lo:104: 00000100:00100000:1.0:1789263730.679287:0:9488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898066560 00000100:00100000:1.0:1789263730.679296:0:9488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898066560 00000100:00100000:0.0:1789263730.679300:0:13686:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263730.679338:0:9488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898066688 00000100:00100000:1.0:1789263730.679342:0:9488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898066688 00010000:00010000:0.0:1789263730.679351:0:13686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd9bfa22400/0xce1582440fb1da23 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce1582440fb1da1c expref: 23 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263730.679359:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00010000:00010000:0.0:1789263730.679365:0:13686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dd9bfa22400/0xce1582440fb1da23 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce1582440fb1da1c expref: 23 pid: 6480 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263730.679372:0:9488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789263730.679373:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:66a76ccf-c64c-4b18-8369-a2861ec3956c+4:13686:x1876178898066560:12345-0@lo:104: 00000100:00100000:3.0:1789263730.679380:0:6471:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 3 min 2 max 56 00000100:00100000:0.0:1789263730.679385:0:13686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa8e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13686:1876178898066816:0@lo:104: 00000100:00100000:1.0:1789263730.679388:0:9488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa8e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:66a76ccf-c64c-4b18-8369-a2861ec3956c+4:13686:x1876178898066688:12345-0@lo:104: 00010000:00010000:2.0:1789263730.679390:0:6470:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff9dd981531a00/0xce1582440fb1da38 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1da3f expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263730.679393:0:6471:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_003' 00010000:00010000:1.0:1789263730.679404:0:9488:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23000/0xce1582440fb1da2a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1da31 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263730.679413:0:13686:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789263730.679447:0:13686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd9bfa22000/0xce1582440fb1da15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce1582440fb1da0e expref: 23 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263730.679456:0:13686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dd9bfa22000/0xce1582440fb1da15 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce1582440fb1da0e expref: 23 pid: 6482 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263730.679466:0:13686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8842ea680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13686:1876178898066944:0@lo:104: 00010000:00010000:2.0:1789263730.679471:0:6470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1789263730.679483:0:9488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789263730.679484:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:66a76ccf-c64c-4b18-8369-a2861ec3956c+4:13686:x1876178898066560:12345-0@lo:104: Request processed in 111us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263730.679492:0:9488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa8e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:66a76ccf-c64c-4b18-8369-a2861ec3956c+4:13686:x1876178898066688:12345-0@lo:104: Request processed in 109us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263730.679495:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789263730.679503:0:9488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789263730.679510:0:13686:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789263730.679516:0:13146:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:2.0:1789263730.679518:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898066816 00000100:00100000:2.0:1789263730.679522:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898066816 00000100:00100000:1.0:1789263730.679522:0:9488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898066944 00010000:00010000:3.0:1789263730.679526:0:13146:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd981531a00/0xce1582440fb1da38 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1da3f expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263730.679527:0:9488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898066944 00000100:00100000:0.0:1789263730.679528:0:13686:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd884086b40 going to sleep for 11 seconds 00010000:00010000:3.0:1789263730.679540:0:13146:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981531a00 already unused, calling callback (ffffffffc12b1c20) 10000000:00010000:3.0:1789263730.679545:0:13146:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd981531a00/0xce1582440fb1da38 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xce1582440fb1da3f expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263730.679550:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789263730.679552:0:13686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa8ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13686:1876178898066560:0@lo:104: 00010000:00010000:3.0:1789263730.679559:0:13146:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd981531a00/0xce1582440fb1da38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xce1582440fb1da3f expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789263730.679568:0:13146:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd981531a00/0xce1582440fb1da38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xce1582440fb1da3f expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263730.679568:0:13686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa8ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13686:1876178898066688:0@lo:104: 00000100:00100000:1.0:1789263730.679569:0:9488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789263730.679571:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa8f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:66a76ccf-c64c-4b18-8369-a2861ec3956c+4:13686:x1876178898066816:12345-0@lo:104: 10000000:01000000:3.0:1789263730.679583:0:13146:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1789263730.679585:0:9488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8842e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:66a76ccf-c64c-4b18-8369-a2861ec3956c+4:13686:x1876178898066944:12345-0@lo:104: 00010000:00010000:2.0:1789263730.679588:0:6470:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff9dd981530400/0xce1582440fb1da1c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1da23 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263730.679596:0:9488:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff9dd883e72c00/0xce1582440fb1da0e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1da15 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263730.679597:0:6475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789263730.679603:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23000/0xce1582440fb1da2a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1da31 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263730.679649:0:6470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789263730.679656:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa8f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:66a76ccf-c64c-4b18-8369-a2861ec3956c+4:13686:x1876178898066816:12345-0@lo:104: Request processed in 95us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263730.679663:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:1.0:1789263730.679664:0:9488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789263730.679672:0:9488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8842e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:66a76ccf-c64c-4b18-8369-a2861ec3956c+4:13686:x1876178898066944:12345-0@lo:104: Request processed in 90us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263730.679680:0:9488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00010000:0.0:1789263730.679695:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bfa23000 already unused, calling callback (ffffffffc12b1c20) 00010000:00010000:2.0:1789263730.679696:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 10000000:00010000:0.0:1789263730.679701:0:6475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23000/0xce1582440fb1da2a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xce1582440fb1da31 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263730.679703:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd981530400/0xce1582440fb1da1c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1da23 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263730.679705:0:7427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789263730.679708:0:13146:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff9dd981531a00/0xce1582440fb1da38 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1da3f expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263730.679721:0:6475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23000/0xce1582440fb1da2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xce1582440fb1da31 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263730.679727:0:13146:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:0.0:1789263730.679738:0:6475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23000/0xce1582440fb1da2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xce1582440fb1da31 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263730.679742:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981530400 already unused, calling callback (ffffffffc12b1c20) 10000000:01000000:0.0:1789263730.679748:0:6475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:00010000:2.0:1789263730.679750:0:6476:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd981530400/0xce1582440fb1da1c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xce1582440fb1da23 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263730.679753:0:13146:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd981531a00/0xce1582440fb1da38 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1da3f expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263730.679758:0:6476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd981530400/0xce1582440fb1da1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xce1582440fb1da23 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789263730.679770:0:6476:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd981530400/0xce1582440fb1da1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xce1582440fb1da23 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789263730.679776:0:6476:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789263730.679779:0:13146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd981531a00/0xce1582440fb1da38 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1da3f expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263730.679779:0:6475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23000/0xce1582440fb1da2a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1da31 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263730.679793:0:6476:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff9dd981530400/0xce1582440fb1da1c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1da23 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263730.679798:0:6475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789263730.679801:0:6476:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789263730.679804:0:13689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263730.679807:0:13146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263730.679810:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23000/0xce1582440fb1da2a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1da31 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263730.679811:0:13146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263730.679815:0:13146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263730.679818:0:7427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd883e72c00/0xce1582440fb1da0e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1da15 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263730.679822:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23000/0xce1582440fb1da2a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1da31 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263730.679831:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd981530400/0xce1582440fb1da1c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1da23 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263730.679832:0:7427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883e72c00 already unused, calling callback (ffffffffc12b1c20) 00000100:00100000:3.0:1789263730.679833:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:66a76ccf-c64c-4b18-8369-a2861ec3956c:3618:1876178898067072:0@lo:103:ldlm_bl.0 10000000:00010000:1.0:1789263730.679839:0:7427:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd883e72c00/0xce1582440fb1da0e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xce1582440fb1da15 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263730.679851:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789263730.679852:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd981530400/0xce1582440fb1da1c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1da23 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263730.679856:0:7427:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd883e72c00/0xce1582440fb1da0e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xce1582440fb1da15 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263730.679862:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263730.679866:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:1.0:1789263730.679870:0:7427:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd883e72c00/0xce1582440fb1da0e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xce1582440fb1da15 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263730.679872:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789263730.679877:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789263730.679878:0:7427:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1789263730.679880:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789263730.679883:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789263730.679893:0:13686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa8e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13686:1876178898066816:0@lo:104: 00000100:00100000:2.0:1789263730.679899:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:66a76ccf-c64c-4b18-8369-a2861ec3956c:3620:1876178898067328:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789263730.679899:0:7427:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff9dd883e72c00/0xce1582440fb1da0e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1da15 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263730.679910:0:13686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8842ea680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13686:1876178898066944:0@lo:104: 00010000:00010000:1.0:1789263730.679911:0:7427:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789263730.679913:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789263730.679924:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8842e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:66a76ccf-c64c-4b18-8369-a2861ec3956c:3618:1876178898067200:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789263730.679932:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789263730.679935:0:13689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263730.679936:0:7427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd883e72c00/0xce1582440fb1da0e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1da15 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263730.679938:0:13689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263730.679947:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd883e72c00/0xce1582440fb1da0e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1da15 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263730.679973:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789263730.679973:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898067072 00000100:00100000:3.0:1789263730.679975:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263730.679980:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898067072 00000100:00100000:2.0:1789263730.679985:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8838f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:66a76ccf-c64c-4b18-8369-a2861ec3956c:3620:1876178898067456:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789263730.679993:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263730.679998:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263730.680003:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263730.680005:0:6473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd883e72a00/0xce1582440fb1da3f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1da38 expref: 24 pid: 6480 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263730.680019:0:7428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898067328 00000100:00100000:1.0:1789263730.680025:0:7428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898067328 00000100:00100000:2.0:1789263730.680030:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263730.680033:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898067200 00000100:00100000:0.0:1789263730.680038:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898067200 00000100:00100000:3.0:1789263730.680042:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898067456 00000100:00100000:3.0:1789263730.680048:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898067456 00010000:00010000:1.0:1789263730.680048:0:7428:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd9bfa22400/0xce1582440fb1da23 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1da1c expref: 26 pid: 6480 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263730.680054:0:6473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd883e73e00/0xce1582440fb1da31 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1da2a expref: 27 pid: 6481 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263730.680068:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00010000:00010000:3.0:1789263730.680071:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd9bfa22000/0xce1582440fb1da15 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1da0e expref: 27 pid: 6482 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263730.680110:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a76ccf-c64c-4b18-8369-a2861ec3956c+27:3618:x1876178898067072:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789263730.680114:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789263730.680124:0:7428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00010000:00010000:2.0:1789263730.680126:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789263730.680126:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88397dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a76ccf-c64c-4b18-8369-a2861ec3956c+27:3620:x1876178898067328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789263730.680136:0:8409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd883e72a00/0xce1582440fb1da3f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1da38 expref: 27 pid: 6480 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263730.680137:0:7428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a76ccf-c64c-4b18-8369-a2861ec3956c+27:3618:x1876178898067200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789263730.680140:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789263730.680149:0:6473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd9bfa22400/0xce1582440fb1da23 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1da1c expref: 27 pid: 6480 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263730.680153:0:7428:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789263730.680156:0:8409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd883e72a00/0xce1582440fb1da3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce1582440fb1da38 expref: 27 pid: 6480 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263730.680162:0:7428:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd883e73e00/0xce1582440fb1da31 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1da2a expref: 27 pid: 6481 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263730.680175:0:6473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd9bfa22400/0xce1582440fb1da23 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce1582440fb1da1c expref: 27 pid: 6480 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263730.680184:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00010000:00010000:2.0:1789263730.680192:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd883e72a00/0xce1582440fb1da3f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce1582440fb1da38 expref: 27 pid: 6480 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263730.680199:0:7428:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd883e73e00/0xce1582440fb1da31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce1582440fb1da2a expref: 27 pid: 6481 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263730.680200:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88397ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a76ccf-c64c-4b18-8369-a2861ec3956c+27:3620:x1876178898067456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789263730.680212:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789263730.680216:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd9bfa22000/0xce1582440fb1da15 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1da0e expref: 26 pid: 6482 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263730.680219:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789263730.680220:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd9bfa22400/0xce1582440fb1da23 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce1582440fb1da1c expref: 26 pid: 6480 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263730.680227:0:7428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd883e73e00/0xce1582440fb1da31 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce1582440fb1da2a expref: 26 pid: 6481 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263730.680229:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd9bfa22000/0xce1582440fb1da15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce1582440fb1da0e expref: 26 pid: 6482 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263730.680246:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789263730.680252:0:7428:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789263730.680253:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd9bfa22000/0xce1582440fb1da15 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce1582440fb1da0e expref: 24 pid: 6482 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263730.680261:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a76ccf-c64c-4b18-8369-a2861ec3956c+24:3618:x1876178898067072:12345-0@lo:103:ldlm_bl.0 Request processed in 181us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263730.680273:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:3.0:1789263730.680277:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789263730.680295:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88397dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66a76ccf-c64c-4b18-8369-a2861ec3956c+23:3620:x1876178898067328:12345-0@lo:103:ldlm_bl.0 Request processed in 171us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263730.680299:0:7428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a76ccf-c64c-4b18-8369-a2861ec3956c+23:3618:x1876178898067200:12345-0@lo:103:ldlm_bl.0 Request processed in 165us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263730.680310:0:7428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789263730.680318:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789263730.680321:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88397ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a76ccf-c64c-4b18-8369-a2861ec3956c+22:3620:x1876178898067456:12345-0@lo:103:ldlm_bl.0 Request processed in 122us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263730.680332:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789263730.680336:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8838f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:66a76ccf-c64c-4b18-8369-a2861ec3956c:3620:1876178898067456:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789263730.680351:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:66a76ccf-c64c-4b18-8369-a2861ec3956c:3620:1876178898067328:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789263730.680394:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8842e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:66a76ccf-c64c-4b18-8369-a2861ec3956c:3618:1876178898067200:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789263730.680411:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:66a76ccf-c64c-4b18-8369-a2861ec3956c:3618:1876178898067072:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789263730.680441:0:13686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa8ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13686:1876178898066304:192.168.203.20@tcp:104: 00000100:00100000:1.0:1789263730.680452:0:13686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa8f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13686:1876178898066432:192.168.203.20@tcp:104: 00010000:00010000:1.0:1789263730.680487:0:13686:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dd883e72000/0xce1582440fb1db81 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263730.680673:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263730.680707:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888576768 00000100:00100000:0.0:1789263730.680712:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888576768 00000100:00100000:2.0:1789263730.680729:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00010000:00010000:0.0:1789263730.680731:0:8409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd9bfa23e00/0xce1582440fb1da46 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11c45 expref: 13 pid: 6481 timeout: 272 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263730.680757:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888576896 00000100:00100000:0.0:1789263730.680761:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888576896 00010000:00010000:0.0:1789263730.680774:0:8409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd883e73c00/0xce1582440fb1da4d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11c4c expref: 14 pid: 6480 timeout: 272 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263730.680775:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 45 00000100:00100000:3.0:1789263730.680785:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd987241050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+14:2398:x1876178888576768:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789263730.680792:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789263730.680798:0:6473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd9bfa23e00/0xce1582440fb1da46 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11c45 expref: 14 pid: 6481 timeout: 272 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263730.680805:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 46 00010000:00010000:3.0:1789263730.680812:0:6473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd9bfa23e00/0xce1582440fb1da46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11c45 expref: 14 pid: 6481 timeout: 272 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263730.680820:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88397ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+14:2397:x1876178888576896:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789263730.680829:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789263730.680834:0:8409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd883e73c00/0xce1582440fb1da4d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11c4c expref: 14 pid: 6480 timeout: 272 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263730.680864:0:8409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd883e73c00/0xce1582440fb1da4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11c4c expref: 14 pid: 6480 timeout: 272 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263730.680879:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd9bfa23e00/0xce1582440fb1da46 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11c45 expref: 14 pid: 6481 timeout: 272 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263730.680885:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd883e73c00/0xce1582440fb1da4d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11c4c expref: 14 pid: 6480 timeout: 272 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263730.680890:0:6473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dd883e72000/0xce1582440fb1db81 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263730.680898:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd883e72000/0xce1582440fb1db81 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263730.680904:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789263730.680908:0:6473:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd883e72000/0xce1582440fb1db81 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263730.680913:0:6473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd883e72000/0xce1582440fb1db81 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263730.680918:0:6473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dd883e72000/0xce1582440fb1db81 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263730.680928:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dd883e72000/0xce1582440fb1db81 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263730.680932:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883e72000 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:3.0:1789263730.680938:0:6473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dd883e72000/0xce1582440fb1db81 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263730.680939:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88397ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+12:2397:x1876178888576896:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 121us (206us total) trans 0 rc 0/0 00010000:00010000:3.0:1789263730.680944:0:6473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dd883e72000/0xce1582440fb1db81 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263730.680970:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 46 00010000:00010000:3.0:1789263730.680980:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dd883e72000/0xce1582440fb1db81 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263730.680992:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789263730.681010:0:13686:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dd883e72000/0xce1582440fb1db81 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263730.681021:0:13686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dd883e72000/0xce1582440fb1db81 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263730.681028:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd987241050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+11:2398:x1876178888576768:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 241us (352us total) trans 0 rc 0/0 00010000:00010000:1.0:1789263730.681032:0:13686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd883e72000/0xce1582440fb1db81 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263730.681042:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 45 00000020:00000080:1.0:1789263731.028572:0:13737:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc4ac15210 20000000:00000080:1.0:1789263731.028587:0:13737:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9dd883f9e800 uarg=0000000000000000 20000000:01000000:1.0:1789263731.028625:0:13737:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:1.0:1789263731.028631:0:13737:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:1.0:1789263731.028636:0:13737:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:1.0:1789263731.029248:0:13738:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:3.0:1789263731.029340:0:13737:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:3.0:1789263731.029411:0:13737:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:3.0:1789263731.029442:0:13737:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:3.0:1789263731.029459:0:13737:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:3.0:1789263731.029481:0:13737:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789263731.029500:0:13737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dd981531a00/0xce1582440fb1db88 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263731.029515:0:13737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd981531a00/0xce1582440fb1db88 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263731.029525:0:13737:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd981531a00/0xce1582440fb1db88 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263731.029538:0:13737:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd981531a00/0xce1582440fb1db88 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263731.029545:0:13737:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dd981531a00/0xce1582440fb1db88 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263731.029552:0:13737:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dd981531a00/0xce1582440fb1db88 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263731.029558:0:13737:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981531a00 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:3.0:1789263731.029563:0:13737:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dd981531a00/0xce1582440fb1db88 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263731.029571:0:13737:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dd981531a00/0xce1582440fb1db88 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263731.029583:0:13737:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dd981531a00/0xce1582440fb1db88 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263731.029591:0:13737:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dd981531a00/0xce1582440fb1db88 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263731.029598:0:13737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd981531a00/0xce1582440fb1db88 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263731.117335:0:13146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789263731.757334:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8842e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898067584:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789263731.757406:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263731.757474:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898067584 00000100:00100000:2.0:1789263731.757483:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898067584 00000100:00100000:2.0:1789263731.757542:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789263731.757557:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1876178898067584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789263731.757589:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789263731.757644:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1876178898067584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263731.757663:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789263731.759973:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8842e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898067584:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789263731.962342:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263731.962426:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888577024 00000100:00100000:3.0:1789263731.962436:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888577024 00000100:00100000:1.0:1789263731.962573:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 292 00000100:00100000:1.0:1789263731.962587:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+11:6155:x1876178888577024:12345-192.168.203.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789263731.962604:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263731.962631:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd883f58c00/0xce1582440fb1db8f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11c99 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263731.962658:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd883f58c00/0xce1582440fb1db8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11c99 expref: 12 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263731.962669:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd883f58c00/0xce1582440fb1db8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11c99 expref: 12 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263731.962678:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd883f58c00, rc 0) 00000100:00100000:1.0:1789263731.962760:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+12:6155:x1876178888577024:12345-192.168.203.20@tcp:101:ll_cfg_requeue.0 Request processed in 176us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263731.962768:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 292 00000100:00100000:0.0:1789263731.963685:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263731.963732:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888577152 00000100:00100000:1.0:1789263731.963738:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888577152 00000100:00100000:1.0:1789263731.963776:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 293 00000100:00100000:1.0:1789263731.963784:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+12:6155:x1876178888577152:12345-192.168.203.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789263731.963899:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+12:6155:x1876178888577152:12345-192.168.203.20@tcp:501:ll_cfg_requeue.0 Request processed in 115us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263731.963906:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 293 00000100:00100000:2.0:1789263731.964701:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263731.965388:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888577280 00000100:00100000:1.0:1789263731.965395:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888577280 00000100:00100000:1.0:1789263731.965441:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 294 00000100:00100000:1.0:1789263731.965450:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+12:6155:x1876178888577280:12345-192.168.203.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789263731.965558:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+12:6155:x1876178888577280:12345-192.168.203.20@tcp:503:ll_cfg_requeue.0 Request processed in 109us (858us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263731.965566:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 294 00000100:00100000:2.0:1789263731.966864:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263731.966902:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888577408 00000100:00100000:3.0:1789263731.966907:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888577408 00000100:00100000:3.0:1789263731.966979:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 295 00000100:00100000:3.0:1789263731.966988:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+12:10748:x1876178888577408:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789263731.967111:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+12:10748:x1876178888577408:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 124us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263731.967120:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 295 00000100:00100000:0.0:1789263731.968186:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263731.968348:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888577536 00000100:00100000:3.0:1789263731.968354:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888577536 00000100:00100000:3.0:1789263731.968390:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 296 00000100:00100000:3.0:1789263731.968398:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+12:10748:x1876178888577536:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789263731.968501:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+12:10748:x1876178888577536:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 103us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263731.968508:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 296 00000100:00100000:2.0:1789263731.970878:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263731.970925:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888577664 00000100:00100000:3.0:1789263731.970981:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888577664 00000100:00100000:3.0:1789263731.971027:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 297 00000100:00100000:3.0:1789263731.971036:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+12:6155:x1876178888577664:12345-192.168.203.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789263731.971050:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263731.971067:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd981531a00/0xce1582440fb1db96 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11ca0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263731.971120:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd981531a00/0xce1582440fb1db96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ca0 expref: 13 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263731.971149:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd981531a00/0xce1582440fb1db96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ca0 expref: 13 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263731.971158:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981531a00, rc 0) 00000100:00100000:3.0:1789263731.971207:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+13:6155:x1876178888577664:12345-192.168.203.20@tcp:101:ll_cfg_requeue.0 Request processed in 172us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263731.971214:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 297 00000100:00100000:2.0:1789263731.972256:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263731.972310:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888577792 00000100:00100000:1.0:1789263731.972316:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888577792 00000100:00100000:1.0:1789263731.972350:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 298 00000100:00100000:1.0:1789263731.972357:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+13:6155:x1876178888577792:12345-192.168.203.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789263731.972469:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+13:6155:x1876178888577792:12345-192.168.203.20@tcp:501:ll_cfg_requeue.0 Request processed in 112us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263731.972476:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 298 00000100:00100000:0.0:1789263731.973352:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263731.973421:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888577920 00000100:00100000:3.0:1789263731.973426:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888577920 00000100:00100000:3.0:1789263731.973458:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 299 00000100:00100000:3.0:1789263731.973466:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+13:6155:x1876178888577920:12345-192.168.203.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789263731.973557:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+13:6155:x1876178888577920:12345-192.168.203.20@tcp:503:ll_cfg_requeue.0 Request processed in 91us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263731.973565:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 299 00000100:00100000:2.0:1789263731.974992:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263731.975104:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888578048 00000100:00100000:1.0:1789263731.975119:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888578048 00000100:00100000:1.0:1789263731.975167:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 300 00000100:00100000:1.0:1789263731.975178:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+13:10751:x1876178888578048:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789263731.975290:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+13:10751:x1876178888578048:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 116us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263731.975296:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 300 00000100:00100000:2.0:1789263731.976409:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263731.976461:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888578176 00000100:00100000:3.0:1789263731.976467:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888578176 00000100:00100000:3.0:1789263731.976512:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 301 00000100:00100000:3.0:1789263731.976520:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+13:10751:x1876178888578176:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789263731.976617:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+13:10751:x1876178888578176:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 98us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263731.976625:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 301 00010000:00010000:0.0:1789263732.141490:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789263732.397193:0:6484:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789263732.397200:0:6484:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dd882a29800 from 7 10000000:01000000:2.0:1789263732.397205:0:6484:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789263732.397250:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9bb804600/0xce1582440fb1db9d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263732.397262:0:6484:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd9bb804600/0xce1582440fb1db9d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263732.397272:0:6484:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd9bb804600/0xce1582440fb1db9d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263732.397297:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898067712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789263732.397355:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263732.397408:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd882a58300 going to sleep for 11 seconds 00000100:00100000:1.0:1789263732.397413:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898067712 00000100:00100000:1.0:1789263732.397422:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898067712 00000100:00100000:1.0:1789263732.397467:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1789263732.397477:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+20:6484:x1876178898067712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789263732.397502:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263732.397515:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd883f58200/0xce1582440fb1dba4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1db9d expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263732.397538:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd883f58200/0xce1582440fb1dba4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1db9d expref: 21 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263732.397548:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd883f58200/0xce1582440fb1dba4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1db9d expref: 21 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263732.397557:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd883f58200, rc 0) 00000100:00100000:1.0:1789263732.397601:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+21:6484:x1876178898067712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263732.397607:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1789263732.397649:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898067712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789263732.397664:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd9bb804600/0xce1582440fb1db9d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1dba4 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263732.397674:0:6484:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd9bb804600/0xce1582440fb1db9d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1dba4 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263732.397760:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898067840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789263732.397801:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263732.397822:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd882a58300 going to sleep for 11 seconds 00000100:00100000:3.0:1789263732.397854:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898067840 00000100:00100000:3.0:1789263732.397859:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898067840 00000100:00100000:3.0:1789263732.397889:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1789263732.397897:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+21:6484:x1876178898067840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789263732.398034:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+21:6484:x1876178898067840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 137us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263732.398041:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1789263732.398117:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898067840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789263732.398158:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898067968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789263732.398202:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263732.398233:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd882a58300 going to sleep for 11 seconds 00000100:00100000:1.0:1789263732.398244:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898067968 00000100:00100000:1.0:1789263732.398251:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898067968 00000100:00100000:1.0:1789263732.398279:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1789263732.398286:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+21:6484:x1876178898067968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789263732.398371:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+21:6484:x1876178898067968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263732.398378:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1789263732.398417:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898067968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789263732.398702:0:13751:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8838f3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:13751:1876178898068096:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789263732.398746:0:13751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263732.398761:0:13751:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd883ed73c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789263732.398788:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898068096 00000100:00100000:3.0:1789263732.398793:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898068096 00000100:00100000:3.0:1789263732.398824:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1789263732.398832:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+21:13751:x1876178898068096:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789263732.398936:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+21:13751:x1876178898068096:12345-0@lo:502:llog_process_th.0 Request processed in 94us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263732.398944:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1789263732.398976:0:13751:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8838f3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:13751:1876178898068096:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789263732.399003:0:13751:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789263732.399012:0:13751:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263732.399015:0:13751:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789263732.399023:0:13751:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9dd882a29800 00000020:00000080:2.0:1789263732.399026:0:13751:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789263732.399100:0:13751:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789263732.399104:0:13751:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263732.399106:0:13751:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789263732.399109:0:13751:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789263732.399112:0:13751:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263732.399113:0:13751:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1789263732.399117:0:13751:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9dd882a29800 00000020:00000080:2.0:1789263732.399119:0:13751:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789263732.399152:0:13751:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:13751:1876178898068224:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789263732.399194:0:13751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263732.399233:0:13751:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd882a58300 going to sleep for 11 seconds 00000100:00100000:1.0:1789263732.399238:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898068224 00000100:00100000:1.0:1789263732.399244:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898068224 00000100:00100000:1.0:1789263732.399287:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1789263732.399296:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+21:13751:x1876178898068224:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789263732.399375:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+21:13751:x1876178898068224:12345-0@lo:502:llog_process_th.0 Request processed in 81us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263732.399387:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1789263732.399579:0:13751:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:13751:1876178898068224:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789263732.399603:0:13751:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789263732.399608:0:13751:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263732.399609:0:13751:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1789263732.399614:0:13751:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1789263732.399700:0:6484:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1789263732.399728:0:6484:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789263732.399738:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9bb804600/0xce1582440fb1db9d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1dba4 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263732.399748:0:6484:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd9bb804600/0xce1582440fb1db9d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1dba4 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789263732.399757:0:6484:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789263732.399759:0:6484:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dd9c1b57000 from 7 10000000:01000000:0.0:1789263732.399761:0:6484:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789263732.399780:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883e73c00/0xce1582440fb1dbab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263732.399787:0:6484:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd883e73c00/0xce1582440fb1dbab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263732.399795:0:6484:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd883e73c00/0xce1582440fb1dbab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263732.399809:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8842eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898068352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789263732.399847:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263732.399864:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd884086d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789263732.399887:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898068352 00000100:00100000:1.0:1789263732.399892:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898068352 00000100:00100000:1.0:1789263732.399920:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1789263732.399928:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c2072c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+21:6484:x1876178898068352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789263732.399936:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263732.399956:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd883f59600/0xce1582440fb1dbb2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1dbab expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263732.399977:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd883f59600/0xce1582440fb1dbb2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1dbab expref: 22 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263732.399989:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd883f59600/0xce1582440fb1dbb2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1dbab expref: 22 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263732.400009:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd883f59600, rc 0) 00000100:00100000:1.0:1789263732.400245:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c2072c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+22:6484:x1876178898068352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 318us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263732.400251:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1789263732.400290:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8842eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898068352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789263732.400305:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd883e73c00/0xce1582440fb1dbab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1dbb2 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263732.400316:0:6484:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd883e73c00/0xce1582440fb1dbab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1dbb2 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263732.400383:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898068480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789263732.400415:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263732.400441:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd882a58300 going to sleep for 11 seconds 00000100:00100000:1.0:1789263732.400818:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898068480 00000100:00100000:1.0:1789263732.400822:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898068480 00000100:00100000:1.0:1789263732.400852:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1789263732.400861:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd991565c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+22:6484:x1876178898068480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789263732.400962:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd991565c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+22:6484:x1876178898068480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 103us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263732.400970:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1789263732.401034:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898068480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789263732.401071:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8842e9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898068608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789263732.401135:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263732.401154:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd8840863c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789263732.401198:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898068608 00000100:00100000:1.0:1789263732.401202:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898068608 00000100:00100000:1.0:1789263732.401225:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1789263732.401232:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd991566050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+22:6484:x1876178898068608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789263732.401319:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd991566050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+22:6484:x1876178898068608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 86us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263732.401327:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1789263732.401399:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8842e9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898068608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789263732.401655:0:13753:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8842e9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:13753:1876178898068736:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789263732.401692:0:13753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263732.401714:0:13753:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd884086000 going to sleep for 11 seconds 00000100:00100000:1.0:1789263732.401768:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898068736 00000100:00100000:1.0:1789263732.401773:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898068736 00000100:00100000:1.0:1789263732.401803:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1789263732.401810:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd991565850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+22:13753:x1876178898068736:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789263732.401899:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd991565850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+22:13753:x1876178898068736:12345-0@lo:502:llog_process_th.0 Request processed in 91us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263732.401904:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1789263732.402068:0:13753:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8842e9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:13753:1876178898068736:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789263732.402119:0:13753:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789263732.402126:0:13753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789263732.402128:0:13753:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789263732.402136:0:13753:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9dd9c1b57000 00000020:00000080:0.0:1789263732.402139:0:13753:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789263732.402186:0:13753:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789263732.402190:0:13753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789263732.402192:0:13753:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789263732.402194:0:13753:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789263732.402197:0:13753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789263732.402199:0:13753:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789263732.402204:0:13753:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9dd9c1b57000 00000020:00000080:0.0:1789263732.402206:0:13753:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789263732.402242:0:13753:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8842e9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:13753:1876178898068864:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789263732.402268:0:13753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263732.402296:0:13753:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd884086000 going to sleep for 11 seconds 00000100:00100000:1.0:1789263732.402310:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898068864 00000100:00100000:1.0:1789263732.402314:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898068864 00000100:00100000:1.0:1789263732.402340:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:1.0:1789263732.402348:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd991567050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+22:13753:x1876178898068864:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789263732.402430:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd991567050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+22:13753:x1876178898068864:12345-0@lo:502:llog_process_th.0 Request processed in 82us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263732.402436:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1789263732.402461:0:13753:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8842e9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:13753:1876178898068864:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789263732.402488:0:13753:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789263732.402498:0:13753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789263732.402500:0:13753:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789263732.402504:0:13753:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1789263732.402585:0:6484:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1789263732.402610:0:6484:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789263732.402618:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883e73c00/0xce1582440fb1dbab lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1dbb2 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263732.402629:0:6484:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd883e73c00/0xce1582440fb1dbab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1dbb2 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789263732.402639:0:6484:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789263732.402641:0:6484:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dd9c0889800 from 7 10000000:01000000:1.0:1789263732.402644:0:6484:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789263732.402666:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883f58600/0xce1582440fb1dbb9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263732.402673:0:6484:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd883f58600/0xce1582440fb1dbb9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263732.402682:0:6484:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd883f58600/0xce1582440fb1dbb9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263732.402696:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8838f0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898068992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789263732.402727:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263732.402756:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd88429f240 going to sleep for 11 seconds 00000100:00100000:0.0:1789263732.402778:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898068992 00000100:00100000:0.0:1789263732.402784:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898068992 00000100:00100000:0.0:1789263732.402815:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1789263732.402824:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd991566850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+22:6484:x1876178898068992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789263732.402831:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263732.402843:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd883e72a00/0xce1582440fb1dbc0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1dbb9 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263732.402863:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd883e72a00/0xce1582440fb1dbc0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1dbb9 expref: 23 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263732.402874:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd883e72a00/0xce1582440fb1dbc0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1dbb9 expref: 23 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263732.402883:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd883e72a00, rc 0) 00000100:00100000:0.0:1789263732.402927:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd991566850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+23:6484:x1876178898068992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263732.402933:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1789263732.402984:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8838f0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898068992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789263732.402995:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd883f58600/0xce1582440fb1dbb9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1dbc0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263732.403003:0:6484:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd883f58600/0xce1582440fb1dbb9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1dbc0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263732.403053:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8838f0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898069120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789263732.403256:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263732.403282:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd88429f240 going to sleep for 11 seconds 00000100:00100000:0.0:1789263732.403296:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898069120 00000100:00100000:0.0:1789263732.403302:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898069120 00000100:00100000:0.0:1789263732.403332:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1789263732.403340:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd991567c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+23:6484:x1876178898069120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789263732.403413:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd991567c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+23:6484:x1876178898069120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 75us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263732.403418:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1789263732.403458:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8838f0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898069120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789263732.403489:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8838f0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898069248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789263732.403530:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263732.403550:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd88429f240 going to sleep for 11 seconds 00000100:00100000:0.0:1789263732.403552:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898069248 00000100:00100000:0.0:1789263732.403562:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898069248 00000100:00100000:0.0:1789263732.403593:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1789263732.403599:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd991564050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+23:6484:x1876178898069248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789263732.403674:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd991564050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+23:6484:x1876178898069248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263732.403681:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1789263732.403706:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8838f0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898069248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789263732.403898:0:13755:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8838f0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:13755:1876178898069376:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789263732.403938:0:13755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263732.403965:0:13755:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd88429f480 going to sleep for 11 seconds 00000100:00100000:0.0:1789263732.403968:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898069376 00000100:00100000:0.0:1789263732.403974:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898069376 00000100:00100000:0.0:1789263732.404003:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1789263732.404011:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd991564850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+23:13755:x1876178898069376:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789263732.404120:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd991564850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+23:13755:x1876178898069376:12345-0@lo:502:llog_process_th.0 Request processed in 110us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263732.404128:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1789263732.404161:0:13755:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8838f0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:13755:1876178898069376:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789263732.404182:0:13755:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789263732.404189:0:13755:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789263732.404192:0:13755:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789263732.404197:0:13755:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9dd9c0889800 00000020:00000080:1.0:1789263732.404200:0:13755:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789263732.404291:0:13755:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789263732.404301:0:13755:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789263732.404303:0:13755:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789263732.404306:0:13755:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789263732.404309:0:13755:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789263732.404310:0:13755:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789263732.404314:0:13755:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9dd9c0889800 00000020:00000080:1.0:1789263732.404316:0:13755:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789263732.404705:0:13755:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8838f0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:13755:1876178898069504:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789263732.404745:0:13755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263732.404780:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898069504 00000100:00100000:1.0:1789263732.404786:0:13755:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd88429f480 going to sleep for 11 seconds 00000100:00100000:2.0:1789263732.404789:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898069504 00000100:00100000:2.0:1789263732.404829:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1789263732.404838:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd991564c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+23:13755:x1876178898069504:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789263732.404918:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd991564c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+23:13755:x1876178898069504:12345-0@lo:502:llog_process_th.0 Request processed in 81us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263732.404924:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1789263732.404963:0:13755:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8838f0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:13755:1876178898069504:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789263732.404986:0:13755:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789263732.404991:0:13755:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789263732.404993:0:13755:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789263732.404996:0:13755:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1789263732.405177:0:6484:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1789263732.405197:0:6484:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789263732.405204:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883f58600/0xce1582440fb1dbb9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1dbc0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263732.405213:0:6484:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd883f58600/0xce1582440fb1dbb9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1dbc0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789263732.405223:0:6484:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789263732.405225:0:6484:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dd9896b8000 from 7 10000000:01000000:0.0:1789263732.405228:0:6484:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789263732.405250:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883e72000/0xce1582440fb1dbc7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263732.405258:0:6484:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd883e72000/0xce1582440fb1dbc7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263732.405279:0:6484:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd883e72000/0xce1582440fb1dbc7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263732.405293:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8842e9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898069632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789263732.405324:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263732.405383:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd884086780 going to sleep for 11 seconds 00000100:00100000:1.0:1789263732.405414:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898069632 00000100:00100000:1.0:1789263732.405419:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898069632 00000100:00100000:1.0:1789263732.405455:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1789263732.405463:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd991567850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+23:6484:x1876178898069632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789263732.405470:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263732.405481:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd883f59200/0xce1582440fb1dbce lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1dbc7 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263732.405500:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd883f59200/0xce1582440fb1dbce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1dbc7 expref: 24 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263732.405510:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd883f59200/0xce1582440fb1dbce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1dbc7 expref: 24 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263732.405519:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd883f59200, rc 0) 00000100:00100000:1.0:1789263732.405562:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd991567850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+24:6484:x1876178898069632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263732.405566:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1789263732.405618:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8842e9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898069632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789263732.405627:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd883e72000/0xce1582440fb1dbc7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1dbce expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263732.405633:0:6484:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd883e72000/0xce1582440fb1dbc7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1dbce expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263732.405673:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8842e9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898069760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789263732.405695:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263732.405716:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd884086780 going to sleep for 11 seconds 00000100:00100000:2.0:1789263732.405735:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898069760 00000100:00100000:2.0:1789263732.405741:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898069760 00000100:00100000:2.0:1789263732.405770:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1789263732.405778:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd991565050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+24:6484:x1876178898069760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789263732.405870:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd991565050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+24:6484:x1876178898069760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 92us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263732.405885:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1789263732.405886:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8842e9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898069760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789263732.405921:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8842e9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898069888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789263732.405970:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263732.405989:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd884086780 going to sleep for 11 seconds 00000100:00100000:1.0:1789263732.406010:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898069888 00000100:00100000:1.0:1789263732.406015:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898069888 00000100:00100000:1.0:1789263732.406042:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1789263732.406053:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd991566450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+24:6484:x1876178898069888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789263732.406148:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd991566450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+24:6484:x1876178898069888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 99us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263732.406153:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1789263732.406164:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8842e9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66a76ccf-c64c-4b18-8369-a2861ec3956c:6484:1876178898069888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789263732.406451:0:13756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8842e9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:13756:1876178898070016:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789263732.406481:0:13756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263732.406505:0:13756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd884086a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789263732.406543:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898070016 00000100:00100000:2.0:1789263732.406547:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898070016 00000100:00100000:2.0:1789263732.406588:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1789263732.406593:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd988441050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+24:13756:x1876178898070016:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789263732.406652:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd988441050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+24:13756:x1876178898070016:12345-0@lo:502:llog_process_th.0 Request processed in 58us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263732.406663:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1789263732.406696:0:13756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8842e9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:13756:1876178898070016:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789263732.406720:0:13756:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789263732.406727:0:13756:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789263732.406730:0:13756:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789263732.406736:0:13756:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9dd9896b8000 00000020:00000080:1.0:1789263732.406739:0:13756:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789263732.406780:0:13756:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789263732.406783:0:13756:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789263732.406785:0:13756:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789263732.406787:0:13756:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789263732.406790:0:13756:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789263732.406791:0:13756:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789263732.406799:0:13756:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9dd9896b8000 00000020:00000080:1.0:1789263732.406801:0:13756:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789263732.406837:0:13756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8838f0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:13756:1876178898070144:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789263732.406869:0:13756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263732.406891:0:13756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd88429f180 going to sleep for 11 seconds 00000100:00100000:0.0:1789263732.406976:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898070144 00000100:00100000:0.0:1789263732.406981:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898070144 00000100:00100000:0.0:1789263732.407011:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1789263732.407017:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd988442050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+24:13756:x1876178898070144:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789263732.407102:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd988442050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+24:13756:x1876178898070144:12345-0@lo:502:llog_process_th.0 Request processed in 84us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263732.407110:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1789263732.407124:0:13756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8838f0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66a76ccf-c64c-4b18-8369-a2861ec3956c:13756:1876178898070144:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789263732.407147:0:13756:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789263732.407151:0:13756:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789263732.407153:0:13756:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789263732.407157:0:13756:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1789263732.407398:0:6484:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1789263732.407421:0:6484:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789263732.407428:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883e72000/0xce1582440fb1dbc7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1dbce expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263732.407438:0:6484:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd883e72000/0xce1582440fb1dbc7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1dbce expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789263732.408821:0:13757:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1789263732.415611:0:13759:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789263733.165211:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789263733.425363:0:13757:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1789263733.425374:0:13759:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789263734.189334:0:13689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789263734.716184:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263734.716276:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263734.716311:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263734.716505:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888578560 00000100:00100000:1.0:1789263734.716514:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888578560 00000100:00100000:1.0:1789263734.716575:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888578816 00000100:00100000:1.0:1789263734.716578:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888578816 00000100:00100000:1.0:1789263734.716604:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 91 00000100:00100000:1.0:1789263734.716614:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8842e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+5:2398:x1876178888578560:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1789263734.716682:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8842e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+5:2398:x1876178888578560:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 70us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263734.716690:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 91 00000100:00100000:1.0:1789263734.716706:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 92 00000100:00100000:1.0:1789263734.716712:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8842e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:857a0866-badb-47ac-9591-fbf273e4680e+5:2398:x1876178888578816:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1789263734.716733:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8842e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:857a0866-badb-47ac-9591-fbf273e4680e+5:2398:x1876178888578816:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 22us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263734.716739:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 92 00000100:00080000:0.0:1789263734.716879:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789263734.716884:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789263734.717060:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263734.717120:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263734.717146:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263734.717221:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888578432 00000100:00100000:3.0:1789263734.717226:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888578432 00000100:00100000:3.0:1789263734.717260:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888578944 00000100:00100000:3.0:1789263734.717263:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888578944 00000100:00100000:3.0:1789263734.717281:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 93 00000100:00100000:3.0:1789263734.717288:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8842e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+18:2398:x1876178888578432:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1789263734.717318:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8842e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+18:2398:x1876178888578432:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 30us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263734.717324:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 93 00000100:00100000:3.0:1789263734.717337:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 94 00000100:00100000:3.0:1789263734.717343:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8842eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:857a0866-badb-47ac-9591-fbf273e4680e+5:2398:x1876178888578944:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1789263734.717362:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8842eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:857a0866-badb-47ac-9591-fbf273e4680e+5:2398:x1876178888578944:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 21us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263734.717369:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 94 00000100:00080000:0.0:1789263734.717434:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789263734.717437:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789263734.717534:0:8394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888578688 00000100:00100000:1.0:1789263734.717539:0:8394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888578688 00000100:00100000:1.0:1789263734.717580:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 51 00000100:00100000:1.0:1789263734.717587:0:8394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8842e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+5:2398:x1876178888578688:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1789263734.717617:0:8394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8842e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+5:2398:x1876178888578688:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 31us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263734.717622:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 51 00000100:00080000:0.0:1789263734.717689:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789263734.717974:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888578304 00000100:00100000:2.0:1789263734.717978:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888578304 00000100:00100000:2.0:1789263734.718060:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 322 00000100:00100000:2.0:1789263734.718068:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd988442c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+13:2398:x1876178888578304:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789263734.718119:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd988442c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+13:2398:x1876178888578304:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 52us (1943us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263734.718125:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 322 00000100:00100000:0.0:1789263734.721067:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263734.721121:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263734.721246:0:8511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888579072 00000100:00100000:1.0:1789263734.721259:0:8511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888579072 00000100:00080000:0.0:1789263734.721313:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789263734.721328:0:8511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888579200 00000100:00100000:1.0:1789263734.721333:0:8511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888579200 00000100:00080000:0.0:1789263734.721364:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789263734.721372:0:8511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 24 00000100:00100000:2.0:1789263734.721384:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 25 00000100:00100000:1.0:1789263734.721386:0:8511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8842e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:857a0866-badb-47ac-9591-fbf273e4680e+5:2396:x1876178888579072:12345-192.168.203.20@tcp:9:kworker.0 00000100:00100000:0.0:1789263734.721394:0:8392:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1789263734.721401:0:8394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8842e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:857a0866-badb-47ac-9591-fbf273e4680e+5:2396:x1876178888579200:12345-192.168.203.20@tcp:9:kworker.0 00000100:00100000:0.0:1789263734.721406:0:8392:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000020:00000080:1.0:1789263734.721418:0:8511:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1d9f9 00000100:00080000:1.0:1789263734.721427:0:8511:0:(import.c:65:import_set_state_nolock()) ffff9dd883faf800 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1789263734.721428:0:8394:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1da00 00000100:00080000:2.0:1789263734.721439:0:8394:0:(import.c:65:import_set_state_nolock()) ffff9dd882a28000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789263734.721488:0:8394:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000001:00000004:1.0:1789263734.721489:0:8511:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:3.0:1789263734.721521:0:13146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263734.721618:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789263734.721673:0:8394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8842e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:857a0866-badb-47ac-9591-fbf273e4680e+2:2396:x1876178888579200:12345-192.168.203.20@tcp:9:kworker.0 Request processed in 276us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263734.721673:0:8511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8842e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:857a0866-badb-47ac-9591-fbf273e4680e+2:2396:x1876178888579072:12345-192.168.203.20@tcp:9:kworker.0 Request processed in 288us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263734.721689:0:8511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 24 00000100:00100000:2.0:1789263734.721703:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 25 00000100:00100000:1.0:1789263734.829246:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898070272:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789263734.829323:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263734.829384:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898070784:0@lo:400:kworker.0 00000100:00100000:1.0:1789263734.829421:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263734.829445:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9907a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898071296:0@lo:400:kworker.0 00000100:00100000:0.0:1789263734.829469:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898070272 00000100:00100000:1.0:1789263734.829477:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263734.829478:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898070272 00000100:00100000:3.0:1789263734.829481:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876178898070656:0@lo:400:kworker.0 00000100:00100000:1.0:1789263734.829505:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1876178898071808:0@lo:400:kworker.0 00000100:00100000:3.0:1789263734.829520:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263734.829533:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789263734.829543:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263734.829544:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8838f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1876178898070272:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789263734.829545:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9907a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1876178898071168:0@lo:400:kworker.0 00002000:00000024:0.0:1789263734.829578:0:8397:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789263734.829584:0:8499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898070784 00000100:00100000:3.0:1789263734.829589:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263734.829589:0:8499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898070784 00000100:00100000:3.0:1789263734.829617:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1876178898071680:0@lo:400:kworker.0 00000100:00100000:1.0:1789263734.829628:0:8499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789263734.829634:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8838f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1876178898070272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263734.829636:0:8499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8838f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1876178898070784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263734.829642:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789263734.829646:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263734.829677:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898070656 00000100:00100000:1.0:1789263734.829684:0:8499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8838f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1876178898070784:12345-0@lo:400:kworker.0 Request processed in 47us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263734.829693:0:8499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789263734.829703:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898070656 00000100:00100000:2.0:1789263734.829704:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898070400:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789263734.829724:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789263734.829725:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898071808 00000100:00100000:1.0:1789263734.829729:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898071808 00000100:00100000:3.0:1789263734.829740:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898071168 00000100:00100000:3.0:1789263734.829744:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898071168 00000100:00100000:2.0:1789263734.829748:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263734.829761:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898071680 00000100:00100000:1.0:1789263734.829766:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789263734.829767:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898071680 00000100:00100000:3.0:1789263734.829773:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789263734.829778:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876178898070656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263734.829786:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8838f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1876178898071808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789263734.829791:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1876178898070912:0@lo:400:kworker.0 00000100:00100000:0.0:1789263734.829796:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789263734.829807:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876178898071168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789263734.829826:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876178898070656:12345-0@lo:400:kworker.0 Request processed in 53us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263734.829833:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789263734.829845:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8838f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1876178898071808:12345-0@lo:400:kworker.0 Request processed in 59us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263734.829845:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263734.829853:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789263734.829861:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789263734.829865:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1876178898071680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263734.829865:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876178898071168:12345-0@lo:400:kworker.0 Request processed in 59us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263734.829873:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789263734.829882:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898070912 00000100:00100000:3.0:1789263734.829886:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898070912 00000100:00100000:1.0:1789263734.829904:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1876178898071680:12345-0@lo:400:kworker.0 Request processed in 42us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263734.829904:0:8395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898071296 00000100:00100000:0.0:1789263734.829909:0:8395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898071296 00000100:00100000:1.0:1789263734.829912:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789263734.829921:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789263734.829948:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1876178898070912:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789263734.829949:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789263734.829955:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789263734.829957:0:8395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00080000:1.0:1789263734.829958:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789263734.829968:0:8395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8838f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1876178898071296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789263734.829970:0:8512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898070400 00000100:00100000:1.0:1789263734.829973:0:8512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898070400 00000100:00100000:3.0:1789263734.829981:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1876178898070912:12345-0@lo:400:kworker.0 Request processed in 35us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263734.829986:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789263734.830006:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1876178898070912:0@lo:400:kworker.0 00000100:00100000:1.0:1789263734.830014:0:8512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789263734.830014:0:8395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8838f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1876178898071296:12345-0@lo:400:kworker.0 Request processed in 47us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263734.830020:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9907a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898071424:0@lo:400:kworker.0 00000100:00100000:1.0:1789263734.830025:0:8512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88397dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1876178898070400:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789263734.830027:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:66a76ccf-c64c-4b18-8369-a2861ec3956c:3621:1876178898070528:0@lo:400:kworker.0 00000100:00100000:0.0:1789263734.830030:0:8395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00002000:00000024:1.0:1789263734.830043:0:8512:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789263734.830101:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263734.830102:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263734.830105:0:8512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88397dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1876178898070400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (358us total) trans 0 rc 0/0 00010000:00080000:0.0:1789263734.830105:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd9bfa84e00 x1876178898071808/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263750 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789263734.830113:0:8512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789263734.830117:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1876178898071808:0@lo:400:kworker.0 00000100:00100000:2.0:1789263734.830132:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898071936:0@lo:400:kworker.0 00000100:00080000:1.0:1789263734.830134:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789263734.830142:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898070784:0@lo:400:kworker.0 00000100:00100000:3.0:1789263734.830149:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3621:1876178898071040:0@lo:400:kworker.0 00000100:00100000:1.0:1789263734.830158:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876178898070656:0@lo:400:kworker.0 00010000:00080000:0.0:1789263734.830161:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd9907a4000 x1876178898071296/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789263750 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789263734.830170:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789263734.830176:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd9907a7800 x1876178898071168/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263750 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263734.830177:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9907a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898071296:0@lo:400:kworker.0 00010000:00080000:0.0:1789263734.830193:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd9bfa72a00 x1876178898070272/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789263750 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789263734.830197:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9907a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1876178898071168:0@lo:400:kworker.0 00000100:00100000:3.0:1789263734.830204:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263734.830208:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898070272:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789263734.830215:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1876178898071680:0@lo:400:kworker.0 00010000:00080000:2.0:1789263734.830232:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd88397ea00 x1876178898070400/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789263750 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263734.830234:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898071552:0@lo:400:kworker.0 00000100:00100000:1.0:1789263734.830244:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898071040 00000100:00100000:0.0:1789263734.830244:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898070528 00000100:00100000:1.0:1789263734.830250:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898071040 00000100:00100000:0.0:1789263734.830250:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898070528 00000100:00100000:2.0:1789263734.830259:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898070400:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789263734.830267:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263734.830283:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1789263734.830288:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789263734.830293:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a07450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+24:3621:x1876178898070528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789263734.830294:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1876178898071040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789263734.830298:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898071424 00000100:00100000:2.0:1789263734.830304:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898071424 00000100:00100000:1.0:1789263734.830343:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1876178898071040:12345-0@lo:400:kworker.0 Request processed in 47us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263734.830343:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a07450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+24:3621:x1876178898070528:12345-0@lo:400:kworker.0 Request processed in 52us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263734.830350:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789263734.830354:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789263734.830354:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1789263734.830363:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882610700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1876178898071424:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789263734.830374:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789263734.830393:0:13766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898071936 00000100:00100000:0.0:1789263734.830396:0:13766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898071936 00000100:00100000:1.0:1789263734.830406:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:66a76ccf-c64c-4b18-8369-a2861ec3956c:3621:1876178898070528:0@lo:400:kworker.0 00000100:00100000:1.0:1789263734.830420:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3621:1876178898071040:0@lo:400:kworker.0 00000100:00100000:0.0:1789263734.830420:0:13766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898071552 00000100:00100000:0.0:1789263734.830423:0:13766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898071552 00000100:00100000:2.0:1789263734.830437:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882610700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1876178898071424:12345-0@lo:400:kworker.0 Request processed in 76us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263734.830444:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00080000:1.0:1789263734.830445:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789263734.830450:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789263734.830457:0:8394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882612300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1876178898071936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789263734.830465:0:8511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789263734.830476:0:8511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3621:x1876178898071552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789263734.830494:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9907a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898071424:0@lo:400:kworker.0 00000100:00100000:3.0:1789263734.830498:0:8394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882612300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1876178898071936:12345-0@lo:400:kworker.0 Request processed in 42us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263734.830507:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1789263734.830513:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd9bfa85c00 x1876178898071936/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789263750 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789263734.830533:0:8511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3621:x1876178898071552:12345-0@lo:400:kworker.0 Request processed in 58us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263734.830539:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898071936:0@lo:400:kworker.0 00000100:00100000:1.0:1789263734.830546:0:8511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:0.0:1789263734.830563:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd9bfa84700 x1876178898071552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789263750 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263734.830573:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898071552:0@lo:400:kworker.0 00000004:00080000:3.0:1789263734.831708:0:6466:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:3.0:1789263734.831745:0:6466:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:3.0:1789263734.831754:0:6466:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:1.0:1789263734.831827:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804a00/0xce1582440fb1dad9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xf79bc41e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263734.831840:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804a00/0xce1582440fb1dad9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xf79bc41e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263734.831849:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804a00/0xce1582440fb1dad9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xf79bc41e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263734.831863:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bb804a00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263734.831868:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804a00/0xce1582440fb1dad9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xf79bc41e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263734.831876:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804a00/0xce1582440fb1dad9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xf79bc41e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263734.831887:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8842eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898072064:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1789263734.831895:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xf79bc41e (ffff9dd9bb584000) 00010000:00010000:1.0:1789263734.831900:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263734.831904:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804a00/0xce1582440fb1dad9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xf79bc41e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263734.831911:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804a00/0xce1582440fb1dad9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xf79bc41e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263734.831926:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789263734.831939:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59400/0xce1582440fb1daee lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263734.831948:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59400/0xce1582440fb1daee lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263734.831954:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59400/0xce1582440fb1daee lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263734.831960:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883f59400 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263734.831963:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59400/0xce1582440fb1daee lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263734.831969:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59400/0xce1582440fb1daee lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263734.832002:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9dd883dd9c00) 00010000:00010000:1.0:1789263734.832006:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263734.832010:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59400/0xce1582440fb1daee lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263734.832016:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59400/0xce1582440fb1daee lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263734.832023:0:8392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898072064 00010000:00010000:1.0:1789263734.832035:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804e00/0xce1582440fb1db57 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xf79bc41e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263734.832037:0:8392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898072064 00010000:00010000:1.0:1789263734.832045:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804e00/0xce1582440fb1db57 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xf79bc41e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263734.832053:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804e00/0xce1582440fb1db57 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xf79bc41e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263734.832058:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bb804e00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263734.832062:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804e00/0xce1582440fb1db57 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xf79bc41e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263734.832068:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804e00/0xce1582440fb1db57 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xf79bc41e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263734.832108:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xf79bc41e (ffff9dd9bb584000) 00010000:00010000:1.0:1789263734.832112:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263734.832118:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804e00/0xce1582440fb1db57 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xf79bc41e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263734.832126:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804e00/0xce1582440fb1db57 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xf79bc41e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263734.832132:0:8392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789263734.832143:0:8392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882612680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1876178898072064:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1789263734.832159:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805400/0xce1582440fb1db73 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263734.832167:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805400/0xce1582440fb1db73 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1789263734.832167:0:8392:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00010000:00010000:1.0:1789263734.832178:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805400/0xce1582440fb1db73 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263734.832184:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bb805400 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263734.832187:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805400/0xce1582440fb1db73 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263734.832193:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805400/0xce1582440fb1db73 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789263734.832198:0:8392:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x6aa5ff71, atime: 0x6aa5ff71, ctime: 0x6aa5ff71, blocks: 0x0 00010000:00010000:1.0:1789263734.832202:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9dd9bb584600) 00010000:00010000:1.0:1789263734.832207:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789263734.832208:0:8392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d41be70/0xce1582440fb1dbd5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263734.832211:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805400/0xce1582440fb1db73 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263734.832231:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805400/0xce1582440fb1db73 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263734.832234:0:8392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=177s v=(0 0) 00010000:00010000:0.0:1789263734.832243:0:8392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789263734.832250:0:8392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d41be70/0xce1582440fb1dbd5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263734.832265:0:8392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d41be70/0xce1582440fb1dbd5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263734.832275:0:8392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d41be70/0xce1582440fb1dbd5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263734.832282:0:8392:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d41be70/0xce1582440fb1dbd5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263734.832307:0:8392:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789263734.832338:0:6475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789263734.832346:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d41be70/0xce1582440fb1dbd5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263734.832357:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883e73000 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:3.0:1789263734.832362:0:6475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d41be70/0xce1582440fb1dbd5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263734.832373:0:6475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d41be70/0xce1582440fb1dbd5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263734.832390:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d41be70/0xce1582440fb1dbd5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263734.832398:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d41be70/0xce1582440fb1dbd5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263734.832422:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263734.832425:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263734.832427:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789263734.832458:0:8392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882612680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3621:x1876178898072064:12345-0@lo:6:osp-syn-0-0.0 Request processed in 317us (532us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1789263734.832465:0:8392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000004:00080000:2.0:1789263734.832507:0:3621:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9dd8842eb100/2, rc 0, transno 4294967301 00000100:00100000:2.0:1789263734.832518:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8842eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898072064:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1789263735.213208:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789263735.341262:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789263735.341301:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8842e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876178898072192:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789263735.341369:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263735.341458:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789263735.341469:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882611500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898072320:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789263735.341500:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263735.341536:0:8396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898072320 00000100:00100000:2.0:1789263735.341543:0:8396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898072320 00000100:00100000:2.0:1789263735.341585:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789263735.341593:0:8396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882611f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3618:x1876178898072320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789263735.341620:0:8396:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789263735.341657:0:8396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882611f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3618:x1876178898072320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263735.341664:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789263735.341678:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898072192 00000100:00100000:3.0:1789263735.341685:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898072192 00000100:00100000:2.0:1789263735.341706:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882611500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898072320:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789263735.341733:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789263735.341743:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8842ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1876178898072192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789263735.341768:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789263735.341829:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8842ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1876178898072192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263735.341838:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789263735.341865:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8842eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898072448:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789263735.341881:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8842e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876178898072192:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789263735.341954:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263735.342013:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898072448 00000100:00100000:0.0:1789263735.342021:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898072448 00000100:00100000:0.0:1789263735.342146:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789263735.342155:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8838f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898072448:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789263735.342167:0:8397:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789263735.342213:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8838f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898072448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 59us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263735.342221:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789263735.342274:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8842eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898072448:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789263736.238027:0:13689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789263736.877632:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789263736.877659:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8842ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898072576:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789263736.877743:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263736.877792:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898072576 00000100:00100000:2.0:1789263736.877802:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898072576 00000100:00100000:2.0:1789263736.877850:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789263736.877861:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8838f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898072576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789263736.877894:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789263736.877965:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8838f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898072576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263736.877972:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789263736.878020:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8842ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898072576:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789263737.261253:0:13146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263738.285276:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263739.309251:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789263739.835044:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263739.835127:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263739.835161:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263739.835198:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263739.835218:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263739.835245:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263739.835271:0:13766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888579712 00000100:00100000:0.0:1789263739.835280:0:13766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888579712 00000100:00100000:0.0:1789263739.835343:0:13766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 55 00000100:00100000:0.0:1789263739.835354:0:13766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8842e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+5:2399:x1876178888579712:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789263739.835417:0:13766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8842e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+5:2399:x1876178888579712:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 66us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263739.835425:0:13766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 55 00000100:00100000:2.0:1789263739.835514:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888579328 00000100:00100000:2.0:1789263739.835520:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888579328 00000100:00100000:2.0:1789263739.835554:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 324 00000100:00100000:2.0:1789263739.835562:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a07050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+13:2399:x1876178888579328:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789263739.835591:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a07050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+13:2399:x1876178888579328:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 30us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263739.835598:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 324 00000100:00100000:3.0:1789263739.835766:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888579584 00000100:00100000:3.0:1789263739.835771:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888579584 00000100:00100000:3.0:1789263739.835850:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888579840 00000100:00100000:3.0:1789263739.835853:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888579840 00000100:00100000:3.0:1789263739.835866:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888579456 00000100:00100000:3.0:1789263739.835868:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888579456 00000100:00100000:3.0:1789263739.835878:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888579968 00000100:00100000:3.0:1789263739.835880:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888579968 00000100:00100000:3.0:1789263739.835893:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 101 00000100:00100000:3.0:1789263739.835914:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8842ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+5:2399:x1876178888579584:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1789263739.835953:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8842ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+5:2399:x1876178888579584:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 41us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263739.835960:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 101 00000100:00100000:3.0:1789263739.835975:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 102 00000100:00100000:3.0:1789263739.835994:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8842ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:857a0866-badb-47ac-9591-fbf273e4680e+5:2399:x1876178888579840:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1789263739.836021:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8842ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:857a0866-badb-47ac-9591-fbf273e4680e+5:2399:x1876178888579840:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 28us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263739.836027:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 102 00000100:00100000:3.0:1789263739.836039:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 103 00000100:00100000:3.0:1789263739.836045:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8842eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+5:2399:x1876178888579456:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1789263739.836068:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8842eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+5:2399:x1876178888579456:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 23us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263739.836074:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 103 00000100:00100000:2.0:1789263739.836457:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 104 00000100:00100000:2.0:1789263739.836466:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8842e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:857a0866-badb-47ac-9591-fbf273e4680e+5:2399:x1876178888579968:12345-192.168.203.20@tcp:400:kworker.0 00000100:00080000:1.0:1789263739.836490:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789263739.836494:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8842e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:857a0866-badb-47ac-9591-fbf273e4680e+5:2399:x1876178888579968:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 30us (1248us total) trans 0 rc 0/0 00000100:00080000:1.0:1789263739.836494:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789263739.836497:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789263739.836500:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 104 00000100:00100000:2.0:1789263739.949235:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898072832:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789263739.949293:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8842eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:66a76ccf-c64c-4b18-8369-a2861ec3956c:3619:1876178898072960:0@lo:400:kworker.0 00000100:00100000:2.0:1789263739.949315:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263739.949344:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263739.949404:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9907a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1876178898073472:0@lo:400:kworker.0 00000100:00100000:0.0:1789263739.949427:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898072960 00000100:00100000:0.0:1789263739.949433:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898072960 00000100:00100000:3.0:1789263739.949438:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263739.949464:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876178898073984:0@lo:400:kworker.0 00000100:00100000:0.0:1789263739.949491:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1789263739.949497:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263739.949505:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a05850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+24:3619:x1876178898072960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789263739.949521:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882611500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898072704:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789263739.949529:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883e31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876178898074496:0@lo:400:kworker.0 00000100:00100000:0.0:1789263739.949563:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a05850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+24:3619:x1876178898072960:12345-0@lo:400:kworker.0 Request processed in 60us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263739.949569:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263739.949575:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263739.949579:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1789263739.949605:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9907a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876178898073344:0@lo:400:kworker.0 00000100:00100000:3.0:1789263739.949619:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8842eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:66a76ccf-c64c-4b18-8369-a2861ec3956c:3619:1876178898072960:0@lo:400:kworker.0 00000100:00100000:0.0:1789263739.949631:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898072832 00000100:00100000:2.0:1789263739.949632:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263739.949637:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898072832 00000100:00100000:2.0:1789263739.949655:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898073856:0@lo:400:kworker.0 00000100:00100000:1.0:1789263739.949656:0:8512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898072704 00000100:00100000:3.0:1789263739.949664:0:8395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898073984 00000100:00100000:1.0:1789263739.949664:0:8512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898072704 00000100:00100000:3.0:1789263739.949670:0:8395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898073984 00000100:00100000:0.0:1789263739.949684:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789263739.949690:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263739.949698:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882613480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876178898072832:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789263739.949705:0:8512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789263739.949713:0:8395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898074496 00000100:00100000:1.0:1789263739.949716:0:8512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882612a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876178898072704:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789263739.949718:0:8395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898074496 00000100:00100000:2.0:1789263739.949726:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883e32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898074368:0@lo:400:kworker.0 00002000:00000024:0.0:1789263739.949726:0:8397:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00002000:00000024:1.0:1789263739.949734:0:8512:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789263739.949750:0:8395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789263739.949760:0:8395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3619:x1876178898073984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263739.949779:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882613480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876178898072832:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263739.949784:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263739.949791:0:8512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882612a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3618:x1876178898072704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263739.949793:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789263739.949804:0:8512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:2.0:1789263739.949818:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd9bfa86d80 x1876178898072832/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789263755 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263739.949827:0:8395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3619:x1876178898073984:12345-0@lo:400:kworker.0 Request processed in 68us (329us total) trans 0 rc 0/0 00000100:00080000:1.0:1789263739.949829:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789263739.949832:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898072832:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1789263739.949836:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789263739.949842:0:8395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789263739.949847:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898073472 00010000:00080000:2.0:1789263739.949850:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd882611500 x1876178898072704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789263755 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263739.949852:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898073472 00000100:00100000:3.0:1789263739.949858:0:8395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898074368 00000100:00100000:3.0:1789263739.949862:0:8395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898074368 00000100:00100000:1.0:1789263739.949865:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8842e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1876178898073088:0@lo:400:kworker.0 00000100:00100000:2.0:1789263739.949866:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882611500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898072704:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789263739.949879:0:8395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789263739.949887:0:8395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1876178898074496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263739.949908:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898073344 00000100:00100000:0.0:1789263739.949913:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898073344 00000100:00100000:2.0:1789263739.949921:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8842ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898073216:0@lo:400:kworker.0 00000100:00100000:1.0:1789263739.949922:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263739.949942:0:8395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1876178898074496:12345-0@lo:400:kworker.0 Request processed in 56us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263739.949950:0:8395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789263739.949952:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898073088 00000100:00100000:1.0:1789263739.949957:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9907a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1876178898073600:0@lo:400:kworker.0 00000100:00100000:0.0:1789263739.949958:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898073088 00000100:00100000:2.0:1789263739.949966:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263739.949970:0:8395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789263739.949981:0:8395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88397ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1876178898074368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263739.949988:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789263739.950002:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898073728:0@lo:400:kworker.0 00000100:00100000:1.0:1789263739.950003:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263739.950004:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1876178898073472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789263739.950027:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1876178898074112:0@lo:400:kworker.0 00000100:00100000:3.0:1789263739.950042:0:8395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88397ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1876178898074368:12345-0@lo:400:kworker.0 Request processed in 61us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263739.950043:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263739.950053:0:8395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789263739.950059:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1876178898073472:12345-0@lo:400:kworker.0 Request processed in 61us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263739.950069:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789263739.950070:0:8395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898073728 00000100:00100000:2.0:1789263739.950071:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883e32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3621:1876178898074240:0@lo:400:kworker.0 00000100:00100000:3.0:1789263739.950099:0:8395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898073728 00000100:00100000:0.0:1789263739.950115:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898073600 00000100:00100000:0.0:1789263739.950120:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898073600 00000100:00100000:2.0:1789263739.950126:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263739.950138:0:8395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789263739.950144:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898074240 00000100:00100000:0.0:1789263739.950148:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898074240 00000100:00100000:3.0:1789263739.950149:0:8395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1876178898073728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789263739.950168:0:8499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898073856 00000100:00100000:2.0:1789263739.950174:0:8499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898073856 00000100:00100000:0.0:1789263739.950188:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789263739.950203:0:8395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1876178898073728:12345-0@lo:400:kworker.0 Request processed in 53us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263739.950203:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882611880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876178898073344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263739.950216:0:8395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789263739.950219:0:8499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898073216 00000100:00100000:2.0:1789263739.950224:0:8499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898073216 00000100:00100000:3.0:1789263739.950246:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789263739.950252:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882611880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876178898073344:12345-0@lo:400:kworker.0 Request processed in 55us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263739.950259:0:8499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789263739.950260:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882610a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1876178898073856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263739.950267:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789263739.950269:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263739.950275:0:8499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882611500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1876178898073216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263739.950298:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898074112 00000100:00100000:0.0:1789263739.950303:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898074112 00000100:00100000:3.0:1789263739.950314:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882610a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1876178898073856:12345-0@lo:400:kworker.0 Request processed in 60us (624us total) trans 0 rc 0/0 00000100:00080000:1.0:1789263739.950316:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789263739.950322:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789263739.950327:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789263739.950333:0:8499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882611500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1876178898073216:12345-0@lo:400:kworker.0 Request processed in 59us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263739.950333:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789263739.950337:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789263739.950345:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789263739.950347:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8838f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1876178898073088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789263739.950351:0:8499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789263739.950359:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8838f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1876178898073600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263739.950377:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789263739.950388:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1876178898074240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263739.950403:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8838f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1876178898073088:12345-0@lo:400:kworker.0 Request processed in 57us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263739.950410:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8842ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898073216:0@lo:400:kworker.0 00000100:00100000:0.0:1789263739.950413:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789263739.950419:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8838f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1876178898073600:12345-0@lo:400:kworker.0 Request processed in 63us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263739.950428:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789263739.950435:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898073728:0@lo:400:kworker.0 00000100:00100000:0.0:1789263739.950440:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789263739.950452:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1876178898074240:12345-0@lo:400:kworker.0 Request processed in 63us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263739.950453:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8838f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1876178898074112:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1789263739.950465:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd883e32d80 x1876178898074240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263755 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263739.950469:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789263739.950473:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8842e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1876178898073088:0@lo:400:kworker.0 00000100:00100000:2.0:1789263739.950493:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883e32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3621:1876178898074240:0@lo:400:kworker.0 00010000:00080000:1.0:1789263739.950495:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd9907a4000 x1876178898073600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263755 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263739.950504:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8838f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1876178898074112:12345-0@lo:400:kworker.0 Request processed in 52us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263739.950513:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9907a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1876178898073600:0@lo:400:kworker.0 00000100:00100000:0.0:1789263739.950518:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00010000:00080000:3.0:1789263739.950521:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd883e31180 x1876178898074496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789263755 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789263739.950533:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1876178898074112:0@lo:400:kworker.0 00000100:00100000:3.0:1789263739.950535:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883e31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876178898074496:0@lo:400:kworker.0 00000100:00100000:2.0:1789263739.950549:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9907a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876178898073344:0@lo:400:kworker.0 00000100:00100000:3.0:1789263739.950558:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9907a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1876178898073472:0@lo:400:kworker.0 00000100:00100000:2.0:1789263739.950570:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898073856:0@lo:400:kworker.0 00000100:00100000:3.0:1789263739.950577:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876178898073984:0@lo:400:kworker.0 00010000:00080000:2.0:1789263739.950589:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd883e32680 x1876178898074368/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789263755 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789263739.950598:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883e32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898074368:0@lo:400:kworker.0 00010000:00010000:2.0:1789263740.333176:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789263740.461262:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883e31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898074752:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789263740.461307:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898074624:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789263740.461329:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263740.461352:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263740.461396:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883e33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898074880:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789263740.461413:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898074624 00000100:00100000:1.0:1789263740.461421:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898074624 00000100:00100000:2.0:1789263740.461427:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263740.461634:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898074752 00000100:00100000:3.0:1789263740.461638:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898074752 00000100:00100000:3.0:1789263740.461667:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789263740.461675:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1876178898074752:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789263740.461713:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789263740.461786:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1876178898074752:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263740.461792:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789263740.461911:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883e31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898074752:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789263740.461982:0:8396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898074880 00000100:00100000:2.0:1789263740.461986:0:8396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898074880 00000100:00100000:1.0:1789263740.461995:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789263740.462012:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1876178898074624:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789263740.462012:0:8512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789263740.462029:0:8512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876178898074880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789263740.462051:0:8397:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00002000:00000024:0.0:1789263740.462051:0:8512:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789263740.462122:0:8512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876178898074880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263740.462191:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1876178898074624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 186us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263740.462292:0:8512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789263740.462299:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789263740.462353:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883e33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898074880:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789263740.462405:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898074624:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1789263740.463150:0:9479:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 857a0866-badb-47ac-9591-fbf273e4680e 00000020:00000080:3.0:1789263740.463155:0:9479:0:(genops.c:885:class_export_put()) final put ffff9dd9bfa33800/857a0866-badb-47ac-9591-fbf273e4680e 00000001:00080000:1.0:1789263740.463161:0:8388:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:1.0:1789263740.463178:0:8388:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 857a0866-badb-47ac-9591-fbf273e4680e 00000020:00000080:1.0:1789263740.463182:0:8388:0:(genops.c:885:class_export_put()) final put ffff9dd883fae000/857a0866-badb-47ac-9591-fbf273e4680e 00000020:00000080:0.0:1789263740.463208:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd9bfa33800/857a0866-badb-47ac-9591-fbf273e4680e for lustre-OST0001 00000020:00000080:0.0:1789263740.463256:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd883fae000/857a0866-badb-47ac-9591-fbf273e4680e for lustre-OST0000 00000020:00000080:0.0:1789263740.463285:0:479:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd882a28000 for lustre-OST0001 00000020:00000080:0.0:1789263740.463290:0:479:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd883faf800 for lustre-OST0000 00010000:00010000:1.0:1789263741.357416:0:13689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789263741.998072:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883e33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898075008:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789263741.998176:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263741.998233:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898075008 00000100:00100000:0.0:1789263741.998241:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898075008 00000100:00100000:0.0:1789263741.998314:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789263741.998325:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1876178898075008:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789263741.998357:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789263741.998407:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1876178898075008:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263741.998415:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789263741.998452:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883e33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898075008:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789263742.381305:0:13146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263743.405249:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789263743.664946:0:13759:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1789263743.665108:0:13757:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789263744.429284:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789263744.956529:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263744.956569:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263744.956593:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888580224 00000100:00100000:0.0:1789263744.956599:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263744.956602:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888580224 00000100:00100000:0.0:1789263744.956629:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263744.956656:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263744.956669:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888580096 00000100:00100000:1.0:1789263744.956680:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888580352 00000100:00100000:1.0:1789263744.956685:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888580352 00000100:00100000:2.0:1789263744.956695:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888580096 00000100:00100000:0.0:1789263744.956700:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263744.956719:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888580608 00000100:00100000:1.0:1789263744.956725:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888580608 00000100:00100000:3.0:1789263744.956743:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888580736 00000100:00100000:3.0:1789263744.956751:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888580736 00000100:00100000:0.0:1789263744.956767:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 111 00000100:00100000:0.0:1789263744.956789:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+5:2397:x1876178888580224:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789263744.956791:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 326 00000100:00100000:1.0:1789263744.956802:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 112 00000100:00100000:2.0:1789263744.956820:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a07850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+13:2398:x1876178888580096:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1789263744.956822:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 113 00000100:00100000:1.0:1789263744.956822:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+5:2398:x1876178888580352:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1789263744.956842:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:857a0866-badb-47ac-9591-fbf273e4680e+5:2398:x1876178888580608:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789263744.956902:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+5:2397:x1876178888580224:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 117us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263744.956904:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:857a0866-badb-47ac-9591-fbf273e4680e+5:2398:x1876178888580608:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 60us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263744.956904:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+5:2398:x1876178888580352:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 83us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263744.956922:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 111 00000100:00100000:3.0:1789263744.956949:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 113 00000100:00100000:2.0:1789263744.956949:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a07850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+13:2398:x1876178888580096:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 124us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263744.956965:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 112 00000100:00100000:2.0:1789263744.956973:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 326 00000100:00100000:0.0:1789263744.956981:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 114 00000100:00100000:0.0:1789263744.956994:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:857a0866-badb-47ac-9591-fbf273e4680e+5:2397:x1876178888580736:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1789263744.957012:0:8395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888580480 00000100:00100000:3.0:1789263744.957018:0:8395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888580480 00000100:00080000:1.0:1789263744.957021:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789263744.957028:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789263744.957034:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789263744.957050:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:857a0866-badb-47ac-9591-fbf273e4680e+5:2397:x1876178888580736:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 60us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263744.957058:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 114 00000100:00100000:3.0:1789263744.957072:0:8395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 60 00000100:00100000:3.0:1789263744.957126:0:8395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+5:2397:x1876178888580480:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1789263744.957158:0:8395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+5:2397:x1876178888580480:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 35us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263744.957166:0:8395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 60 00000100:00100000:2.0:1789263745.069314:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898075136:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789263745.069318:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883e30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898075264:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789263745.069418:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263745.069460:0:8396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898075264 00000100:00100000:2.0:1789263745.069471:0:8396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898075264 00000100:00100000:0.0:1789263745.069534:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1876178898075776:0@lo:400:kworker.0 00000100:00100000:2.0:1789263745.069558:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789263745.069570:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263745.069578:0:8396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1876178898075264:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789263745.069597:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898076288:0@lo:400:kworker.0 00000100:00100000:3.0:1789263745.069599:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263745.069625:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1789263745.069627:0:8396:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789263745.069682:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898075136 00000100:00100000:0.0:1789263745.069686:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989aff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898076800:0@lo:400:kworker.0 00000100:00100000:1.0:1789263745.069689:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898075136 00000100:00100000:2.0:1789263745.069698:0:8396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1876178898075264:12345-0@lo:13:osp-pre-1-1.0 Request processed in 127us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263745.069705:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9907a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898075648:0@lo:400:kworker.0 00000100:00100000:2.0:1789263745.069718:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789263745.069729:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263745.069741:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789263745.069755:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1876178898075136:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789263745.069765:0:8499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898076288 00000100:00100000:2.0:1789263745.069770:0:8499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898076288 00002000:00000024:1.0:1789263745.069772:0:8397:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00080000:0.0:1789263745.069777:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd883e30e00 x1876178898075264/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789263761 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263745.069794:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263745.069808:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883e30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898075264:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789263745.069823:0:8499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898075648 00000100:00100000:2.0:1789263745.069829:0:8499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898075648 00000100:00100000:1.0:1789263745.069868:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1876178898075136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263745.069878:0:8499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789263745.069879:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789263745.069892:0:8499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1876178898076288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263745.069902:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9907a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:66a76ccf-c64c-4b18-8369-a2861ec3956c:3618:1876178898075392:0@lo:400:kworker.0 00000100:00100000:1.0:1789263745.069921:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898075776 00000100:00100000:1.0:1789263745.069927:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898075776 00000100:00100000:3.0:1789263745.069941:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898076160:0@lo:400:kworker.0 00000100:00100000:0.0:1789263745.069961:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263745.069968:0:8499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1876178898076288:12345-0@lo:400:kworker.0 Request processed in 79us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263745.069977:0:8499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789263745.069994:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789263745.070004:0:8499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789263745.070008:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263745.070016:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1876178898075776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263745.070017:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1876178898075904:0@lo:400:kworker.0 00000100:00100000:2.0:1789263745.070020:0:8499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898075648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263745.070060:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989afc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1876178898076672:0@lo:400:kworker.0 00000100:00100000:1.0:1789263745.070121:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1876178898075776:12345-0@lo:400:kworker.0 Request processed in 113us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263745.070125:0:8499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898075648:12345-0@lo:400:kworker.0 Request processed in 108us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263745.070125:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263745.070139:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789263745.070140:0:8499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789263745.070168:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898075904 00000100:00100000:3.0:1789263745.070169:0:8511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898076800 00000100:00100000:1.0:1789263745.070174:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898075904 00000100:00100000:0.0:1789263745.070178:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898076416:0@lo:400:kworker.0 00000100:00100000:3.0:1789263745.070180:0:8511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898076800 00000100:00100000:2.0:1789263745.070186:0:8394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898076160 00000100:00100000:2.0:1789263745.070193:0:8394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898076160 00000100:00100000:1.0:1789263745.070218:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789263745.070223:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263745.070235:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876178898075904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789263745.070246:0:8394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898076416 00000100:00100000:2.0:1789263745.070251:0:8394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898076416 00000100:00100000:0.0:1789263745.070266:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789263745.070277:0:8511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789263745.070283:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9907a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876178898075520:0@lo:400:kworker.0 00000100:00100000:3.0:1789263745.070299:0:8511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898076160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789263745.070304:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789263745.070304:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876178898075904:12345-0@lo:400:kworker.0 Request processed in 72us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263745.070318:0:8394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1876178898076800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789263745.070319:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789263745.070325:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263745.070344:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898075520 00000100:00100000:1.0:1789263745.070351:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898075520 00000100:00100000:0.0:1789263745.070362:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1876178898076032:0@lo:400:kworker.0 00000100:00100000:2.0:1789263745.070379:0:8394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1876178898076800:12345-0@lo:400:kworker.0 Request processed in 64us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263745.070383:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789263745.070390:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789263745.070395:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876178898075520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263745.070420:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263745.070427:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789263745.070438:0:8394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1876178898076416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263745.070451:0:8511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898076160:12345-0@lo:400:kworker.0 Request processed in 158us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263745.070460:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1876178898076544:0@lo:400:kworker.0 00000100:00100000:3.0:1789263745.070470:0:8511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789263745.070474:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876178898075520:12345-0@lo:400:kworker.0 Request processed in 75us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263745.070483:0:8394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1876178898076416:12345-0@lo:400:kworker.0 Request processed in 46us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263745.070490:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789263745.070496:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789263745.070513:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263745.070516:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898076032 00000100:00100000:1.0:1789263745.070521:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898076032 00000100:00100000:2.0:1789263745.070535:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898075392 00000100:00100000:2.0:1789263745.070542:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898075392 00000100:00100000:3.0:1789263745.070551:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263745.070558:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1876178898075904:0@lo:400:kworker.0 00000100:00100000:1.0:1789263745.070562:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898076544 00000100:00100000:1.0:1789263745.070569:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898076544 00000100:00100000:0.0:1789263745.070586:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:0.0:1789263745.070593:0:3618:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9dd8842eb100, transno 4294967301 00000100:00100000:2.0:1789263745.070597:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1789263745.070608:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898076672 00000100:00100000:2.0:1789263745.070610:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a04050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+24:3618:x1876178898075392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263745.070613:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898076416:0@lo:400:kworker.0 00000100:00100000:1.0:1789263745.070614:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898076672 00010000:00080000:3.0:1789263745.070620:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd9bfa72a00 x1876178898075136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789263761 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789263745.070653:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789263745.070654:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898075136:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789263745.070664:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a04050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+24:3618:x1876178898075392:12345-0@lo:400:kworker.0 Request processed in 55us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263745.070665:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876178898076032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789263745.070682:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1789263745.070687:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9907a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876178898075520:0@lo:400:kworker.0 00000100:00100000:3.0:1789263745.070716:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9907a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898075648:0@lo:400:kworker.0 00000100:00100000:0.0:1789263745.070718:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9907a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:66a76ccf-c64c-4b18-8369-a2861ec3956c:3618:1876178898075392:0@lo:400:kworker.0 00000100:00080000:2.0:1789263745.070732:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789263745.070734:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876178898076032:12345-0@lo:400:kworker.0 Request processed in 66us (313us total) trans 0 rc 0/0 00000100:00080000:2.0:1789263745.070744:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789263745.070749:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:2.0:1789263745.070752:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789263745.070760:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789263745.070773:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898076160:0@lo:400:kworker.0 00010000:00080000:0.0:1789263745.070784:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd9bfa8e680 x1876178898076032/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263761 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789263745.070790:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789263745.070804:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1876178898076032:0@lo:400:kworker.0 00000100:00100000:1.0:1789263745.070808:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1876178898076544:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1789263745.070813:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd989aff800 x1876178898076800/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789263761 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789263745.070827:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989aff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898076800:0@lo:400:kworker.0 00000100:00100000:2.0:1789263745.070855:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898076288:0@lo:400:kworker.0 00000100:00100000:1.0:1789263745.070873:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1876178898076544:12345-0@lo:400:kworker.0 Request processed in 57us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263745.070883:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789263745.070890:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1876178898075776:0@lo:400:kworker.0 00000100:00100000:3.0:1789263745.070900:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789263745.070918:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1876178898076672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789263745.070991:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1876178898076544:0@lo:400:kworker.0 00000100:00100000:3.0:1789263745.071003:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1876178898076672:12345-0@lo:400:kworker.0 Request processed in 87us (454us total) trans 0 rc 0/0 00010000:00080000:2.0:1789263745.071008:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd989afc700 x1876178898076672/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263761 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263745.071025:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789263745.071029:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989afc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1876178898076672:0@lo:400:kworker.0 00010000:00010000:2.0:1789263745.453283:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789263745.581574:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876178898077056:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789263745.581574:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883e32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898076928:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789263745.581656:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263745.581657:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263745.581714:0:8499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898076928 00000100:00100000:0.0:1789263745.581723:0:8499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898076928 00000100:00100000:2.0:1789263745.581751:0:8396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898077056 00000100:00100000:2.0:1789263745.581756:0:8396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898077056 00000100:00100000:0.0:1789263745.581774:0:8499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789263745.581781:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789263745.581786:0:8499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1876178898076928:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789263745.581790:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789263745.581794:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989afce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898077184:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789263745.581799:0:8396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1876178898077056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789263745.581818:0:8396:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000004:00000024:0.0:1789263745.581818:0:8499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789263745.581824:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263745.581884:0:8396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1876178898077056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263745.581885:0:8499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1876178898076928:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263745.581893:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789263745.581893:0:8499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789263745.581902:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898077184 00000100:00100000:3.0:1789263745.581908:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876178898077056:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789263745.581910:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898077184 00000100:00100000:1.0:1789263745.581949:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789263745.581959:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1876178898077184:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789263745.581966:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883e32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898076928:0@lo:41:osp-pre-1-0.0 00002000:00000024:1.0:1789263745.581972:0:8397:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789263745.582016:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1876178898077184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 59us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263745.582022:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789263745.582052:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989afce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898077184:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789263746.477287:0:13689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789263747.117360:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883e31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898077312:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789263747.117447:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263747.117685:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898077312 00000100:00100000:2.0:1789263747.117693:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898077312 00000100:00100000:2.0:1789263747.117749:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789263747.117760:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1876178898077312:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789263747.117792:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789263747.117898:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1876178898077312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 141us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263747.117915:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789263747.117987:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883e31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898077312:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789263747.501296:0:13146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263748.525347:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263749.549269:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789263750.074374:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263750.074432:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263750.074442:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888580864 00000100:00100000:2.0:1789263750.074453:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888580864 00000100:00100000:1.0:1789263750.074470:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263750.074509:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 328 00000100:00100000:2.0:1789263750.074522:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a04850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+13:2398:x1876178888580864:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789263750.074525:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888581120 00000100:00100000:0.0:1789263750.074532:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888581120 00000100:00100000:0.0:1789263750.074583:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888580992 00000100:00100000:0.0:1789263750.074587:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888580992 00000100:00100000:2.0:1789263750.074593:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a04850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+13:2398:x1876178888580864:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 73us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263750.074602:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 328 00000100:00100000:0.0:1789263750.074625:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 121 00000100:00100000:0.0:1789263750.074637:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989afdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+5:2398:x1876178888581120:12345-192.168.203.20@tcp:400:kworker.0 00000100:00080000:1.0:1789263750.074658:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789263750.074666:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789263750.074672:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989afdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+5:2398:x1876178888581120:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 38us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263750.075484:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 122 00000100:00100000:3.0:1789263750.075573:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989aff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+5:2398:x1876178888580992:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1789263750.075612:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989aff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+5:2398:x1876178888580992:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 44us (1141us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263750.075656:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 121 00000100:00100000:3.0:1789263750.075937:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 122 00000100:00100000:1.0:1789263750.079655:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263750.079714:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263750.079717:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888581376 00000100:00100000:3.0:1789263750.079726:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888581376 00000100:00100000:1.0:1789263750.079749:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263750.079790:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888581504 00000100:00100000:3.0:1789263750.079794:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888581504 00000100:00080000:2.0:1789263750.079802:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789263750.079808:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789263750.079808:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 123 00000100:00100000:1.0:1789263750.079824:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989afca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:857a0866-badb-47ac-9591-fbf273e4680e+5:2397:x1876178888581376:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1789263750.079847:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 124 00000100:00100000:0.0:1789263750.079852:0:8511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888581248 00000100:00100000:0.0:1789263750.079858:0:8511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888581248 00000100:00100000:3.0:1789263750.079859:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989afea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:857a0866-badb-47ac-9591-fbf273e4680e+5:2397:x1876178888581504:12345-192.168.203.20@tcp:400:kworker.0 00000100:00080000:2.0:1789263750.079903:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789263750.079908:0:8511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 27 00000100:00100000:1.0:1789263750.079914:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989afca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:857a0866-badb-47ac-9591-fbf273e4680e+5:2397:x1876178888581376:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 91us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263750.079915:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989afea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:857a0866-badb-47ac-9591-fbf273e4680e+5:2397:x1876178888581504:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 55us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263750.079923:0:8511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989affb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+5:2396:x1876178888581248:12345-192.168.203.20@tcp:9:kworker.0 00000100:00100000:1.0:1789263750.079928:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 123 00000100:00100000:3.0:1789263750.079935:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 124 00000020:00000080:0.0:1789263750.079949:0:8511:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1dafc 00000100:00080000:0.0:1789263750.079960:0:8511:0:(import.c:65:import_set_state_nolock()) ffff9dd883f8c000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1789263750.079989:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1789263750.080005:0:8511:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:0.0:1789263750.080191:0:8511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989affb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+2:2396:x1876178888581248:12345-192.168.203.20@tcp:9:kworker.0 Request processed in 272us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263750.080199:0:8511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 27 00000100:00100000:3.0:1789263750.189272:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898077440:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789263750.189276:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989afed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1876178898077824:0@lo:400:kworker.0 00000100:00100000:0.0:1789263750.189340:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989afe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898077952:0@lo:400:kworker.0 00000100:00100000:2.0:1789263750.189355:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263750.189356:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263750.189398:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263750.189400:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898077824 00000100:00100000:1.0:1789263750.189408:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898077824 00000100:00100000:3.0:1789263750.189431:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989afe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:66a76ccf-c64c-4b18-8369-a2861ec3956c:3618:1876178898077696:0@lo:400:kworker.0 00000100:00100000:0.0:1789263750.189432:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989afd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898078464:0@lo:400:kworker.0 00000100:00100000:2.0:1789263750.189434:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989aff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3619:1876178898078336:0@lo:400:kworker.0 00000100:00100000:1.0:1789263750.189460:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1789263750.189468:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1876178898077824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263750.189482:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263750.189488:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263750.189493:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263750.189529:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883e32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898077568:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789263750.189531:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989afd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3619:1876178898078848:0@lo:400:kworker.0 00000100:00100000:0.0:1789263750.189535:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989afce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1876178898078976:0@lo:400:kworker.0 00000100:00100000:1.0:1789263750.189550:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1876178898077824:12345-0@lo:400:kworker.0 Request processed in 81us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263750.189558:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789263750.189579:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263750.189580:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263750.189581:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898078336 00000100:00100000:0.0:1789263750.189585:0:8499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898077952 00000100:00100000:1.0:1789263750.189587:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898078336 00000100:00100000:0.0:1789263750.189597:0:8499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898077952 00000100:00100000:3.0:1789263750.189615:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989afdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1876178898078208:0@lo:400:kworker.0 00000100:00100000:1.0:1789263750.189630:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898078848 00000100:00100000:2.0:1789263750.189635:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989afed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1876178898077824:0@lo:400:kworker.0 00000100:00100000:1.0:1789263750.189635:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898078848 00000100:00100000:0.0:1789263750.189642:0:8499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789263750.189648:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263750.189657:0:8499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898077952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789263750.189661:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898078208 00000100:00100000:1.0:1789263750.189665:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898078208 00000100:00100000:2.0:1789263750.189676:0:8394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898078464 00000100:00100000:3.0:1789263750.189678:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989afc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898078720:0@lo:400:kworker.0 00000100:00100000:2.0:1789263750.189683:0:8394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898078464 00000100:00100000:1.0:1789263750.189691:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789263750.189701:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1876178898078336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263750.189708:0:8499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898077952:12345-0@lo:400:kworker.0 Request processed in 53us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263750.189719:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263750.189720:0:8499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789263750.189727:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789263750.189739:0:8394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898078464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263750.189749:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989aff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898079232:0@lo:400:kworker.0 00000100:00100000:1.0:1789263750.189761:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1876178898078336:12345-0@lo:400:kworker.0 Request processed in 60us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263750.189761:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263750.189771:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789263750.189790:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898078976 00000100:00100000:3.0:1789263750.189791:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263750.189794:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898078976 00000100:00100000:0.0:1789263750.189794:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989afe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898077952:0@lo:400:kworker.0 00000100:00100000:2.0:1789263750.189797:0:8394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898078464:12345-0@lo:400:kworker.0 Request processed in 60us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263750.189809:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789263750.189821:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789263750.189821:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989afd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898078464:0@lo:400:kworker.0 00000100:00100000:1.0:1789263750.189845:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c08a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1876178898078848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789263750.189848:0:8394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898078720 00000100:00100000:2.0:1789263750.189854:0:8394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898078720 00000100:00100000:3.0:1789263750.189857:0:8396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898077440 00000100:00100000:0.0:1789263750.189859:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789263750.189863:0:8396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898077440 00000100:00100000:0.0:1789263750.189868:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989afd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1876178898078080:0@lo:400:kworker.0 00000100:00100000:1.0:1789263750.189885:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c08a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1876178898078848:12345-0@lo:400:kworker.0 Request processed in 42us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263750.189887:0:8394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898079232 00000100:00100000:2.0:1789263750.189893:0:8394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898079232 00000100:00100000:1.0:1789263750.189896:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789263750.189903:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263750.189905:0:8396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898077568 00000100:00100000:3.0:1789263750.189910:0:8396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898077568 00000100:00100000:1.0:1789263750.189920:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898078080 00000100:00100000:2.0:1789263750.189925:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789263750.189925:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989afc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898078592:0@lo:400:kworker.0 00000100:00100000:1.0:1789263750.189926:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898078080 00000100:00100000:2.0:1789263750.189937:0:8394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1876178898078720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263750.189940:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789263750.189954:0:8396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3618:x1876178898077440:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789263750.189958:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789263750.189965:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263750.189972:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876178898078208:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1789263750.189981:0:8396:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789263750.189993:0:8394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1876178898078720:12345-0@lo:400:kworker.0 Request processed in 59us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263750.189993:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989afc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898079104:0@lo:400:kworker.0 00000100:00100000:2.0:1789263750.190005:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789263750.190023:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876178898078208:12345-0@lo:400:kworker.0 Request processed in 53us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263750.190026:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789263750.190035:0:8396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3618:x1876178898077440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263750.190040:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263750.190046:0:8394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8842eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3618:x1876178898079232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263750.190056:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789263750.190056:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789263750.190098:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00080000:0.0:1789263750.190102:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789263750.190108:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00080000:0.0:1789263750.190108:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789263750.190109:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9907a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1876178898078976:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789263750.190113:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789263750.190118:0:8394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8842eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1876178898079232:12345-0@lo:400:kworker.0 Request processed in 81us (326us total) trans 0 rc 0/0 00000100:00080000:0.0:1789263750.190119:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789263750.190124:0:8396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876178898077568:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789263750.190130:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00002000:00000024:3.0:1789263750.190141:0:8396:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789263750.190143:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789263750.190147:0:8394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898079104 00000100:00100000:2.0:1789263750.190152:0:8394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898079104 00000100:00100000:0.0:1789263750.190155:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9907a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1876178898078080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789263750.190162:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9907a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1876178898078976:12345-0@lo:400:kworker.0 Request processed in 57us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263750.190171:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789263750.190176:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789263750.190186:0:8394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883f5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3620:x1876178898079104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263750.190190:0:8396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3618:x1876178898077568:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263750.190199:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9907a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1876178898078080:12345-0@lo:400:kworker.0 Request processed in 46us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263750.190200:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789263750.190211:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00010000:00080000:1.0:1789263750.190218:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd989aff480 x1876178898078336/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263766 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789263750.190229:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989aff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3619:1876178898078336:0@lo:400:kworker.0 00000100:00100000:3.0:1789263750.190231:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898077696 00000100:00100000:2.0:1789263750.190233:0:8394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883f5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898079104:12345-0@lo:400:kworker.0 Request processed in 46us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263750.190238:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898077696 00000100:00100000:2.0:1789263750.190243:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789263750.190253:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989afd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1876178898078080:0@lo:400:kworker.0 00000100:00100000:1.0:1789263750.190262:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989afd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3619:1876178898078848:0@lo:400:kworker.0 00000100:00100000:3.0:1789263750.190276:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1789263750.190277:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898078592 00000100:00100000:2.0:1789263750.190283:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898078592 00010000:00080000:0.0:1789263750.190283:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd989afc700 x1876178898079104/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789263766 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263750.190291:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a06850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+24:3618:x1876178898077696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263750.190301:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989afc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898079104:0@lo:400:kworker.0 00000100:00100000:2.0:1789263750.190316:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00010000:00080000:0.0:1789263750.190319:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd989afce00 x1876178898078976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263766 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789263750.190329:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9907a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1876178898078592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263750.190331:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989afce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1876178898078976:0@lo:400:kworker.0 00000100:00100000:3.0:1789263750.190339:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a06850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+24:3618:x1876178898077696:12345-0@lo:400:kworker.0 Request processed in 52us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263750.190348:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1789263750.190367:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989afdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1876178898078208:0@lo:400:kworker.0 00000100:00100000:2.0:1789263750.190379:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9907a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1876178898078592:12345-0@lo:400:kworker.0 Request processed in 52us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263750.190385:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989afc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898078592:0@lo:400:kworker.0 00000100:00100000:1.0:1789263750.190388:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989afc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898078720:0@lo:400:kworker.0 00000100:00100000:2.0:1789263750.190402:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:1.0:1789263750.190412:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd989aff800 x1876178898079232/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789263766 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789263750.190423:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989aff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898079232:0@lo:400:kworker.0 00010000:00080000:1.0:1789263750.190434:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd9bfaab100 x1876178898077440/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789263766 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789263750.190446:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898077440:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789263750.190454:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989afe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:66a76ccf-c64c-4b18-8369-a2861ec3956c:3618:1876178898077696:0@lo:400:kworker.0 00010000:00080000:1.0:1789263750.190463:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd883e32d80 x1876178898077568/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789263766 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789263750.190486:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883e32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898077568:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1789263750.573217:0:13689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789263750.701292:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789263750.701321:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898079360:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789263750.701354:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898079488:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789263750.701405:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263750.701412:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263750.701428:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989afe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898079616:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789263750.701508:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898079360 00000100:00100000:1.0:1789263750.701516:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263750.701518:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898079360 00000100:00100000:0.0:1789263750.701540:0:8512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898079488 00000100:00100000:0.0:1789263750.701547:0:8512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898079488 00000100:00100000:3.0:1789263750.701561:0:8396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898079616 00000100:00100000:3.0:1789263750.701569:0:8396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898079616 00000100:00100000:2.0:1789263750.701594:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789263750.701613:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c08ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1876178898079360:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789263750.701619:0:8512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789263750.701636:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789263750.701637:0:8512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898079488:12345-0@lo:13:osp-pre-0-1.0 00000004:00000024:2.0:1789263750.701646:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789263750.701659:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989aff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1876178898079616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789263750.701668:0:8512:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00002000:00000024:1.0:1789263750.701686:0:8397:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789263750.701705:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c08ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1876178898079360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263750.701712:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789263750.701747:0:8512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898079488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 116us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263750.701768:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989aff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1876178898079616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263750.701768:0:8512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789263750.701777:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898079360:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789263750.701791:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789263750.701870:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898079488:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789263750.701872:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989afe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898079616:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789263751.598798:0:13146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789263752.237610:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789263752.237632:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989afe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898079744:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789263752.237765:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263752.237989:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898079744 00000100:00100000:2.0:1789263752.237997:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898079744 00000100:00100000:2.0:1789263752.238058:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789263752.238069:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989afc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1876178898079744:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789263752.238131:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789263752.238185:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989afc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1876178898079744:12345-0@lo:41:osp-pre-0-1.0 Request processed in 118us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263752.238194:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789263752.238222:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989afe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898079744:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789263752.621201:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789263753.146852:0:14016:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 21:42:32 (1789263752) 00010000:00010000:3.0:1789263753.645287:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789263753.708561:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263753.708680:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888581632 00000100:00100000:3.0:1789263753.708699:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888581632 00000100:00080000:0.0:1789263753.708761:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789263753.708778:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 38 00000100:00100000:3.0:1789263753.708791:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989afe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+5:11039:x1876178888581632:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789263753.708827:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263753.708849:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1dbdc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11ca7 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263753.708911:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1dbe3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263753.708925:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1dbe3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263753.708939:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1dbe3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789263753.708981:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789263753.708984:0:6488:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789263753.709019:0:6488:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1dbe3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263753.709042:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1dbdc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ca7 expref: 7 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263753.709147:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1dbe3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ca7 expref: 6 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263753.709168:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd98940e200) 00010000:00010000:3.0:1789263753.709170:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789263753.709173:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981530c00, rc 0) 00000100:00100000:3.0:1789263753.709222:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989afe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+6:11039:x1876178888581632:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 436us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263753.709228:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 38 00000100:00100000:2.0:1789263753.712695:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263753.712755:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888581760 00000100:00100000:1.0:1789263753.712763:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888581760 00000100:00100000:1.0:1789263753.712825:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 39 00000100:00100000:1.0:1789263753.712834:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9838fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+6:11040:x1876178888581760:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789263753.712849:0:8417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263753.712870:0:8417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59a00/0xce1582440fb1dbea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11cae expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263753.712934:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1dbf1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263753.712947:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1dbf1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263753.712960:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1dbf1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263753.712974:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1dbf8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263753.712981:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1dbf8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263753.712988:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1dbf8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263753.713045:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58e00/0xce1582440fb1dbff lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263753.713053:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58e00/0xce1582440fb1dbff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263753.713060:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58e00/0xce1582440fb1dbff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789263753.713130:0:8417:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789263753.713134:0:8417:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789263753.713153:0:8417:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58e00/0xce1582440fb1dbff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263753.713173:0:8417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1dbf1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263753.713179:0:8417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1dbf1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263753.713187:0:8417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1dbf1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263753.713193:0:8417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883f58a00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263753.713197:0:8417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1dbf1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263753.713204:0:8417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1dbf1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263753.713216:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd98940e200) 00010000:00010000:1.0:1789263753.713219:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263753.713223:0:8417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1dbf1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263753.713228:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1dbf1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263753.713240:0:8417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1dbf8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263753.713244:0:8417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1dbf8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263753.713248:0:8417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1dbf8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263753.713256:0:8417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883f59800 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263753.713258:0:8417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1dbf8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263753.713261:0:8417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1dbf8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263753.713266:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9dd8829edf00) 00010000:00010000:1.0:1789263753.713267:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263753.713269:0:8417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1dbf8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263753.713273:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1dbf8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263753.713293:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59a00/0xce1582440fb1dbea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11cae expref: 8 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263753.713301:0:8417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58e00/0xce1582440fb1dbff lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11cae expref: 7 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263753.713306:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9dd8829ed100) 00010000:00010000:1.0:1789263753.713308:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789263753.713309:0:8417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd883f58e00, rc 0) 00000100:00100000:1.0:1789263753.713356:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9838fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+7:11040:x1876178888581760:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 524us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263753.713361:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 39 00000100:00100000:2.0:1789263753.714488:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263753.714535:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888581888 00000100:00100000:0.0:1789263753.714541:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888581888 00000100:00100000:0.0:1789263753.714584:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 7 00000100:00100000:0.0:1789263753.714593:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9838fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:3ce90ea2-917f-4b54-98b0-25e051f2317f+7:11040:x1876178888581888:12345-192.168.203.20@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1789263753.714649:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9838fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:3ce90ea2-917f-4b54-98b0-25e051f2317f+7:11040:x1876178888581888:12345-192.168.203.20@tcp:900:lhsmtool_posix.0 Request processed in 57us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263753.714657:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 7 00000100:00100000:0.0:1789263753.715954:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263753.715994:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888582144 00000100:00100000:1.0:1789263753.716008:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888582144 00000100:00100000:1.0:1789263753.716046:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 40 00000100:00100000:1.0:1789263753.716054:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+7:11040:x1876178888582144:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789263753.716066:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263753.716103:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1dc06 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11cb5 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263753.716158:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1dc0d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263753.716169:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1dc0d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263753.716179:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1dc0d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263753.716241:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58000/0xce1582440fb1dc14 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263753.716249:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58000/0xce1582440fb1dc14 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263753.716256:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58000/0xce1582440fb1dc14 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263753.716348:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59400/0xce1582440fb1dc1b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263753.716355:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59400/0xce1582440fb1dc1b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263753.716362:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59400/0xce1582440fb1dc1b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789263753.716378:0:6487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1789263753.716459:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1dc0d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263753.716464:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1dc0d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263753.716468:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1dc0d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263753.716472:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883f59000 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263753.716475:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1dc0d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263753.716479:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1dc0d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263753.716487:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9dd8829ed100) 00010000:00010000:1.0:1789263753.716488:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263753.716491:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1dc0d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263753.716495:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1dc0d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263753.716504:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58000/0xce1582440fb1dc14 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263753.716507:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58000/0xce1582440fb1dc14 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263753.716518:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58000/0xce1582440fb1dc14 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263753.716521:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883f58000 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263753.716523:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58000/0xce1582440fb1dc14 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263753.716526:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58000/0xce1582440fb1dc14 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263753.716530:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9dd8829ed300) 00010000:00010000:1.0:1789263753.716532:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263753.716533:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58000/0xce1582440fb1dc14 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263753.716536:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58000/0xce1582440fb1dc14 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263753.716773:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1dc06 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11cb5 expref: 10 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263753.716787:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59400/0xce1582440fb1dc1b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11cb5 expref: 9 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263753.716793:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9dd8829ed700) 00010000:00010000:1.0:1789263753.716795:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263753.716798:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd883f59400, rc 0) 00000100:00100000:1.0:1789263753.716865:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+9:11040:x1876178888582144:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 811us (914us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1789263753.716881:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 40 00000100:00100000:1.0:1789263753.718276:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263753.718394:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888582272 00000100:00100000:3.0:1789263753.718984:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888582272 00000100:00100000:3.0:1789263753.719033:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 41 00000100:00100000:3.0:1789263753.719044:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989afdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+9:11040:x1876178888582272:12345-192.168.203.20@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789263753.719172:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989afdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+9:11040:x1876178888582272:12345-192.168.203.20@tcp:59:lhsmtool_posix.0 Request processed in 130us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263753.719180:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 41 00000100:00100000:1.0:1789263753.720394:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263753.720534:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888582400 00000100:00100000:2.0:1789263753.720542:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888582400 00000100:00100000:2.0:1789263753.720594:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 42 00000100:00080000:0.0:1789263753.720598:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789263753.720605:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989afd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+5:11040:x1876178888582400:12345-192.168.203.20@tcp:59:lhsmtool_posix.0 00000004:00080000:3.0:1789263753.721496:0:8417:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 789us 00000100:00100000:3.0:1789263753.728216:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989afd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+5:11040:x1876178888582400:12345-192.168.203.20@tcp:59:lhsmtool_posix.0 Request processed in 7605us (7818us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263753.728232:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 42 00000040:00080000:2.0:1789263753.905228:0:13759:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1789263753.905334:0:13757:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789263754.487243:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263754.487350:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888582528 00000100:00100000:1.0:1789263754.487360:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888582528 00000100:00100000:1.0:1789263754.487471:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 43 00000100:00100000:1.0:1789263754.487485:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+9:11082:x1876178888582528:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:1.0:1789263754.487506:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263754.487524:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1dc29 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11cbc expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.487595:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59a00/0xce1582440fb1dc30 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.487606:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59a00/0xce1582440fb1dc30 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.487614:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59a00/0xce1582440fb1dc30 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.487626:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1dc37 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.487631:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1dc37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.487635:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1dc37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.487670:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59a00/0xce1582440fb1dc30 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.487681:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59a00/0xce1582440fb1dc30 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.487688:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59a00/0xce1582440fb1dc30 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.487695:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883f59a00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263754.487699:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59a00/0xce1582440fb1dc30 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.487707:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59a00/0xce1582440fb1dc30 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.487718:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd98940e200) 00010000:00010000:1.0:1789263754.487722:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263754.487726:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59a00/0xce1582440fb1dc30 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.487733:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59a00/0xce1582440fb1dc30 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.487745:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1dc37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.487752:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1dc37 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.487757:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1dc37 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.487762:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883f59800 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263754.487772:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1dc37 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.487778:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1dc37 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.487787:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9dd8829edd00) 00010000:00010000:1.0:1789263754.487790:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263754.487792:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1dc37 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.487810:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1dc37 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.487839:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1dc29 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11cbc expref: 10 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.487846:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd98940e200) 00010000:00010000:1.0:1789263754.487847:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263754.487850:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1dc29 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11cbc expref: 10 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.487857:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd883f59000, rc 0) 00000100:00100000:1.0:1789263754.487908:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+9:11082:x1876178888582528:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 427us (672us total) trans 0 rc 301/301 00000100:00100000:1.0:1789263754.487916:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 43 00000100:00100000:2.0:1789263754.490628:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263754.490703:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888582784 00000100:00100000:1.0:1789263754.490714:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888582784 00000100:00100000:1.0:1789263754.490769:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 44 00000100:00100000:1.0:1789263754.490780:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9838fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+9:11082:x1876178888582784:12345-192.168.203.20@tcp:36:lfs.0 00010000:00010000:1.0:1789263754.490849:0:6488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789263754.490884:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1dbe3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ca7 expref: 9 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.490902:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd98940e200) 00010000:00010000:1.0:1789263754.490913:0:6488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789263754.490972:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1dc3e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.490985:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1dc3e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.490994:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1dc3e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.491012:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58400/0xce1582440fb1dc45 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.491020:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58400/0xce1582440fb1dc45 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.491027:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58400/0xce1582440fb1dc45 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.491526:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59e00/0xce1582440fb1dc4c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.491545:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59e00/0xce1582440fb1dc4c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.491553:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59e00/0xce1582440fb1dc4c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789263754.491575:0:6488:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b2aba289 reply state 000000003700b01a transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59e00/0xce1582440fb1dc4c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.491586:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59e00/0xce1582440fb1dc4c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.491593:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dd8829ed600) 00010000:00010000:1.0:1789263754.491595:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789263754.491598:0:6488:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789263754.491602:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1789263754.491662:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1dc3e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.491668:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1dc3e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.491673:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1dc3e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.491676:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883f58a00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263754.491679:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1dc3e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.491684:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1dc3e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.491691:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd8829ed000) 00010000:00010000:1.0:1789263754.491693:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263754.491696:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1dc3e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.491713:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1dc3e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789263754.491733:0:6488:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b2aba289 reply state 000000003700b01a transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58400/0xce1582440fb1dc45 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.491742:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58400/0xce1582440fb1dc45 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.491749:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9dd8829edb00) 00010000:00010000:1.0:1789263754.491752:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789263754.491754:0:6488:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1789263754.491857:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9838fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+10:11082:x1876178888582784:12345-192.168.203.20@tcp:36:lfs.0 Request processed in 1078us (1238us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1789263754.491865:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 44 00000100:00100000:2.0:1789263754.520847:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263754.520890:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888582912 00000100:00100000:3.0:1789263754.520900:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888582912 00000100:00100000:3.0:1789263754.520950:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 45 00000100:00100000:3.0:1789263754.520962:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9838fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+10:11090:x1876178888582912:12345-192.168.203.20@tcp:101:lctl.0 00010000:00010000:3.0:1789263754.520983:0:8417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263754.521004:0:8417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1dc53 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11cc3 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.521096:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530800/0xce1582440fb1dc5a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.521110:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530800/0xce1582440fb1dc5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.521122:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530800/0xce1582440fb1dc5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789263754.521164:0:8417:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789263754.521169:0:8417:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789263754.521205:0:8417:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530800/0xce1582440fb1dc5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.521228:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1dc53 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11cc3 expref: 12 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.521242:0:8417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530800/0xce1582440fb1dc5a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11cc3 expref: 11 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.521250:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd9bb596200) 00010000:00010000:3.0:1789263754.521253:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789263754.521256:0:8417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981530800, rc 0) 00000100:00100000:3.0:1789263754.521318:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9838fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+11:11090:x1876178888582912:12345-192.168.203.20@tcp:101:lctl.0 Request processed in 358us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263754.521326:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 45 00000100:00100000:0.0:1789263754.548606:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263754.548682:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888583040 00000100:00100000:1.0:1789263754.548692:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888583040 00000100:00100000:1.0:1789263754.548745:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 46 00000100:00100000:1.0:1789263754.548757:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+11:11096:x1876178888583040:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:1.0:1789263754.548778:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263754.548808:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1dc61 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11cca expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.548868:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1dc68 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.548882:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1dc68 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.548910:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1dc68 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.548924:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1dc6f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.548931:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1dc6f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.548938:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1dc6f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.549006:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59a00/0xce1582440fb1dc76 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.549013:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59a00/0xce1582440fb1dc76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.549017:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59a00/0xce1582440fb1dc76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789263754.549046:0:6487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1789263754.549050:0:6487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789263754.549112:0:6487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59a00/0xce1582440fb1dc76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.549125:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1dc68 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.549132:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1dc68 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.549146:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1dc68 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.549150:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883f59000 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263754.549153:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1dc68 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.549158:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1dc68 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.549167:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd9bb596200) 00010000:00010000:1.0:1789263754.549169:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263754.549171:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1dc68 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.549175:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1dc68 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.549184:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1dc6f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.549190:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1dc6f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.549196:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1dc6f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.549201:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883f59800 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263754.549203:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1dc6f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.549219:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1dc6f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.549241:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9dd8829edb00) 00010000:00010000:1.0:1789263754.549243:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263754.549247:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1dc6f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.549253:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1dc6f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.549278:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1dc61 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11cca expref: 13 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.549291:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59a00/0xce1582440fb1dc76 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11cca expref: 12 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.549299:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dd8829ed600) 00010000:00010000:1.0:1789263754.549301:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789263754.549304:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd883f59a00, rc 0) 00000100:00100000:1.0:1789263754.549360:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+12:11096:x1876178888583040:12345-192.168.203.20@tcp:101:bash.0 Request processed in 605us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263754.549367:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 46 00000100:00100000:2.0:1789263754.551103:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263754.551182:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888583296 00000100:00100000:1.0:1789263754.551189:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888583296 00000100:00100000:1.0:1789263754.551236:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 47 00000100:00100000:1.0:1789263754.551245:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9838fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+12:11096:x1876178888583296:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:1.0:1789263754.551270:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263754.551284:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58000/0xce1582440fb1dc7d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11cd1 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.551364:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1dc84 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.551374:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1dc84 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.551380:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1dc84 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.551430:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981682200/0xce1582440fb1dc8b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.551438:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981682200/0xce1582440fb1dc8b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.551444:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981682200/0xce1582440fb1dc8b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789263754.551721:0:6488:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:1.0:1789263754.551852:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683600/0xce1582440fb1dc92 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.551861:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683600/0xce1582440fb1dc92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.551869:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683600/0xce1582440fb1dc92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.551966:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1dc84 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.551975:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1dc84 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.551982:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1dc84 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.551988:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883f58800 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263754.551991:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1dc84 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.551999:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1dc84 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.552010:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dd8829ed600) 00010000:00010000:1.0:1789263754.552013:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263754.552016:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1dc84 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.552022:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1dc84 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789263754.552035:0:6488:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d58db716 reply state 00000000c28a88ed transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981682200/0xce1582440fb1dc8b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.552045:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981682200/0xce1582440fb1dc8b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.552051:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9dd8829ed000) 00010000:00010000:1.0:1789263754.552061:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789263754.552064:0:6488:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789263754.552113:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58000/0xce1582440fb1dc7d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11cd1 expref: 15 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.552127:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683600/0xce1582440fb1dc92 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11cd1 expref: 14 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.552134:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd8829edd00) 00010000:00010000:1.0:1789263754.552136:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789263754.552139:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981683600, rc 0) 00000100:00100000:1.0:1789263754.552191:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9838fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+15:11096:x1876178888583296:12345-192.168.203.20@tcp:101:bash.0 Request processed in 947us (1114us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1789263754.552198:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 47 00000100:00100000:2.0:1789263754.554867:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263754.555343:0:8392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888583424 00000100:00100000:1.0:1789263754.555352:0:8392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888583424 00000100:00100000:1.0:1789263754.555393:0:8392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 28 00000100:00100000:1.0:1789263754.555401:0:8392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9838ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2396:x1876178888583424:12345-192.168.203.20@tcp:8:bash.0 00010000:00080000:1.0:1789263754.555434:0:8392:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 3ce90ea2-917f-4b54-98b0-25e051f2317f@192.168.203.20@tcp t0 exp 0000000000000000 cur 196 last 0 00000020:00000080:1.0:1789263754.555466:0:8392:0:(genops.c:1385:class_connect()) connect: client 3ce90ea2-917f-4b54-98b0-25e051f2317f, cookie 0xce1582440fb1dca0 00002000:00100000:1.0:1789263754.555477:0:8392:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 3ce90ea2-917f-4b54-98b0-25e051f2317f/ffff9dd884009800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789263754.555493:0:8392:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789263754.555562:0:8392:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789263754.555586:0:8392:0:(import.c:65:import_set_state_nolock()) ffff9dd88400b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789263754.555654:0:8392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9838ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+6:2396:x1876178888583424:12345-192.168.203.20@tcp:8:bash.0 Request processed in 251us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263754.555661:0:8392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 28 00000100:00100000:0.0:1789263754.556961:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263754.557051:0:13766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888583552 00000100:00100000:2.0:1789263754.557061:0:13766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888583552 00000100:00100000:2.0:1789263754.557265:0:13766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 29 00000100:00100000:2.0:1789263754.557275:0:13766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+6:0:x1876178888583552:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:2.0:1789263754.557288:0:13766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263754.557308:0:13766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9692538/0xce1582440fb1dca7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11cd8 expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789263754.557331:0:13766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789263754.557345:0:13766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=196s v=(0 0) 00010000:00010000:2.0:1789263754.557348:0:13766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789263754.557355:0:13766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9692538/0xce1582440fb1dca7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11cd8 expref: 7 pid: 13766 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263754.557372:0:13766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f9692538/0xce1582440fb1dca7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11cd8 expref: 7 pid: 13766 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263754.557386:0:13766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bb805c00, rc 0) 00000100:00100000:2.0:1789263754.557435:0:13766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+7:0:x1876178888583552:12345-192.168.203.20@tcp:101:bash.0 Request processed in 161us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263754.557441:0:13766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 29 00000100:00080000:0.0:1789263754.557495:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789263754.559047:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263754.559101:0:8511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888583680 00000100:00100000:1.0:1789263754.559109:0:8511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888583680 00000100:00100000:1.0:1789263754.559155:0:8511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 30 00000100:00100000:1.0:1789263754.559163:0:8511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9838fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+7:11096:x1876178888583680:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:1.0:1789263754.559175:0:8511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263754.559189:0:8511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000878f705/0xce1582440fb1dcae lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11cdf expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.559212:0:8511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f9692538/0xce1582440fb1dca7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11cd8 expref: 8 pid: 13766 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.559220:0:8511:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789263754.559224:0:8511:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789263754.559228:0:8511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000878f705/0xce1582440fb1dcae lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11cdf expref: 8 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.559260:0:8511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f9692538/0xce1582440fb1dca7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11cd8 expref: 8 pid: 13766 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.559274:0:8511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f9692538/0xce1582440fb1dca7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11cd8 expref: 8 pid: 13766 timeout: 296 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263754.559286:0:8511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989aff480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8511:1876178898079872:192.168.203.20@tcp:104: 00000100:00100000:1.0:1789263754.559366:0:8511:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd986230540 going to sleep for 11 seconds 00000100:00100000:0.0:1789263754.560580:0:8511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989aff480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8511:1876178898079872:192.168.203.20@tcp:104: 00010000:00010000:0.0:1789263754.560603:0:8511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000878f705/0xce1582440fb1dcae lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11cdf expref: 8 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263754.560618:0:8511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981683800, rc 0) 00000100:00100000:0.0:1789263754.560658:0:8511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9838fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+8:11096:x1876178888583680:12345-192.168.203.20@tcp:101:bash.0 Request processed in 1496us (1616us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263754.560666:0:8511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 30 00000100:00100000:0.0:1789263754.561043:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263754.561099:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888583808 00000100:00100000:3.0:1789263754.561105:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888583808 00010000:00010000:3.0:1789263754.561133:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f9692538/0xce1582440fb1dca7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11cd8 expref: 8 pid: 13766 timeout: 296 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263754.561161:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 47 00000100:00100000:3.0:1789263754.561169:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989aef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+8:2397:x1876178888583808:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789263754.561180:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789263754.561195:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f9692538/0xce1582440fb1dca7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11cd8 expref: 8 pid: 13766 timeout: 296 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.561208:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f9692538/0xce1582440fb1dca7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11cd8 expref: 8 pid: 13766 timeout: 296 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.561229:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9692538/0xce1582440fb1dca7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11cd8 expref: 8 pid: 13766 timeout: 296 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.561244:0:6474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789263754.561248:0:6474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789263754.561256:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000878f705/0xce1582440fb1dcae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11cdf expref: 7 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.561266:0:6474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000878f705/0xce1582440fb1dcae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11cdf expref: 7 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.561294:0:6474:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000878f705/0xce1582440fb1dcae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11cdf expref: 7 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263754.561318:0:6474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8842e9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6474:1876178898080000:192.168.203.20@tcp:105: 00000100:00100000:3.0:1789263754.561362:0:6474:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd98615ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1789263754.562391:0:6474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8842e9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6474:1876178898080000:192.168.203.20@tcp:105: 00010000:00010000:3.0:1789263754.562406:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789263754.562439:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989aef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+7:2397:x1876178888583808:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 1270us (1396us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263754.562447:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 47 00000100:00100000:1.0:1789263754.563049:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263754.563212:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888584064 00000100:00100000:2.0:1789263754.563218:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888584064 00000100:00100000:2.0:1789263754.563264:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 6 00000100:00100000:1.0:1789263754.563270:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:2.0:1789263754.563274:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989aff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+15:11096:x1876178888584064:12345-192.168.203.20@tcp:35:bash.0 00000100:00100000:1.0:1789263754.563294:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:2.0:1789263754.563578:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989aff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+16:11096:x1876178888584064:12345-192.168.203.20@tcp:35:bash.0 Request processed in 305us (529us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1789263754.563584:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 6 00000100:00100000:0.0:1789263754.598173:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263754.598259:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888584320 00000100:00100000:3.0:1789263754.598276:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888584320 00000100:00100000:3.0:1789263754.598335:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 48 00000100:00100000:3.0:1789263754.598346:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989aece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+16:11106:x1876178888584320:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:3.0:1789263754.598369:0:8417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263754.598386:0:8417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1dcb5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11ce6 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789263754.598482:0:8417:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1789263754.598579:0:8417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1dcb5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ce6 expref: 18 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.598594:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd9bb596200) 00010000:00010000:3.0:1789263754.598597:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789263754.598602:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1dcb5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ce6 expref: 18 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.598618:0:8417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981530200, rc 0) 00000100:00100000:3.0:1789263754.598686:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989aece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+17:11106:x1876178888584320:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 343us (522us total) trans 4294967315 rc 301/301 00000100:00100000:3.0:1789263754.598693:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 48 00000100:00100000:0.0:1789263754.600343:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263754.600419:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888584576 00000100:00100000:2.0:1789263754.600427:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888584576 00000100:00100000:2.0:1789263754.600473:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 7 00000100:00100000:2.0:1789263754.600482:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989aedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+17:11106:x1876178888584576:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:2.0:1789263754.600651:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989aedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+18:11106:x1876178888584576:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 169us (309us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1789263754.600659:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 7 00000100:00100000:1.0:1789263754.635184:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263754.635270:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888584704 00000100:00100000:3.0:1789263754.635279:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888584704 00000100:00100000:3.0:1789263754.635337:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 49 00000100:00100000:3.0:1789263754.635346:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989afc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+18:11112:x1876178888584704:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:3.0:1789263754.635366:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263754.635382:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1dcc3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11ced expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.635443:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1dcca lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.635457:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1dcca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.635467:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1dcca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789263754.635508:0:6487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1789263754.635512:0:6487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789263754.635528:0:6487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1dcca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.635554:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1dcc3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ced expref: 20 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.635570:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1dcca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ced expref: 19 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.635596:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dd8829ed600) 00010000:00010000:3.0:1789263754.635599:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789263754.635603:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981531600, rc 0) 00000100:00100000:3.0:1789263754.635655:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989afc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+19:11112:x1876178888584704:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 310us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263754.635662:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 49 00000100:00100000:0.0:1789263754.637988:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263754.638055:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888584960 00000100:00100000:1.0:1789263754.638064:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888584960 00000100:00100000:1.0:1789263754.638156:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 50 00000100:00100000:1.0:1789263754.638166:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989aef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+19:11112:x1876178888584960:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:1.0:1789263754.638182:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263754.638198:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1dcd1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11cf4 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.638291:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1dcd8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.638303:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683600/0xce1582440fb1dc92 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11cd1 expref: 20 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.638309:0:6488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1dcd8 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.638333:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683600/0xce1582440fb1dc92 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11cd1 expref: 20 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.638342:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683600/0xce1582440fb1dc92 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11cd1 expref: 20 pid: 6488 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263754.638352:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989afce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6488:1876178898080128:192.168.203.20@tcp:104: 00000100:00100000:1.0:1789263754.638423:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd986230780 going to sleep for 11 seconds 00000100:00100000:3.0:1789263754.640246:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989afce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6488:1876178898080128:192.168.203.20@tcp:104: 00010000:00010000:3.0:1789263754.640281:0:6488:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1dcd8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263754.640576:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263754.640631:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888585088 00000100:00100000:2.0:1789263754.640638:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888585088 00010000:00010000:2.0:1789263754.640670:0:6472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683600/0xce1582440fb1dc92 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11cd1 expref: 21 pid: 6488 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263754.640705:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 48 00000100:00100000:2.0:1789263754.640717:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989aeca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+21:2398:x1876178888585088:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789263754.640729:0:6472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789263754.640736:0:6472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683600/0xce1582440fb1dc92 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11cd1 expref: 21 pid: 6488 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263754.640771:0:6472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683600/0xce1582440fb1dc92 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11cd1 expref: 21 pid: 6488 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263754.640791:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683600/0xce1582440fb1dc92 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11cd1 expref: 21 pid: 6488 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263754.640820:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd8829edd00) 00010000:00010000:2.0:1789263754.640825:0:6472:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1dcd8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263754.640833:0:6472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1dcd8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263754.640839:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1dcd8 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263754.640862:0:6472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789263754.640882:0:6488:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1dcd8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.640892:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1dcd8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789263754.640911:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00000100:00100000:2.0:1789263754.640920:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989aeca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+20:2398:x1876178888585088:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 198us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263754.640935:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 48 00010000:00010000:3.0:1789263754.641107:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1dcd1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11cf4 expref: 21 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.641124:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1dcd8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11cf4 expref: 20 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.641131:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd8829edd00) 00010000:00010000:3.0:1789263754.641134:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789263754.641137:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd883f59800, rc 0) 00000100:00100000:3.0:1789263754.641178:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989aef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+20:11112:x1876178888584960:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 3014us (3195us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1789263754.641191:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 50 00000100:00100000:0.0:1789263754.642948:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263754.643043:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888585344 00000100:00100000:3.0:1789263754.643051:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888585344 00000100:00100000:3.0:1789263754.643113:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 51 00000100:00100000:3.0:1789263754.643128:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989aefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+20:11112:x1876178888585344:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:3.0:1789263754.643150:0:8417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263754.643153:0:8417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789263754.643173:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1dcd8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11cf4 expref: 20 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.643189:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd8829edd00) 00010000:00010000:3.0:1789263754.643197:0:8417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789263754.643212:0:8417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1dce6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11cfb expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.643310:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531200/0xce1582440fb1dced lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.643322:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531200/0xce1582440fb1dced lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.643331:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531200/0xce1582440fb1dced lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789263754.643342:0:8417:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789263754.643419:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1dce6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11cfb expref: 22 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.643452:0:8417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531200/0xce1582440fb1dced lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11cfb expref: 21 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.643456:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd9bb596600) 00010000:00010000:3.0:1789263754.643458:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789263754.643460:0:8417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981531200, rc 0) 00000100:00100000:3.0:1789263754.643500:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989aefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+21:11112:x1876178888585344:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 381us (559us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1789263754.643506:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 51 00000100:00100000:0.0:1789263754.645729:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263754.645831:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888585472 00000100:00100000:3.0:1789263754.645841:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888585472 00000100:00100000:3.0:1789263754.645901:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 52 00000100:00100000:3.0:1789263754.645912:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989aeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+21:11112:x1876178888585472:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:3.0:1789263754.645935:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263754.645962:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1dcfb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11d02 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.646018:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1dcfb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d02 expref: 22 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.646032:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1dcfb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d02 expref: 22 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.646049:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd9bb596600) 00010000:00010000:3.0:1789263754.646052:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789263754.646068:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981530200, rc 0) 00000100:00100000:3.0:1789263754.646152:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989aeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+22:11112:x1876178888585472:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 240us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263754.646160:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 52 00000100:00100000:1.0:1789263754.648602:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263754.648680:0:8392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888585600 00000100:00100000:2.0:1789263754.648689:0:8392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888585600 00000100:00100000:2.0:1789263754.648735:0:8392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 31 00000100:00100000:2.0:1789263754.648745:0:8392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989afc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+7:2400:x1876178888585600:12345-192.168.203.20@tcp:1:lfs.0 00010000:00010000:2.0:1789263754.648782:0:8392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f81bf9c/0xce1582440fb1dd02 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263754.648814:0:8392:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000878f705/0xce1582440fb1dcae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11cdf expref: 7 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263754.648833:0:8392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789263754.648838:0:8392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789263754.648843:0:8392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f81bf9c/0xce1582440fb1dd02 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263754.648877:0:8392:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000878f705/0xce1582440fb1dcae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11cdf expref: 7 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263754.648890:0:8392:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000878f705/0xce1582440fb1dcae lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11cdf expref: 7 pid: 8511 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263754.648905:0:8392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9838fc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8392:1876178898080256:192.168.203.20@tcp:104: 00000100:00100000:2.0:1789263754.648993:0:8392:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd88392aa80 going to sleep for 11 seconds 00000100:00100000:2.0:1789263754.650619:0:8392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9838fc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8392:1876178898080256:192.168.203.20@tcp:104: 00010000:00010000:2.0:1789263754.650644:0:8392:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009f81bf9c/0xce1582440fb1dd02 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263754.651229:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263754.651310:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888585728 00000100:00100000:0.0:1789263754.651322:0:8398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888585728 00002000:00100000:0.0:1789263754.651364:0:8398:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff9dd989afd180 x1876178888585728/t0(0) o4->3ce90ea2-917f-4b54-98b0-25e051f2317f@192.168.203.20@tcp:590/0 lens 504/0 e 0 to 0 dl 1789263765 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789263754.651374:0:8398:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dd989afd180 with x1876178888585728 ext(0->12) 00010000:00010000:0.0:1789263754.651381:0:8398:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000878f705/0xce1582440fb1dcae lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11cdf expref: 8 pid: 8511 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263754.651395:0:8398:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000878f705/0xce1582440fb1dcae lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11cdf expref: 8 pid: 8511 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789263754.651403:0:8398:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9dd989afd180 00000100:00100000:0.0:1789263754.651432:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 0 00000100:00100000:0.0:1789263754.651442:0:8398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989afd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+8:2398:x1876178888585728:12345-192.168.203.20@tcp:4:lfs.0 00000001:00100000:0.0:1789263754.652879:0:9479:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3ce90ea2-917f-4b54-98b0-25e051f2317f 00000100:00100000:2.0:1789263754.653327:0:8398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989afd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+9:2398:x1876178888585728:12345-192.168.203.20@tcp:4:lfs.0 Request processed in 1883us (2097us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789263754.653341:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 0 00002000:00100000:2.0:1789263754.653351:0:8398:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff9dd989afd180 x1876178888585728/t4294967300(0) o4->3ce90ea2-917f-4b54-98b0-25e051f2317f@192.168.203.20@tcp:590/0 lens 504/448 e 0 to 0 dl 1789263765 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789263754.653362:0:8398:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dd989afd180 with x1876178888585728 ext(0->12) 00010000:00010000:2.0:1789263754.653377:0:8398:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000878f705/0xce1582440fb1dcae lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11cdf expref: 9 pid: 8511 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263754.653393:0:8398:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000878f705/0xce1582440fb1dcae lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11cdf expref: 9 pid: 8511 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789263754.653401:0:8398:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9dd989afd180 00000100:00100000:0.0:1789263754.654596:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263754.654641:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888585856 00000100:00100000:3.0:1789263754.654649:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888585856 00010000:00010000:3.0:1789263754.654678:0:6473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000878f705/0xce1582440fb1dcae lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11cdf expref: 9 pid: 8511 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263754.654712:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 49 00000100:00100000:3.0:1789263754.654718:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989aee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+9:2399:x1876178888585856:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789263754.654730:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789263754.654745:0:6473:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789263754.654748:0:6473:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1789263754 00002000:00010000:3.0:1789263754.654751:0:6473:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb atime from disk: 0 -> 1789263755 00002000:00010000:3.0:1789263754.654753:0:6473:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1789263754 00002000:00010000:3.0:1789263754.654759:0:6473:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1789263754.654765:0:6473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000878f705/0xce1582440fb1dcae lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11cdf expref: 9 pid: 8511 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.654778:0:6473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000878f705/0xce1582440fb1dcae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11cdf expref: 9 pid: 8511 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.654813:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000878f705/0xce1582440fb1dcae lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11cdf expref: 9 pid: 8511 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.654829:0:6473:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789263754.654840:0:6473:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789263754.654846:0:6473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009f81bf9c/0xce1582440fb1dd02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.654856:0:6473:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f81bf9c/0xce1582440fb1dd02 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.654886:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789263754.654929:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989aee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+8:2399:x1876178888585856:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 208us (335us total) trans 0 rc 0/0 00010000:00010000:2.0:1789263754.654930:0:8392:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009f81bf9c/0xce1582440fb1dd02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263754.654943:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 49 00010000:00010000:2.0:1789263754.654947:0:8392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f81bf9c/0xce1582440fb1dd02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263754.654970:0:8392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f81bf9c/0xce1582440fb1dd02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263754.654978:0:8392:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009f81bf9c/0xce1582440fb1dd02 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263754.654985:0:8392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009f81bf9c/0xce1582440fb1dd02 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263754.654992:0:8392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bb804200 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:2.0:1789263754.654997:0:8392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009f81bf9c/0xce1582440fb1dd02 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263754.655006:0:8392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009f81bf9c/0xce1582440fb1dd02 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263754.655029:0:8392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009f81bf9c/0xce1582440fb1dd02 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263754.655037:0:8392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f81bf9c/0xce1582440fb1dd02 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263754.655128:0:8392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989afc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+7:2400:x1876178888585600:12345-192.168.203.20@tcp:1:lfs.0 Request processed in 6384us (6532us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263754.655137:0:8392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 31 00000100:00100000:0.0:1789263754.656182:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263754.656231:0:14127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888586112 00000100:00100000:1.0:1789263754.656237:0:14127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888586112 00000100:00100000:1.0:1789263754.656279:0:14127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 8 00000100:00100000:1.0:1789263754.656288:0:14127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989aeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+22:11112:x1876178888586112:12345-192.168.203.20@tcp:35:lfs.0 00000004:00010000:1.0:1789263754.656338:0:14127:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531200/0xce1582440fb1dced lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11cfb expref: 22 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789263754.656536:0:14127:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:1.0:1789263754.656580:0:14127:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:1.0:1789263754.656935:0:14127:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:1.0:1789263754.656969:0:14127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1dd09 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.656985:0:14127:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1dcfb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d02 expref: 26 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.656992:0:14127:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1dd09 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.657020:0:14127:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1dcfb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d02 expref: 26 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.657034:0:14127:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1dcfb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d02 expref: 26 pid: 6487 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263754.657047:0:14127:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989afd500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14127:1876178898080384:192.168.203.20@tcp:104: 00000100:00100000:1.0:1789263754.657146:0:14127:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9b79966c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789263754.658289:0:14127:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989afd500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14127:1876178898080384:192.168.203.20@tcp:104: 00010000:00010000:1.0:1789263754.658313:0:14127:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1dd09 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14127 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263754.658583:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263754.658857:0:7428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888586240 00000100:00100000:1.0:1789263754.658865:0:7428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888586240 00010000:00010000:1.0:1789263754.658894:0:7428:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1dcfb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d02 expref: 27 pid: 6487 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263754.658935:0:7428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 50 00000100:00100000:1.0:1789263754.658946:0:7428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989aee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+27:2398:x1876178888586240:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789263754.658959:0:7428:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789263754.658967:0:7428:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1dcfb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d02 expref: 27 pid: 6487 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.658979:0:7428:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1dcfb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d02 expref: 27 pid: 6487 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.658999:0:7428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1dcfb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d02 expref: 27 pid: 6487 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.659014:0:7428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd9bb596600) 00010000:00010000:1.0:1789263754.659019:0:7428:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1dd09 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.659027:0:7428:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1dd09 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.659034:0:7428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1dd09 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.659060:0:7428:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789263754.659105:0:14127:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1dd09 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263754.659115:0:14127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1dd09 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14127 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263754.659159:0:7428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989aee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+26:2398:x1876178888586240:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 214us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263754.659168:0:7428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 50 00000001:00080000:0.0:1789263754.659201:0:14127:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:0.0:1789263754.659332:0:14127:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:0.0:1789263754.659437:0:14127:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989aed180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14127:1876178898080512:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1789263754.659477:0:14127:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263754.659511:0:14127:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9c09d7480 going to sleep for 11 seconds 00000100:00100000:2.0:1789263754.659527:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898080512 00000100:00100000:2.0:1789263754.659533:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898080512 00000100:00100000:2.0:1789263754.659582:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789263754.659590:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989aedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:14127:x1876178898080512:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1789263754.659667:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989aedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:14127:x1876178898080512:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 77us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263754.659674:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:0.0:1789263754.659788:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789263754.660037:0:14127:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989aed180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14127:1876178898080512:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:1.0:1789263754.660203:0:14127:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:1.0:1789263754.660238:0:14127:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989afd500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14127:1876178898080640:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1789263754.660264:0:14127:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263754.660282:0:14127:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9c09d7e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789263754.660300:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898080640 00000100:00100000:2.0:1789263754.660305:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898080640 00000100:00100000:2.0:1789263754.660332:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789263754.660338:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989afe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:14127:x1876178898080640:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1789263754.660443:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989afe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14127:x1876178898080640:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 104us (177us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1789263754.660450:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789263754.660487:0:14127:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989afd500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14127:1876178898080640:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:1.0:1789263754.660519:0:14127:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:1.0:1789263754.660554:0:14127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1dd09 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.660562:0:14127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1dd09 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.660569:0:14127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1dd09 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.660575:0:14127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883f58a00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263754.660579:0:14127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1dd09 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.660587:0:14127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1dd09 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.660597:0:14127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd9bb596600) 00010000:00010000:1.0:1789263754.660606:0:14127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789263754.660610:0:14127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1dd09 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.660616:0:14127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1dd09 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14127 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789263754.660696:0:14127:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789263754.660742:0:14127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1789263754.660750:0:14127:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 196950672373ns, next at 197950671128ns, rc = 0 00000001:00080000:1.0:1789263754.660754:0:14127:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:1.0:1789263754.660768:0:14127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd9bb596600) 00010000:00010000:1.0:1789263754.660770:0:14127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789263754.660774:0:14127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531200/0xce1582440fb1dced lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11cfb expref: 30 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263754.660852:0:14127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989aeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+29:11112:x1876178888586112:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 4566us (4674us total) trans 4294967327 rc 0/0 00000100:00100000:1.0:1789263754.660858:0:14127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 8 00000020:00080000:1.0:1789263754.660860:0:14127:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789263754.661835:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263754.661889:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888586368 00000100:00100000:3.0:1789263754.661894:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888586368 00000100:00100000:3.0:1789263754.661944:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 53 00000100:00100000:3.0:1789263754.661959:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989aef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+29:11112:x1876178888586368:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:3.0:1789263754.661974:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263754.661990:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1dd10 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11d09 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.662030:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1dd10 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d09 expref: 30 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.662041:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1dd10 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d09 expref: 30 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.662057:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd9bb596400) 00010000:00010000:3.0:1789263754.662060:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789263754.662070:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981530600, rc 0) 00000100:00100000:3.0:1789263754.662177:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989aef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+30:11112:x1876178888586368:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 220us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263754.662183:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 53 00000100:00100000:0.0:1789263754.663560:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263754.663605:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888586624 00000100:00100000:3.0:1789263754.663611:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888586624 00000100:00100000:3.0:1789263754.663651:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 9 00000100:00100000:3.0:1789263754.663660:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a38850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+30:11112:x1876178888586624:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:3.0:1789263754.663827:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a38850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+31:11112:x1876178888586624:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 168us (267us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1789263754.663835:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 9 00010000:00010000:1.0:1789263754.669298:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789263754.694557:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263754.694612:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888586880 00000100:00100000:3.0:1789263754.694623:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888586880 00000100:00100000:3.0:1789263754.694683:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 54 00000100:00100000:3.0:1789263754.694693:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9838fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+31:11122:x1876178888586880:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:3.0:1789263754.694718:0:8417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263754.694739:0:8417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1dd17 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11d10 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.694859:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531200/0xce1582440fb1dd1e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.694874:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531200/0xce1582440fb1dd1e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.694885:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531200/0xce1582440fb1dd1e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789263754.694896:0:8417:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1789263754.695007:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1dd17 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d10 expref: 34 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.695025:0:8417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531200/0xce1582440fb1dd1e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d10 expref: 33 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.695034:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dd8829ed600) 00010000:00010000:3.0:1789263754.695037:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789263754.695040:0:8417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981531200, rc 0) 00000100:00100000:3.0:1789263754.695143:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9838fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+33:11122:x1876178888586880:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 451us (593us total) trans 4294967329 rc 0/0 00000100:00100000:3.0:1789263754.695150:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 54 00000100:00100000:0.0:1789263754.696519:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263754.696558:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888587008 00000100:00100000:3.0:1789263754.696565:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888587008 00000100:00100000:3.0:1789263754.696611:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 55 00000100:00100000:3.0:1789263754.696620:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989aed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+33:11122:x1876178888587008:12345-192.168.203.20@tcp:34:lfs.0 00010000:00010000:3.0:1789263754.696680:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1dd2c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.696694:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1dd2c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.696704:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1dd2c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.696715:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1dd33 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.696722:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1dd33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.696742:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1dd33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.696828:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1dd3a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.696836:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1dd3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.696843:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1dd3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789263754.696879:0:6487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1dd3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.696891:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1dd2c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.696897:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1dd2c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.696903:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1dd2c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.696909:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981530200 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263754.696914:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1dd2c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.696921:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1dd2c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.696932:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dd8829ed600) 00010000:00010000:3.0:1789263754.696941:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789263754.696946:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1dd2c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.696952:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1dd2c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.696964:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1dd33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.696970:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1dd33 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.696976:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1dd33 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.696981:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981530c00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263754.696984:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1dd33 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.696990:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1dd33 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.696998:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9dd8829ed000) 00010000:00010000:3.0:1789263754.697001:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789263754.697003:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1dd33 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.697009:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1dd33 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.697018:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1dd3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.697029:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1dd3a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.697035:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1dd3a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.697040:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981530400 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263754.697044:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1dd3a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.697050:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1dd3a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.697057:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd9bb596400) 00010000:00010000:3.0:1789263754.697060:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789263754.697062:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1dd3a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.697067:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1dd3a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263754.697147:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989aed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+33:11122:x1876178888587008:12345-192.168.203.20@tcp:34:lfs.0 Request processed in 529us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263754.697164:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 55 00000100:00100000:0.0:1789263754.713644:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263754.713691:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888587264 00000100:00100000:3.0:1789263754.713700:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888587264 00000100:00100000:3.0:1789263754.713747:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 56 00000100:00100000:3.0:1789263754.713755:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989aec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+33:11125:x1876178888587264:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:3.0:1789263754.713772:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263754.713809:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1dd41 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11d17 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.713880:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1dd48 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.713890:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1dd48 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.713900:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1dd48 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.713907:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1dd4f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.713911:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1dd4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.713915:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1dd4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.714015:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1dd56 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.714021:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1dd56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.714025:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1dd56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789263754.714032:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789263754.714150:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1dd48 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.714167:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1dd48 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.714174:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1dd48 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.714180:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981530c00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263754.714184:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1dd48 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.714192:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1dd48 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.714204:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dd8829ed600) 00010000:00010000:3.0:1789263754.714207:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789263754.714211:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1dd48 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.714216:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1dd48 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.714228:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1dd4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.714233:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1dd4f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.714239:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1dd4f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.714243:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981530200 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263754.714251:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1dd4f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.714257:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1dd4f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.714265:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9dd8829ed000) 00010000:00010000:3.0:1789263754.714267:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789263754.714270:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1dd4f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.714276:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1dd4f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.714310:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1dd41 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d17 expref: 36 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.714323:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1dd56 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d17 expref: 35 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.714336:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd9bb596400) 00010000:00010000:3.0:1789263754.714339:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789263754.714342:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981530a00, rc 0) 00000100:00100000:3.0:1789263754.714395:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989aec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+35:11125:x1876178888587264:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 641us (760us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1789263754.714402:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 56 00000100:00100000:2.0:1789263754.715704:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263754.715749:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888587392 00000100:00100000:3.0:1789263754.715756:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888587392 00000100:00100000:3.0:1789263754.715805:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 57 00000100:00100000:3.0:1789263754.715816:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9838fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+35:11125:x1876178888587392:12345-192.168.203.20@tcp:54:lfs.0 00010000:00010000:3.0:1789263754.715866:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1dd64 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.715878:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1dd64 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.715891:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1dd64 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.715913:0:8417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1dd64 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.715919:0:8417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1dd64 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.715925:0:8417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1dd64 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.715938:0:8417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981530e00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263754.715944:0:8417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1dd64 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.715951:0:8417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1dd64 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.715960:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd9bb596400) 00010000:00010000:3.0:1789263754.715963:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789263754.715966:0:8417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1dd64 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.715970:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1dd64 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263754.716015:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9838fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+35:11125:x1876178888587392:12345-192.168.203.20@tcp:54:lfs.0 Request processed in 203us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263754.716020:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 57 00000100:00100000:0.0:1789263754.717875:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263754.718500:0:14127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888587648 00000100:00100000:1.0:1789263754.718508:0:14127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888587648 00000100:00100000:1.0:1789263754.718561:0:14127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 10 00000100:00100000:1.0:1789263754.718572:0:14127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989aec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+35:11125:x1876178888587648:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:1.0:1789263754.718772:0:14127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989aec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+36:11125:x1876178888587648:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 201us (902us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1789263754.718781:0:14127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 10 00000100:00100000:0.0:1789263754.822323:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263754.822588:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888587904 00000100:00100000:3.0:1789263754.822598:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888587904 00000100:00100000:3.0:1789263754.822652:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 58 00000100:00100000:3.0:1789263754.822664:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989aed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+36:11156:x1876178888587904:12345-192.168.203.20@tcp:101:cat.0 00010000:00010000:3.0:1789263754.822687:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263754.822707:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1dd6b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11d1e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.822811:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1dd72 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.822825:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1dd72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.822836:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1dd72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789263754.822847:0:6487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789263754.822978:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1dd6b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d1e expref: 39 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.823008:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1dd72 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d1e expref: 38 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.823017:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd9bb596400) 00010000:00010000:3.0:1789263754.823031:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789263754.823035:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981530400, rc 0) 00000100:00100000:3.0:1789263754.823134:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989aed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+38:11156:x1876178888587904:12345-192.168.203.20@tcp:101:cat.0 Request processed in 472us (823us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1789263754.823142:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 58 00000100:00100000:2.0:1789263754.825290:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263754.825389:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888588032 00000100:00100000:0.0:1789263754.825397:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888588032 00000100:00100000:0.0:1789263754.825453:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 3 00000100:00100000:0.0:1789263754.825464:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9838fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+38:2397:x1876178888588032:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789263754.825476:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789263754.825495:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1dd72 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d1e expref: 38 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263754.825512:0:8409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd9bb596400) 00010000:00010000:0.0:1789263754.825516:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789263754.825557:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9838fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+37:2397:x1876178888588032:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 94us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263754.825566:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 3 00000100:00100000:1.0:1789263754.825598:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263754.825703:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888588288 00000100:00100000:3.0:1789263754.825708:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888588288 00000100:00100000:3.0:1789263754.825740:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 11 00000100:00100000:3.0:1789263754.825747:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989afed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+37:11156:x1876178888588288:12345-192.168.203.20@tcp:35:cat.0 00000100:00100000:3.0:1789263754.825985:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989afed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+38:11156:x1876178888588288:12345-192.168.203.20@tcp:35:cat.0 Request processed in 237us (388us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1789263754.825993:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 11 00000100:00100000:2.0:1789263754.850025:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263754.850281:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888588544 00000100:00100000:3.0:1789263754.850290:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888588544 00000100:00100000:3.0:1789263754.850349:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 59 00000100:00100000:3.0:1789263754.850361:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9838fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+38:11162:x1876178888588544:12345-192.168.203.20@tcp:101:dd.0 00010000:00010000:3.0:1789263754.850384:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263754.850388:0:6488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789263754.850413:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1dcca lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ced expref: 38 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.850431:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dd8829ed600) 00010000:00010000:3.0:1789263754.850435:0:6488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789263754.850448:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1dd80 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11d25 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.850544:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1dd87 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.850570:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1dd56 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d17 expref: 38 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.850579:0:6488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1dd87 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.850610:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1dd56 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d17 expref: 38 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.850624:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1dd56 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d17 expref: 38 pid: 6488 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263754.850637:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8842e9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6488:1876178898080768:192.168.203.20@tcp:104: 00000100:00100000:3.0:1789263754.850770:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd98615a480 going to sleep for 11 seconds 00000100:00100000:3.0:1789263754.852009:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8842e9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6488:1876178898080768:192.168.203.20@tcp:104: 00010000:00010000:3.0:1789263754.852035:0:6488:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1dd87 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263754.852104:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263754.852187:0:10303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888588672 00000100:00100000:1.0:1789263754.852193:0:10303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888588672 00010000:00010000:1.0:1789263754.852218:0:10303:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1dd56 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d17 expref: 39 pid: 6488 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263754.852245:0:10303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 51 00000100:00100000:1.0:1789263754.852253:0:10303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98c4b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3ce90ea2-917f-4b54-98b0-25e051f2317f+39:2398:x1876178888588672:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789263754.852263:0:10303:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789263754.852268:0:10303:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1dd56 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d17 expref: 39 pid: 6488 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.852278:0:10303:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1dd56 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d17 expref: 39 pid: 6488 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.852294:0:10303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1dd56 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d17 expref: 39 pid: 6488 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.852305:0:10303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd9bb596400) 00010000:00010000:1.0:1789263754.852308:0:10303:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1dd87 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.852315:0:10303:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1dd87 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.852322:0:10303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1dd87 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263754.852345:0:10303:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789263754.852389:0:6488:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1dd87 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263754.852390:0:10303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98c4b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3ce90ea2-917f-4b54-98b0-25e051f2317f+38:2398:x1876178888588672:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 136us (288us total) trans 0 rc 0/0 00010000:00010000:2.0:1789263754.852399:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1dd87 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263754.852416:0:10303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 51 00000004:00200000:2.0:1789263754.852423:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789263754.852537:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1dd80 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d25 expref: 39 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263754.852548:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1dd87 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d25 expref: 38 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263754.852554:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd9bb596400) 00010000:00010000:2.0:1789263754.852556:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789263754.852558:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981530200, rc 0) 00000100:00100000:2.0:1789263754.852580:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9838fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+38:11162:x1876178888588544:12345-192.168.203.20@tcp:101:dd.0 Request processed in 2224us (2564us total) trans 4294967334 rc 0/0 00000100:00100000:2.0:1789263754.852585:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 59 00000100:00100000:1.0:1789263754.854314:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263754.854391:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888588800 00000100:00100000:3.0:1789263754.854398:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888588800 00000100:00100000:3.0:1789263754.854440:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 60 00000100:00100000:3.0:1789263754.854454:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989aff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+38:11162:x1876178888588800:12345-192.168.203.20@tcp:101:dd.0 00010000:00010000:3.0:1789263754.854473:0:8417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263754.854488:0:8417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1dd95 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11d2c expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.854517:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1dd9c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.854537:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1dd9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.854546:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1dd9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.854640:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1dd95 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d2c expref: 40 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.854655:0:8417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1dd9c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d2c expref: 39 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.854663:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd9bb596400) 00010000:00010000:3.0:1789263754.854666:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789263754.854669:0:8417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981530400, rc 0) 00000100:00100000:3.0:1789263754.854763:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989aff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+39:11162:x1876178888588800:12345-192.168.203.20@tcp:101:dd.0 Request processed in 313us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263754.854770:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 60 00000100:00100000:0.0:1789263754.857248:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263754.857369:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888589056 00000100:00100000:3.0:1789263754.857379:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888589056 00000100:00100000:3.0:1789263754.857433:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 61 00000100:00100000:3.0:1789263754.857443:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989aec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+39:11162:x1876178888589056:12345-192.168.203.20@tcp:36:dd.0 00010000:00010000:3.0:1789263754.857633:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1dda3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.857649:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1dda3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.857682:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1dda3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789263754.857728:0:6487:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967335 00000004:00010000:3.0:1789263754.857751:0:6487:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000802d0815 reply state 00000000dd9a6a09 transno 4294967336 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1dda3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.857764:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1dda3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.857771:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd9bb596400) 00010000:00010000:3.0:1789263754.857773:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789263754.857776:0:6487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789263754.857868:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989aec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+42:11162:x1876178888589056:12345-192.168.203.20@tcp:36:dd.0 Request processed in 426us (626us total) trans 4294967336 rc 0/0 00000100:00100000:3.0:1789263754.857875:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 61 00000020:00080000:3.0:1789263754.857880:0:6487:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789263754.968811:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263754.968873:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888589184 00000100:00100000:3.0:1789263754.968883:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888589184 00000100:00100000:3.0:1789263754.969122:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 62 00000100:00100000:3.0:1789263754.969134:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9838ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+42:11176:x1876178888589184:12345-192.168.203.20@tcp:101:stat.0 00010000:00010000:3.0:1789263754.969157:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263754.969175:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1ddaa lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11d33 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.969234:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1ddb1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.969248:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1ddb1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.969275:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1ddb1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.969288:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1ddb8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.969296:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1ddb8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.969303:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1ddb8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.969370:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1ddbf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.969382:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1dd87 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d25 expref: 43 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.969390:0:6488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1ddbf lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.969421:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1dd87 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d25 expref: 43 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.969433:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1dd87 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d25 expref: 43 pid: 6488 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263754.969446:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8842e9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6488:1876178898080896:192.168.203.20@tcp:104: 00000100:00100000:3.0:1789263754.969547:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd98615a6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789263754.971825:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263754.971880:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8842e9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6488:1876178898080896:192.168.203.20@tcp:104: 00000100:00100000:0.0:1789263754.971884:0:14127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888589440 00000100:00100000:0.0:1789263754.971897:0:14127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888589440 00010000:00010000:3.0:1789263754.971905:0:6488:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1ddbf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263754.971949:0:14127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 12 00000100:00100000:0.0:1789263754.971959:0:14127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989afce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+44:6621:x1876178888589440:12345-192.168.203.20@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789263754.972240:0:14127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989afce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+45:6621:x1876178888589440:12345-192.168.203.20@tcp:35:ldlm_bl.0 Request processed in 281us (420us total) trans 4294967337 rc 0/0 00000100:00100000:0.0:1789263754.972259:0:14127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 12 00000100:00100000:2.0:1789263754.973168:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263754.973212:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888589568 00000100:00100000:3.0:1789263754.973217:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888589568 00010000:00010000:3.0:1789263754.973241:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1dd87 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d25 expref: 45 pid: 6488 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263754.973281:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 52 00000100:00100000:3.0:1789263754.973288:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9838fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+45:2397:x1876178888589568:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789263754.973298:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789263754.973304:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1dd87 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d25 expref: 45 pid: 6488 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.973313:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1dd87 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d25 expref: 45 pid: 6488 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.973332:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1dd87 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d25 expref: 45 pid: 6488 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.973346:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd9bb596400) 00010000:00010000:3.0:1789263754.973361:0:6474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1ddbf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.973371:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1ddbf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.973378:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1ddbf lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263754.973420:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789263754.973456:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9838fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+44:2397:x1876178888589568:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 167us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263754.973472:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 52 00010000:00010000:2.0:1789263754.973478:0:6488:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1ddbf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263754.973489:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1ddbf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789263754.973532:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789263754.973536:0:6488:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789263754.973580:0:6488:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1ddbf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263754.973592:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1ddbf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263754.973602:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1ddb1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263754.973608:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1ddb1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263754.973615:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1ddb1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263754.973621:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981530a00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263754.973625:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1ddb1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263754.973633:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1ddb1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263754.973642:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dd8829ed600) 00010000:00010000:2.0:1789263754.973645:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789263754.973649:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1ddb1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263754.973655:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1ddb1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263754.973676:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1ddb8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263754.973681:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1ddb8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263754.973687:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1ddb8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263754.973692:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981530e00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263754.973695:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1ddb8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263754.973701:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1ddb8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263754.973715:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9dd8829ed000) 00010000:00010000:2.0:1789263754.973717:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789263754.973720:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1ddb8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263754.973727:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1ddb8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263754.973751:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1ddaa lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d33 expref: 44 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263754.973763:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1ddbf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d33 expref: 43 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263754.973781:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd9bb596400) 00010000:00010000:2.0:1789263754.973783:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789263754.973786:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd990433600, rc 0) 00000100:00100000:2.0:1789263754.973819:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9838ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+43:11176:x1876178888589184:12345-192.168.203.20@tcp:101:stat.0 Request processed in 4687us (5027us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263754.973826:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 62 00000100:00100000:2.0:1789263755.005012:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263755.005174:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888589824 00000100:00100000:3.0:1789263755.005183:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888589824 00000100:00100000:3.0:1789263755.005302:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 63 00000100:00100000:3.0:1789263755.005314:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9838fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+43:11182:x1876178888589824:12345-192.168.203.20@tcp:36:truncate.0 00010000:00010000:3.0:1789263755.005369:0:8417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789263755.005397:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1ddbf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d33 expref: 43 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263755.005415:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd9bb596400) 00010000:00010000:3.0:1789263755.005420:0:8417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789263755.005595:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432200/0xce1582440fb1ddc6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263755.005609:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432200/0xce1582440fb1ddc6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263755.005618:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432200/0xce1582440fb1ddc6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789263755.005660:0:8417:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967338 00000004:00010000:3.0:1789263755.005681:0:8417:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000641940ef reply state 000000003e5d374e transno 4294967339 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432200/0xce1582440fb1ddc6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263755.005694:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432200/0xce1582440fb1ddc6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263755.005714:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd9bb596400) 00010000:00010000:3.0:1789263755.005716:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789263755.005719:0:8417:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789263755.005837:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9838fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+45:11182:x1876178888589824:12345-192.168.203.20@tcp:36:truncate.0 Request processed in 524us (834us total) trans 4294967339 rc 0/0 00000100:00100000:3.0:1789263755.005844:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 63 00000020:00080000:3.0:1789263755.005849:0:8417:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:0.0:1789263755.005890:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789263755.072948:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263755.073280:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888589952 00000100:00100000:3.0:1789263755.073290:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888589952 00000100:00100000:3.0:1789263755.073470:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 64 00000100:00100000:3.0:1789263755.073481:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88397ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+45:11196:x1876178888589952:12345-192.168.203.20@tcp:101:stat.0 00010000:00010000:3.0:1789263755.073504:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263755.073524:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1ddcd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11d3a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263755.073583:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433800/0xce1582440fb1ddd4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263755.073596:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433800/0xce1582440fb1ddd4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263755.073607:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433800/0xce1582440fb1ddd4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263755.073617:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1dddb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263755.073625:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1dddb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263755.073648:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1dddb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263755.073717:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1dde2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263755.073726:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1dde2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263755.073732:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1dde2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789263755.073769:0:6487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1789263755.073773:0:6487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789263755.073803:0:6487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1dde2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263755.073815:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1dde2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263755.073823:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433800/0xce1582440fb1ddd4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263755.073829:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433800/0xce1582440fb1ddd4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263755.073836:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433800/0xce1582440fb1ddd4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263755.073842:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd990433800 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263755.073846:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433800/0xce1582440fb1ddd4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263755.073859:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433800/0xce1582440fb1ddd4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263755.073871:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dd8829ed600) 00010000:00010000:3.0:1789263755.073874:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789263755.073878:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433800/0xce1582440fb1ddd4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263755.073884:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433800/0xce1582440fb1ddd4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263755.073897:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1dddb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263755.073903:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1dddb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263755.073908:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1dddb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263755.073913:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd990433200 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263755.073915:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1dddb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263755.073921:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1dddb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263755.073927:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9dd8829ed000) 00010000:00010000:3.0:1789263755.073930:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789263755.073932:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1dddb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263755.073946:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1dddb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263755.073970:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1ddcd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d3a expref: 47 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263755.073989:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1dde2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d3a expref: 46 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263755.073996:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd9bb596400) 00010000:00010000:3.0:1789263755.073998:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789263755.074000:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981530c00, rc 0) 00000100:00100000:3.0:1789263755.074059:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88397ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+46:11196:x1876178888589952:12345-192.168.203.20@tcp:101:stat.0 Request processed in 580us (1120us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263755.074066:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 64 00000100:00100000:2.0:1789263755.135954:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263755.136020:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888590208 00000100:00100000:3.0:1789263755.136030:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888590208 00000100:00100000:2.0:1789263755.136108:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 65 00000100:00100000:2.0:1789263755.136122:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9838ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+46:11212:x1876178888590208:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:2.0:1789263755.136143:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263755.136163:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805600/0xce1582440fb1dde9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11d41 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.136262:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1ddf0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.136277:0:6489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1dde2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d3a expref: 47 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.136286:0:6489:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1ddf0 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.136318:0:6489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1dde2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d3a expref: 47 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.136347:0:6489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1dde2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d3a expref: 47 pid: 6487 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263755.136360:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9838fca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6489:1876178898081024:192.168.203.20@tcp:104: 00000100:00100000:2.0:1789263755.136460:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd88392aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1789263755.137507:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9838fca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6489:1876178898081024:192.168.203.20@tcp:104: 00010000:00010000:1.0:1789263755.137527:0:6489:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1ddf0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263755.138021:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263755.138119:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888590336 00000100:00100000:1.0:1789263755.138126:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888590336 00010000:00010000:1.0:1789263755.138156:0:6472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1dde2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d3a expref: 48 pid: 6487 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263755.138193:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 53 00000100:00100000:1.0:1789263755.138202:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9838ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+48:2398:x1876178888590336:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789263755.138215:0:6472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789263755.138222:0:6472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1dde2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d3a expref: 48 pid: 6487 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263755.138235:0:6472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1dde2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d3a expref: 48 pid: 6487 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263755.138266:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1dde2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d3a expref: 48 pid: 6487 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263755.138283:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd9bb596400) 00010000:00010000:1.0:1789263755.138297:0:6472:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1ddf0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263755.138306:0:6472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1ddf0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263755.138313:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1ddf0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263755.138400:0:6472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789263755.138445:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9838ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+47:2398:x1876178888590336:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 243us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263755.138452:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 53 00010000:00010000:2.0:1789263755.138493:0:6489:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1ddf0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.138501:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1ddf0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789263755.138516:0:6489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1789263755.138627:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805600/0xce1582440fb1dde9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d41 expref: 48 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.138640:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1ddf0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d41 expref: 47 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.138648:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd9bb596400) 00010000:00010000:2.0:1789263755.138650:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789263755.138653:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bb804400, rc 0) 00000100:00100000:2.0:1789263755.138684:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9838ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+47:11212:x1876178888590208:12345-192.168.203.20@tcp:101:bash.0 Request processed in 2567us (2740us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1789263755.138690:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 65 00000100:00100000:2.0:1789263755.140911:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263755.140971:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888590592 00000100:00100000:3.0:1789263755.140978:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888590592 00000100:00100000:3.0:1789263755.141026:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 66 00000100:00100000:3.0:1789263755.141035:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9838fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+47:11212:x1876178888590592:12345-192.168.203.20@tcp:36:bash.0 00010000:00010000:3.0:1789263755.141286:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1ddfe lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263755.141301:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1ddfe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263755.141322:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1ddfe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789263755.141372:0:8417:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967341 00000004:00010000:3.0:1789263755.141393:0:8417:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e7577fe1 reply state 00000000e2bdab76 transno 4294967342 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1ddfe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263755.141406:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1ddfe lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263755.141413:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd9bb596400) 00010000:00010000:3.0:1789263755.141416:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789263755.141419:0:8417:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789263755.141495:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9838fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+50:11212:x1876178888590592:12345-192.168.203.20@tcp:36:bash.0 Request processed in 460us (589us total) trans 4294967342 rc 0/0 00000100:00100000:3.0:1789263755.141502:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 66 00000020:00080000:3.0:1789263755.141507:0:8417:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789263755.144622:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263755.144691:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888590720 00000100:00100000:3.0:1789263755.144701:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888590720 00000100:00100000:3.0:1789263755.144759:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 67 00000100:00100000:3.0:1789263755.144768:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989aef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+50:11212:x1876178888590720:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:3.0:1789263755.144788:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263755.144815:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1de05 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11d48 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263755.144889:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1de0c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263755.144904:0:6487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1ddf0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d41 expref: 51 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263755.144928:0:6487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1de0c lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263755.144963:0:6487:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1ddf0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d41 expref: 51 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263755.144975:0:6487:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1ddf0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d41 expref: 51 pid: 6489 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263755.144989:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8842e9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6487:1876178898081152:192.168.203.20@tcp:104: 00000100:00100000:3.0:1789263755.145101:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd98615a6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789263755.146951:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263755.146958:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8842e9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6487:1876178898081152:192.168.203.20@tcp:104: 00010000:00010000:3.0:1789263755.146981:0:6487:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1de0c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263755.147032:0:10303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888590848 00000100:00100000:0.0:1789263755.147039:0:10303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888590848 00010000:00010000:0.0:1789263755.147068:0:10303:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1ddf0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d41 expref: 52 pid: 6489 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263755.147122:0:10303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 54 00000100:00100000:0.0:1789263755.147131:0:10303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e32d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3ce90ea2-917f-4b54-98b0-25e051f2317f+52:2398:x1876178888590848:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789263755.147143:0:10303:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789263755.147149:0:10303:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1ddf0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d41 expref: 52 pid: 6489 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263755.147161:0:10303:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1ddf0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d41 expref: 52 pid: 6489 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263755.147179:0:10303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1ddf0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d41 expref: 52 pid: 6489 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263755.147193:0:10303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd9bb596400) 00010000:00010000:0.0:1789263755.147198:0:10303:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1de0c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263755.147207:0:10303:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1de0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263755.147214:0:10303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1de0c lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263755.147251:0:10303:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789263755.147296:0:10303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e32d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3ce90ea2-917f-4b54-98b0-25e051f2317f+51:2398:x1876178888590848:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 165us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263755.147304:0:10303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 54 00010000:00010000:3.0:1789263755.147375:0:6487:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1de0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263755.147383:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1de0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789263755.147426:0:6487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1789263755.147431:0:6487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789263755.147455:0:6487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1de0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263755.147482:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1de05 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d48 expref: 51 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263755.147549:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1de0c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d48 expref: 50 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263755.147557:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd9bb596400) 00010000:00010000:3.0:1789263755.147559:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789263755.147562:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981530200, rc 0) 00000100:00100000:3.0:1789263755.147625:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989aef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+50:11212:x1876178888590720:12345-192.168.203.20@tcp:101:bash.0 Request processed in 2858us (3010us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263755.147633:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 67 00000100:00100000:1.0:1789263755.148811:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263755.148909:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888591104 00000100:00100000:3.0:1789263755.148916:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888591104 00000100:00100000:3.0:1789263755.148964:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 13 00000100:00100000:3.0:1789263755.148973:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+50:11212:x1876178888591104:12345-192.168.203.20@tcp:35:bash.0 00000100:00100000:3.0:1789263755.149178:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+51:11212:x1876178888591104:12345-192.168.203.20@tcp:35:bash.0 Request processed in 205us (368us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1789263755.149186:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 13 00000100:00100000:0.0:1789263755.185291:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263755.185350:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888591232 00000100:00100000:2.0:1789263755.185360:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888591232 00000100:00100000:2.0:1789263755.185416:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 68 00000100:00100000:2.0:1789263755.185427:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989aeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+51:11222:x1876178888591232:12345-192.168.203.20@tcp:34:lfs.0 00010000:00010000:2.0:1789263755.185499:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804c00/0xce1582440fb1de13 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.185515:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804c00/0xce1582440fb1de13 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.185526:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804c00/0xce1582440fb1de13 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.185536:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1de1a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.185542:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1de1a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.185548:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1de1a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.185618:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805a00/0xce1582440fb1de21 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.185639:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805a00/0xce1582440fb1de21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.185646:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805a00/0xce1582440fb1de21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789263755.185700:0:6489:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805a00/0xce1582440fb1de21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.185725:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804c00/0xce1582440fb1de13 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.185732:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804c00/0xce1582440fb1de13 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.185739:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804c00/0xce1582440fb1de13 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.185746:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bb804c00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263755.185750:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804c00/0xce1582440fb1de13 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.185757:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804c00/0xce1582440fb1de13 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.185769:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dd8829ed600) 00010000:00010000:2.0:1789263755.185772:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789263755.185777:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804c00/0xce1582440fb1de13 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.185783:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804c00/0xce1582440fb1de13 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.185809:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1de1a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.185815:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1de1a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.185821:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1de1a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.185832:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bb805800 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263755.185835:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1de1a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.185842:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1de1a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.185851:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9dd8829ed000) 00010000:00010000:2.0:1789263755.185853:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789263755.185856:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1de1a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.185861:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1de1a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.185868:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805a00/0xce1582440fb1de21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.185872:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805a00/0xce1582440fb1de21 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.185875:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805a00/0xce1582440fb1de21 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.185878:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bb805a00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263755.185880:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805a00/0xce1582440fb1de21 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.185883:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805a00/0xce1582440fb1de21 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.185894:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd9bb596400) 00010000:00010000:2.0:1789263755.185896:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789263755.185898:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805a00/0xce1582440fb1de21 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.185901:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805a00/0xce1582440fb1de21 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263755.185959:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989aeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+51:11222:x1876178888591232:12345-192.168.203.20@tcp:34:lfs.0 Request processed in 535us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263755.185964:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 68 00000100:00100000:2.0:1789263755.194804:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263755.194843:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263755.194863:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888591360 00000100:00100000:0.0:1789263755.194872:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888591360 00000100:00100000:2.0:1789263755.194876:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263755.194891:0:13766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888591616 00000100:00100000:3.0:1789263755.194896:0:13766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888591616 00000100:00100000:0.0:1789263755.194927:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 330 00000100:00100000:3.0:1789263755.194936:0:13766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 68 00000100:00100000:0.0:1789263755.194942:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a04450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+13:2400:x1876178888591360:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789263755.194947:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263755.194956:0:13766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9838fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+7:2400:x1876178888591616:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789263755.195014:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a04450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+13:2400:x1876178888591360:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 77us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263755.195022:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 330 00000100:00100000:1.0:1789263755.195041:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888591872 00000100:00100000:3.0:1789263755.195048:0:13766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9838fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+7:2400:x1876178888591616:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 102us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263755.195048:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888591872 00000100:00100000:3.0:1789263755.195059:0:13766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 68 00000100:00080000:0.0:1789263755.195196:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789263755.195207:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263755.195597:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888591488 00000100:00100000:1.0:1789263755.195602:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888591488 00000100:00100000:1.0:1789263755.195637:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888591744 00000100:00100000:1.0:1789263755.195640:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888591744 00000100:00080000:2.0:1789263755.195680:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789263755.195684:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789263755.195709:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 131 00000100:00100000:1.0:1789263755.195722:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9838fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:857a0866-badb-47ac-9591-fbf273e4680e+5:2400:x1876178888591872:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1789263755.195757:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9838fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:857a0866-badb-47ac-9591-fbf273e4680e+5:2400:x1876178888591872:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 37us (883us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263755.196617:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 132 00000100:00100000:2.0:1789263755.196626:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+5:2400:x1876178888591488:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789263755.196650:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+5:2400:x1876178888591488:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 28us (1711us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263755.196655:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 132 00000100:00100000:2.0:1789263755.196667:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 133 00000100:00100000:2.0:1789263755.196671:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:857a0866-badb-47ac-9591-fbf273e4680e+5:2400:x1876178888591744:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789263755.196684:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:857a0866-badb-47ac-9591-fbf273e4680e+5:2400:x1876178888591744:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 13us (1695us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263755.196696:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 133 00000100:00100000:1.0:1789263755.196874:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 131 00000100:00100000:0.0:1789263755.204857:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263755.204930:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888592128 00000100:00100000:2.0:1789263755.204941:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888592128 00000100:00100000:2.0:1789263755.204992:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 69 00000100:00100000:2.0:1789263755.205001:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989aee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+51:11225:x1876178888592128:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:2.0:1789263755.205020:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263755.205039:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805a00/0xce1582440fb1de28 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11d4f expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.205125:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1de2f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.205139:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1de2f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.205157:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1de2f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.205167:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804c00/0xce1582440fb1de36 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.205174:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804c00/0xce1582440fb1de36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.205180:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804c00/0xce1582440fb1de36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.205276:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804000/0xce1582440fb1de3d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.205300:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804000/0xce1582440fb1de3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.205307:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804000/0xce1582440fb1de3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789263755.205317:0:6489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789263755.205391:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1de2f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.205399:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1de2f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.205405:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1de2f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.205411:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bb805800 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263755.205416:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1de2f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.205423:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1de2f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.205434:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dd8829ed600) 00010000:00010000:2.0:1789263755.205437:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789263755.205441:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1de2f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.205447:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1de2f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.205458:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804c00/0xce1582440fb1de36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.205470:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804c00/0xce1582440fb1de36 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.205476:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804c00/0xce1582440fb1de36 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.205480:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bb804c00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263755.205484:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804c00/0xce1582440fb1de36 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.205489:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804c00/0xce1582440fb1de36 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.205497:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9dd8829ed000) 00010000:00010000:2.0:1789263755.205499:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789263755.205502:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804c00/0xce1582440fb1de36 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.205508:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804c00/0xce1582440fb1de36 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.205539:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805a00/0xce1582440fb1de28 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d4f expref: 54 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.205551:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804000/0xce1582440fb1de3d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d4f expref: 53 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.205558:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd9bb596400) 00010000:00010000:2.0:1789263755.205560:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789263755.205568:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bb804000, rc 0) 00000100:00100000:2.0:1789263755.205622:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989aee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+53:11225:x1876178888592128:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 622us (775us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1789263755.205630:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 69 00000100:00100000:0.0:1789263755.207727:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263755.207813:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263755.207823:0:7428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888592256 00000100:00100000:1.0:1789263755.207850:0:7428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888592256 00000100:00100000:2.0:1789263755.207886:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888592384 00000100:00100000:2.0:1789263755.207897:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888592384 00000100:00100000:1.0:1789263755.207943:0:7428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 4 00000100:00100000:2.0:1789263755.207968:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 70 00000100:00100000:1.0:1789263755.207969:0:7428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989aee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+54:2399:x1876178888592256:12345-192.168.203.20@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1789263755.207983:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989aedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+54:11225:x1876178888592384:12345-192.168.203.20@tcp:54:lfs.0 00010000:00010000:1.0:1789263755.208014:0:7428:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789263755.208049:0:7428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804000/0xce1582440fb1de3d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d4f expref: 54 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.208054:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804a00/0xce1582440fb1de4b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.208114:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804a00/0xce1582440fb1de4b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263755.208130:0:7428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd9bb596400) 00010000:00010000:2.0:1789263755.208131:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804a00/0xce1582440fb1de4b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263755.208146:0:7428:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789263755.208174:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804a00/0xce1582440fb1de4b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.208183:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804a00/0xce1582440fb1de4b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.208191:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804a00/0xce1582440fb1de4b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.208198:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bb804a00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263755.208203:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804a00/0xce1582440fb1de4b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.208211:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804a00/0xce1582440fb1de4b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263755.208222:0:7428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989aee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+53:2399:x1876178888592256:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 266us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263755.208246:0:7428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 4 00010000:00010000:2.0:1789263755.208256:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd9bb596400) 00010000:00010000:2.0:1789263755.208262:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789263755.208268:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804a00/0xce1582440fb1de4b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.208275:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804a00/0xce1582440fb1de4b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263755.208340:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989aedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+52:11225:x1876178888592384:12345-192.168.203.20@tcp:54:lfs.0 Request processed in 360us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263755.208348:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 70 00000100:00100000:0.0:1789263755.209342:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263755.209556:0:14127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888592640 00000100:00100000:1.0:1789263755.209563:0:14127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888592640 00000100:00100000:1.0:1789263755.209606:0:14127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 14 00000100:00100000:1.0:1789263755.209614:0:14127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989aeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+52:11225:x1876178888592640:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:1.0:1789263755.209785:0:14127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989aeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+53:11225:x1876178888592640:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 171us (443us total) trans 4294967345 rc 0/0 00000100:00100000:1.0:1789263755.209804:0:14127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 14 00000100:00100000:0.0:1789263755.276879:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263755.276956:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888592896 00000100:00100000:2.0:1789263755.276966:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888592896 00000100:00100000:2.0:1789263755.277048:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 71 00000100:00100000:2.0:1789263755.277061:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989aed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+53:11243:x1876178888592896:12345-192.168.203.20@tcp:101:cat.0 00010000:00010000:2.0:1789263755.277117:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263755.277137:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804a00/0xce1582440fb1de52 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11d56 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.277225:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805a00/0xce1582440fb1de59 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.277235:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805a00/0xce1582440fb1de59 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.277243:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805a00/0xce1582440fb1de59 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789263755.277250:0:6487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789263755.277344:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804a00/0xce1582440fb1de52 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d56 expref: 56 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.277356:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805a00/0xce1582440fb1de59 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d56 expref: 55 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.277364:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd9bb596400) 00010000:00010000:2.0:1789263755.277367:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789263755.277370:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bb805a00, rc 0) 00000100:00100000:2.0:1789263755.277430:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989aed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+55:11243:x1876178888592896:12345-192.168.203.20@tcp:101:cat.0 Request processed in 372us (560us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1789263755.277437:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 71 00000100:00100000:0.0:1789263755.290885:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263755.292286:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888593024 00000100:00100000:2.0:1789263755.292298:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888593024 00000100:00100000:2.0:1789263755.292363:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 72 00000100:00100000:2.0:1789263755.292372:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989ae2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+55:11244:x1876178888593024:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:2.0:1789263755.292397:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263755.292418:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804a00/0xce1582440fb1de67 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11d5d expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.292489:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804c00/0xce1582440fb1de6e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.292503:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804c00/0xce1582440fb1de6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.292514:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804c00/0xce1582440fb1de6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789263755.292572:0:6489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1789263755.292576:0:6489:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789263755.292593:0:6489:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804c00/0xce1582440fb1de6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.292618:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804a00/0xce1582440fb1de67 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d5d expref: 57 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.292636:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804c00/0xce1582440fb1de6e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d5d expref: 56 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.292643:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dd8829ed600) 00010000:00010000:2.0:1789263755.292646:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789263755.292649:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bb804c00, rc 0) 00000100:00100000:2.0:1789263755.292707:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989ae2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+56:11244:x1876178888593024:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 335us (1829us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263755.292714:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 72 00000100:00100000:0.0:1789263755.295608:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263755.295777:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888593408 00000100:00100000:3.0:1789263755.295807:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888593408 00000100:00100000:3.0:1789263755.295864:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 15 00000100:00100000:3.0:1789263755.295873:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a3a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+56:11244:x1876178888593408:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:3.0:1789263755.296209:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a3a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+57:11244:x1876178888593408:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 336us (607us total) trans 4294967347 rc 0/0 00000100:00100000:3.0:1789263755.296215:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 15 00000100:00100000:0.0:1789263755.298143:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263755.298202:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888593536 00000100:00100000:2.0:1789263755.298212:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888593536 00000100:00100000:2.0:1789263755.298267:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 5 00000100:00100000:2.0:1789263755.298278:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989ae2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+57:11244:x1876178888593536:12345-192.168.203.20@tcp:103:lfs.0 00010000:00010000:2.0:1789263755.298293:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789263755.298316:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1de0c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d48 expref: 57 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.298337:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805a00/0xce1582440fb1de59 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d56 expref: 56 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.298370:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1dd10 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d09 expref: 55 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.298380:0:8409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd9bb596400) 00010000:00010000:2.0:1789263755.298385:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789263755.298437:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989ae2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+54:11244:x1876178888593536:12345-192.168.203.20@tcp:103:lfs.0 Request processed in 161us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263755.298445:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 5 00000100:00100000:0.0:1789263755.299407:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263755.299451:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888593664 00000100:00100000:2.0:1789263755.299457:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888593664 00000100:00100000:2.0:1789263755.299496:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 73 00000100:00100000:2.0:1789263755.299504:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989ae2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+54:11244:x1876178888593664:12345-192.168.203.20@tcp:58:lfs.0 00010000:00010000:2.0:1789263755.299606:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804a00/0xce1582440fb1de75 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.299634:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804a00/0xce1582440fb1de75 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.299646:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804a00/0xce1582440fb1de75 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789263755.299861:0:6488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789263755.299994:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1789263755.300102:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1789263755.300166:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989ae2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+54:11244:x1876178888593664:12345-192.168.203.20@tcp:58:lfs.0 Request processed in 662us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263755.300174:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 73 00000100:00100000:0.0:1789263755.309203:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263755.309237:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898081280:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789263755.309248:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888593792 00000100:00100000:0.0:1789263755.309256:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888593792 00000100:00100000:1.0:1789263755.309295:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263755.309313:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 74 00000100:00100000:0.0:1789263755.309335:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989ae1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+54:11246:x1876178888593792:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:0.0:1789263755.309357:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1789263755.309371:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8842e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:66a76ccf-c64c-4b18-8369-a2861ec3956c:3620:1876178898081408:0@lo:400:kworker.0 00000100:00100000:1.0:1789263755.309373:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989afed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1876178898081792:0@lo:400:kworker.0 00010000:00010000:0.0:1789263755.309376:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72e00/0xce1582440fb1de7c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11d64 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263755.309425:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8842ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1876178898081536:0@lo:400:kworker.0 00000100:00100000:3.0:1789263755.309426:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263755.309434:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789263755.309440:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72800/0xce1582440fb1de83 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263755.309456:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72800/0xce1582440fb1de83 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263755.309464:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989afce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1876178898081920:0@lo:400:kworker.0 00000100:00100000:1.0:1789263755.309468:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876178898082304:0@lo:400:kworker.0 00000100:00100000:2.0:1789263755.309474:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789263755.309476:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72800/0xce1582440fb1de83 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263755.309490:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73800/0xce1582440fb1de8a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263755.309498:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73800/0xce1582440fb1de8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263755.309505:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73800/0xce1582440fb1de8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263755.309507:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989aec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3621:1876178898082048:0@lo:400:kworker.0 00000100:00100000:3.0:1789263755.309512:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263755.309518:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263755.309545:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898082432:0@lo:400:kworker.0 00000100:00100000:1.0:1789263755.309547:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876178898082816:0@lo:400:kworker.0 00000100:00100000:2.0:1789263755.309556:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263755.309580:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3621:1876178898082560:0@lo:400:kworker.0 00000100:00100000:3.0:1789263755.309589:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789263755.309596:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73e00/0xce1582440fb1de91 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263755.309597:0:8396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898081280 00010000:00010000:0.0:1789263755.309607:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73e00/0xce1582440fb1de91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263755.309608:0:8396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898081280 00000100:00100000:2.0:1789263755.309618:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789263755.309622:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73e00/0xce1582440fb1de91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263755.309626:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898082944:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789263755.309657:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8842eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898081664:0@lo:400:kworker.0 00000100:00100000:1.0:1789263755.309657:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789263755.309667:0:8396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaa6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1876178898081280:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789263755.309676:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00200000:0.0:1789263755.309682:0:6487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00002000:00000024:1.0:1789263755.309683:0:8396:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000004:00200000:0.0:1789263755.309688:0:6487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:2.0:1789263755.309695:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00010000:0.0:1789263755.309712:0:6487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73e00/0xce1582440fb1de91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263755.309720:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898081408 00000100:00100000:3.0:1789263755.309726:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898081408 00000100:00100000:2.0:1789263755.309726:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989aeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898082176:0@lo:400:kworker.0 00010000:00010000:0.0:1789263755.309727:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73e00/0xce1582440fb1de91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263755.309734:0:8396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaa6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1876178898081280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263755.309747:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00010000:0.0:1789263755.309748:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72800/0xce1582440fb1de83 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263755.309757:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72800/0xce1582440fb1de83 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263755.309764:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1789263755.309765:0:8396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898082944 00000100:00100000:1.0:1789263755.309771:0:8396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898082944 00010000:00010000:0.0:1789263755.309773:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72800/0xce1582440fb1de83 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263755.309775:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263755.309781:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a07c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+24:3620:x1876178898081408:12345-0@lo:400:kworker.0 00010000:00010000:0.0:1789263755.309786:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883e72800 already unused, calling callback (ffffffffc18c14f0) 00000100:00100000:1.0:1789263755.309803:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00010000:00010000:0.0:1789263755.309807:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72800/0xce1582440fb1de83 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263755.309814:0:8396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1876178898082944:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789263755.309815:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1876178898082688:0@lo:400:kworker.0 00010000:00010000:0.0:1789263755.309825:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72800/0xce1582440fb1de83 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00000024:1.0:1789263755.309830:0:8396:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00010000:00010000:0.0:1789263755.309840:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dd8829ed600) 00000100:00100000:3.0:1789263755.309846:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a07c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+24:3620:x1876178898081408:12345-0@lo:400:kworker.0 Request processed in 67us (419us total) trans 0 rc 0/0 00010000:00010000:0.0:1789263755.309846:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789263755.309853:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72800/0xce1582440fb1de83 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263755.309867:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00010000:00010000:0.0:1789263755.309867:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72800/0xce1582440fb1de83 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263755.309876:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263755.309883:0:8396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1876178898082944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263755.309900:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00010000:0.0:1789263755.309908:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73800/0xce1582440fb1de8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789263755.309912:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789263755.309918:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73800/0xce1582440fb1de8a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263755.309920:0:8511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898082432 00000100:00100000:3.0:1789263755.309927:0:8511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898082432 00010000:00010000:0.0:1789263755.309932:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73800/0xce1582440fb1de8a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263755.309938:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898082304 00010000:00010000:0.0:1789263755.309940:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883e73800 already unused, calling callback (ffffffffc18c14f0) 00000100:00100000:2.0:1789263755.309946:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898082304 00010000:00010000:0.0:1789263755.309946:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73800/0xce1582440fb1de8a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263755.309949:0:8395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898082176 00000100:00100000:1.0:1789263755.309955:0:8395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898082176 00010000:00010000:0.0:1789263755.309957:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73800/0xce1582440fb1de8a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263755.309966:0:8511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00010000:00010000:0.0:1789263755.309973:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9dd8829ed000) 00010000:00010000:0.0:1789263755.309979:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789263755.309980:0:8511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3620:x1876178898082432:12345-0@lo:400:kworker.0 00010000:00010000:0.0:1789263755.309985:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73800/0xce1582440fb1de8a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263755.309987:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898081664 00000100:00100000:2.0:1789263755.309992:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898081664 00000100:00100000:1.0:1789263755.309999:0:8395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00010000:00010000:0.0:1789263755.310004:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73800/0xce1582440fb1de8a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263755.310013:0:8395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1876178898082176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789263755.310020:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789263755.310030:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1876178898082304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263755.310045:0:8511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3620:x1876178898082432:12345-0@lo:400:kworker.0 Request processed in 69us (455us total) trans 0 rc 0/0 00010000:00010000:0.0:1789263755.310050:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72e00/0xce1582440fb1de7c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d64 expref: 56 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263755.310057:0:8511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789263755.310067:0:8395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1876178898082176:12345-0@lo:400:kworker.0 Request processed in 57us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263755.310102:0:8395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789263755.310112:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1876178898082304:12345-0@lo:400:kworker.0 Request processed in 83us (597us total) trans 0 rc 0/0 00010000:00010000:0.0:1789263755.310116:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73e00/0xce1582440fb1de91 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d64 expref: 55 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263755.310122:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789263755.310128:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898081792 00000100:00100000:3.0:1789263755.310133:0:8499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789263755.310135:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898081792 00010000:00010000:0.0:1789263755.310146:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd9bb596400) 00000100:00100000:3.0:1789263755.310149:0:8499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1876178898081664:12345-0@lo:400:kworker.0 00010000:00010000:0.0:1789263755.310150:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789263755.310156:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd883e73e00, rc 0) 00000100:00100000:2.0:1789263755.310163:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898081920 00000100:00100000:1.0:1789263755.310163:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898081536 00000100:00100000:1.0:1789263755.310168:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898081536 00000100:00100000:2.0:1789263755.310170:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898081920 00000100:00100000:1.0:1789263755.310185:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898082048 00000100:00100000:1.0:1789263755.310189:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898082048 00000100:00100000:2.0:1789263755.310198:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898082560 00000100:00100000:2.0:1789263755.310203:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898082560 00000100:00100000:1.0:1789263755.310218:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898082688 00000100:00100000:0.0:1789263755.310218:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989ae1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+55:11246:x1876178888593792:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 884us (1021us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263755.310220:0:8499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1876178898081664:12345-0@lo:400:kworker.0 Request processed in 75us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263755.310223:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898082688 00000100:00100000:0.0:1789263755.310233:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 74 00000100:00100000:3.0:1789263755.310238:0:8499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789263755.310257:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00080000:3.0:1789263755.310264:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789263755.310267:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789263755.310270:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789263755.310283:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789263755.310289:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1876178898081792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263755.310294:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789263755.310298:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1876178898081536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263755.310309:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898082944:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789263755.310309:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1876178898081920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263755.310331:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8842e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:66a76ccf-c64c-4b18-8369-a2861ec3956c:3620:1876178898081408:0@lo:400:kworker.0 00000100:00100000:2.0:1789263755.310347:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1876178898081792:12345-0@lo:400:kworker.0 Request processed in 63us (913us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263755.310353:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898082432:0@lo:400:kworker.0 00000100:00100000:1.0:1789263755.310355:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1876178898081536:12345-0@lo:400:kworker.0 Request processed in 59us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263755.310362:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789263755.310368:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1876178898081920:12345-0@lo:400:kworker.0 Request processed in 61us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263755.310373:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789263755.310383:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1789263755.310390:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789263755.310395:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989afce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1876178898081920:0@lo:400:kworker.0 00000100:00100000:1.0:1789263755.310402:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789263755.310404:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1876178898082048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263755.310411:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789263755.310413:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1876178898082560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263755.310427:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263755.310427:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1876178898082688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789263755.310458:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1876178898082560:12345-0@lo:400:kworker.0 Request processed in 47us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263755.310465:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789263755.310483:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898081280:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789263755.310489:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1876178898082048:12345-0@lo:400:kworker.0 Request processed in 88us (929us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263755.310491:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1876178898082688:12345-0@lo:400:kworker.0 Request processed in 68us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263755.310505:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8842ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1876178898081536:0@lo:400:kworker.0 00000100:00100000:2.0:1789263755.310506:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789263755.310515:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989afed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1876178898081792:0@lo:400:kworker.0 00000100:00100000:0.0:1789263755.310516:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00010000:00080000:1.0:1789263755.310529:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd989aec000 x1876178898082048/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263771 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263755.310539:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876178898082304:0@lo:400:kworker.0 00000100:00100000:1.0:1789263755.310539:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989aec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3621:1876178898082048:0@lo:400:kworker.0 00000100:00100000:2.0:1789263755.310552:0:13766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898082816 00000100:00100000:2.0:1789263755.310558:0:13766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898082816 00000100:00100000:1.0:1789263755.310564:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3621:1876178898082560:0@lo:400:kworker.0 00000100:00100000:2.0:1789263755.310596:0:13766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789263755.310607:0:13766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3619:x1876178898082816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263755.310613:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8842eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898081664:0@lo:400:kworker.0 00000100:00100000:3.0:1789263755.310629:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989aeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898082176:0@lo:400:kworker.0 00010000:00080000:3.0:1789263755.310647:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd98ff7ad80 x1876178898082688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263771 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789263755.310659:0:13766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3619:x1876178898082816:12345-0@lo:400:kworker.0 Request processed in 52us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263755.310672:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1876178898082688:0@lo:400:kworker.0 00000100:00100000:2.0:1789263755.310673:0:13766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789263755.310681:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876178898082816:0@lo:400:kworker.0 00000040:00080000:2.0:1789263755.646350:0:14165:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789263755.646358:0:14165:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789263755.646383:0:14165:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1789263755.646390:0:14165:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1789263755.693293:0:13689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789263755.821272:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789263755.821295:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989ae1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898083072:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789263755.821333:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898083200:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789263755.821360:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263755.821379:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263755.821399:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876178898083328:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789263755.821427:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898083200 00000100:00100000:0.0:1789263755.821428:0:8396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898083072 00000100:00100000:3.0:1789263755.821435:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898083200 00000100:00100000:0.0:1789263755.821435:0:8396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898083072 00000100:00100000:2.0:1789263755.821441:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263755.821482:0:8396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898083328 00000100:00100000:3.0:1789263755.821485:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789263755.821486:0:8396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898083328 00000100:00100000:1.0:1789263755.821495:0:8512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789263755.821496:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1876178898083200:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789263755.821512:0:8512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989ae3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898083072:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789263755.821518:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789263755.821527:0:8396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1876178898083328:12345-0@lo:13:osp-pre-0-0.0 00000004:00000024:3.0:1789263755.821529:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00002000:00000024:1.0:1789263755.821536:0:8512:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00002000:00000024:0.0:1789263755.821540:0:8396:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789263755.821584:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1876178898083200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263755.821590:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789263755.821606:0:8512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989ae3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898083072:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263755.821614:0:8396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1876178898083328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263755.821615:0:8512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789263755.821625:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789263755.821649:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876178898083328:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789263755.821660:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989ae1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898083072:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789263755.821759:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898083200:0@lo:41:osp-pre-1-0.0 00000001:00100000:1.0:1789263755.822615:0:8388:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3ce90ea2-917f-4b54-98b0-25e051f2317f 00000020:00000080:1.0:1789263755.822621:0:8388:0:(genops.c:885:class_export_put()) final put ffff9dd883f8d800/3ce90ea2-917f-4b54-98b0-25e051f2317f 00000020:00000080:3.0:1789263755.822817:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd883f8d800/3ce90ea2-917f-4b54-98b0-25e051f2317f for lustre-OST0000 00000020:00000080:3.0:1789263755.822866:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd883f8c000 for lustre-OST0000 00000040:00080000:0.0:1789263755.949343:0:13757:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789263755.949353:0:13757:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789263755.949409:0:13757:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789263755.949418:0:13757:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789263755.949544:0:13757:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989ae1500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13757:1876178898083456:192.168.203.20@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789263755.949712:0:13757:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd983852600 going to sleep for 11 seconds 00000100:00100000:1.0:1789263755.951323:0:13757:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989ae1500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13757:1876178898083456:192.168.203.20@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789263755.952234:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263755.952310:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888593920 00000100:00100000:1.0:1789263755.952322:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888593920 00000100:00100000:1.0:1789263755.952398:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 75 00000100:00100000:1.0:1789263755.952410:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989ae0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+55:11258:x1876178888593920:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789263755.952477:0:7434:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789263755.952606:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989ae0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+55:11258:x1876178888593920:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 Request processed in 199us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263755.952612:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 75 00000100:00100000:0.0:1789263755.954532:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263755.954622:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888594048 00000100:00100000:2.0:1789263755.954633:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888594048 00000100:00100000:2.0:1789263755.954699:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 76 00000100:00100000:2.0:1789263755.954725:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989ae0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+55:11258:x1876178888594048:12345-192.168.203.20@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789263755.954828:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805c00/0xce1582440fb1de98 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.954850:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805c00/0xce1582440fb1de98 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.954867:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805c00/0xce1582440fb1de98 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.956233:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805000/0xce1582440fb1de9f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.956255:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805000/0xce1582440fb1de9f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.956266:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805000/0xce1582440fb1de9f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.956301:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804200/0xce1582440fb1dea6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.956311:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804200/0xce1582440fb1dea6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.956317:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804200/0xce1582440fb1dea6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789263755.956365:0:6487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789263755.956368:0:6487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789263755.956381:0:6487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804200/0xce1582440fb1dea6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.956409:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805c00/0xce1582440fb1de98 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.956416:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805c00/0xce1582440fb1de98 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.956423:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805c00/0xce1582440fb1de98 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.956429:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bb805c00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263755.956433:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805c00/0xce1582440fb1de98 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.956440:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805c00/0xce1582440fb1de98 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.956453:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9dd8829ed700) 00010000:00010000:2.0:1789263755.956456:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789263755.956468:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805c00/0xce1582440fb1de98 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.956472:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805c00/0xce1582440fb1de98 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.956483:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805000/0xce1582440fb1de9f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.956487:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805000/0xce1582440fb1de9f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.956491:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805000/0xce1582440fb1de9f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.956499:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bb805000 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263755.956501:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805000/0xce1582440fb1de9f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.956504:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805000/0xce1582440fb1de9f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.956509:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff9dd9ba858e00) 00010000:00010000:2.0:1789263755.956511:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789263755.956512:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805000/0xce1582440fb1de9f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.956516:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805000/0xce1582440fb1de9f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.956526:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804200/0xce1582440fb1dea6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.956529:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804200/0xce1582440fb1dea6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.956533:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804200/0xce1582440fb1dea6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.956536:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bb804200 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263755.956538:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804200/0xce1582440fb1dea6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.956541:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804200/0xce1582440fb1dea6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.956551:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd9bb596400) 00010000:00010000:2.0:1789263755.956552:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789263755.956554:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804200/0xce1582440fb1dea6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.956558:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804200/0xce1582440fb1dea6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263755.956637:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989ae0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+55:11258:x1876178888594048:12345-192.168.203.20@tcp:34:lhsmtool_posix.0 Request processed in 1911us (2111us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263755.956646:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 76 00000100:00100000:2.0:1789263755.958411:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263755.958523:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888594304 00000100:00100000:1.0:1789263755.958538:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888594304 00000100:00100000:1.0:1789263755.958610:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 77 00000100:00100000:1.0:1789263755.958623:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+55:11258:x1876178888594304:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789263755.958647:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263755.958668:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58000/0xce1582440fb1dead lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11d6b expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263755.958798:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1deb4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263755.958812:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1deb4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263755.958821:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1deb4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789263755.958847:0:6489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1789263755.958943:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1deb4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263755.958993:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1deb4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263755.958998:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1deb4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263755.959003:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883f58a00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263755.959006:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1deb4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263755.959011:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1deb4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263755.959022:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd9bb596400) 00010000:00010000:1.0:1789263755.959024:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789263755.959028:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1deb4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263755.959032:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1deb4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263755.959074:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58000/0xce1582440fb1dead lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d6b expref: 57 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263755.959123:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9dd8829ed700) 00010000:00010000:1.0:1789263755.959124:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789263755.959133:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58000/0xce1582440fb1dead lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d6b expref: 57 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263755.959141:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd883f58000, rc 0) 00000100:00100000:1.0:1789263755.959197:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+56:11258:x1876178888594304:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 579us (805us total) trans 4294967348 rc 301/301 00000100:00100000:1.0:1789263755.959203:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 77 00000100:00100000:0.0:1789263755.960783:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263755.960898:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888594432 00000100:00100000:1.0:1789263755.960907:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888594432 00000100:00100000:1.0:1789263755.960971:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 78 00000100:00100000:1.0:1789263755.960981:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989ae1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+56:11258:x1876178888594432:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789263755.961015:0:7434:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789263755.961140:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989ae1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+56:11258:x1876178888594432:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 Request processed in 161us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263755.961149:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 78 00000100:00100000:0.0:1789263755.962703:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263755.962764:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888594688 00000100:00100000:2.0:1789263755.962775:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888594688 00000100:00100000:2.0:1789263755.962846:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 79 00000100:00100000:2.0:1789263755.962858:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989ae0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+56:11258:x1876178888594688:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789263755.962877:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263755.962880:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789263755.962908:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804c00/0xce1582440fb1de6e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d5d expref: 56 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.962929:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dd8829ed600) 00010000:00010000:2.0:1789263755.962934:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789263755.962946:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805e00/0xce1582440fb1dec2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11d72 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789263755.963422:0:6487:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:2.0:1789263755.963594:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804200/0xce1582440fb1dec9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.963620:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804200/0xce1582440fb1dec9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.963632:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804200/0xce1582440fb1dec9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.963682:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805e00/0xce1582440fb1dec2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d72 expref: 58 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.963696:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804200/0xce1582440fb1dec9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d72 expref: 57 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.963706:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9dd9ba858e00) 00010000:00010000:2.0:1789263755.963709:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789263755.963712:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bb804200, rc 0) 00000100:00100000:2.0:1789263755.963776:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989ae0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+57:11258:x1876178888594688:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 921us (1081us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1789263755.963783:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 79 00000100:00100000:2.0:1789263755.965528:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263755.965574:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888594944 00000100:00100000:1.0:1789263755.965583:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888594944 00000100:00100000:1.0:1789263755.965646:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 80 00000100:00100000:1.0:1789263755.965658:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+57:11258:x1876178888594944:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789263755.965721:0:6489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789263755.965747:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804200/0xce1582440fb1dec9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d72 expref: 57 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263755.965765:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9dd9ba858e00) 00010000:00010000:1.0:1789263755.965775:0:6489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789263755.965809:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1ded7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263755.965841:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1ded7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263755.965852:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1ded7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263755.965873:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1dede lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x882b602e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263755.965878:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1dede lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x882b602e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263755.965882:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1dede lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x882b602e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263755.965924:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1ded7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263755.965932:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1ded7 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263755.965938:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1ded7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263755.965942:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883f59800 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263755.965945:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1ded7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263755.965951:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1ded7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263755.965959:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dd8829ed600) 00010000:00010000:1.0:1789263755.965968:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263755.965973:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1ded7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263755.965980:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1ded7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263755.965991:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1dede lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x882b602e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263755.965998:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1dede lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x882b602e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263755.966009:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1dede lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x882b602e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263755.966015:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883f58800 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263755.966018:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1dede lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x882b602e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263755.966033:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1dede lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x882b602e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263755.966040:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x882b602e (ffff9dd8829ed800) 00010000:00010000:1.0:1789263755.966042:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263755.966043:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1dede lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x882b602e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263755.966048:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1dede lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x882b602e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263755.966137:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+56:11258:x1876178888594944:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 Request processed in 482us (615us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789263755.966147:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 80 00000100:00100000:0.0:1789263755.967774:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263755.967839:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888595072 00000100:00100000:1.0:1789263755.967849:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888595072 00000100:00100000:1.0:1789263755.967902:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 81 00000100:00100000:1.0:1789263755.967914:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989ae3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+56:11258:x1876178888595072:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789263755.967934:0:7434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263755.967953:0:7434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1dee5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11d79 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263755.968021:0:7434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2000/0xce1582440fb1deec lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263755.968034:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2000/0xce1582440fb1deec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263755.968045:0:7434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2000/0xce1582440fb1deec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263755.968199:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1dee5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d79 expref: 58 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263755.968216:0:7434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2000/0xce1582440fb1deec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d79 expref: 57 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263755.968225:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9dd8829ede00) 00010000:00010000:1.0:1789263755.968228:0:7434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789263755.968231:0:7434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd8841a2000, rc 0) 00000100:00100000:1.0:1789263755.968288:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989ae3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+57:11258:x1876178888595072:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 377us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263755.968303:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 81 00000100:00100000:0.0:1789263755.969949:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263755.970007:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888595328 00000100:00100000:2.0:1789263755.970016:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888595328 00000100:00100000:2.0:1789263755.970074:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 82 00000100:00100000:2.0:1789263755.970111:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989ae0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+57:11258:x1876178888595328:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789263755.970208:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805c00/0xce1582440fb1def3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.970242:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805c00/0xce1582440fb1def3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.970254:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805c00/0xce1582440fb1def3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789263755.970480:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:2.0:1789263755.970492:0:6487:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 198260414810ns, next at 199260411519ns, rc = 0 00000004:00010000:2.0:1789263755.970549:0:6487:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000780f4668 reply state 00000000aeeceac8 transno 4294967350 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805c00/0xce1582440fb1def3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.970561:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805c00/0xce1582440fb1def3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.970566:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9dd8829ede00) 00010000:00010000:2.0:1789263755.970569:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1789263755.970571:0:6487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789263755.970657:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989ae0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+59:11258:x1876178888595328:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 Request processed in 551us (718us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1789263755.970662:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 82 00000100:00100000:2.0:1789263755.972074:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263755.972145:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888595456 00000100:00100000:1.0:1789263755.972155:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888595456 00000100:00100000:1.0:1789263755.972209:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 83 00000100:00100000:1.0:1789263755.972220:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+59:11258:x1876178888595456:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789263755.972254:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263755.972273:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2400/0xce1582440fb1defa lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11d80 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263755.972324:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2400/0xce1582440fb1defa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d80 expref: 60 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263755.972338:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2400/0xce1582440fb1defa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d80 expref: 60 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263755.972356:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9dd8829ede00) 00010000:00010000:1.0:1789263755.972359:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789263755.972362:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd8841a2400, rc 0) 00000100:00100000:1.0:1789263755.972415:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+60:11258:x1876178888595456:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 197us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263755.972422:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 83 00000100:00100000:0.0:1789263755.973578:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263755.973626:0:8395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888595584 00000100:00100000:1.0:1789263755.973633:0:8395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888595584 00000100:00100000:1.0:1789263755.973681:0:8395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 32 00000100:00100000:1.0:1789263755.973689:0:8395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989ae1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2396:x1876178888595584:12345-192.168.203.20@tcp:8:lhsmtool_posix.0 00010000:00080000:1.0:1789263755.973723:0:8395:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 3ce90ea2-917f-4b54-98b0-25e051f2317f@192.168.203.20@tcp t0 exp 0000000000000000 cur 198 last 0 00000020:00000080:1.0:1789263755.973774:0:8395:0:(genops.c:1385:class_connect()) connect: client 3ce90ea2-917f-4b54-98b0-25e051f2317f, cookie 0xce1582440fb1df01 00002000:00100000:1.0:1789263755.973801:0:8395:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3ce90ea2-917f-4b54-98b0-25e051f2317f/ffff9dd88400f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789263755.973814:0:8395:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789263755.973908:0:8395:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789263755.973953:0:8395:0:(import.c:65:import_set_state_nolock()) ffff9dd883886800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789263755.974012:0:8395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989ae1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+6:2396:x1876178888595584:12345-192.168.203.20@tcp:8:lhsmtool_posix.0 Request processed in 323us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263755.974021:0:8395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 32 00000100:00100000:0.0:1789263755.975054:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263755.975176:0:8394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888595712 00000100:00100000:3.0:1789263755.975186:0:8394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888595712 00000100:00080000:2.0:1789263755.975245:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789263755.975265:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 33 00000100:00100000:3.0:1789263755.975278:0:8394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989ae3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+6:0:x1876178888595712:12345-192.168.203.20@tcp:2:lhsmtool_posix.0 00000001:00080000:1.0:1789263755.976484:0:8388:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00100000:1.0:1789263755.976496:0:8388:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3ce90ea2-917f-4b54-98b0-25e051f2317f 00000100:00100000:3.0:1789263755.976615:0:8394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989ae3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+5:0:x1876178888595712:12345-192.168.203.20@tcp:2:lhsmtool_posix.0 Request processed in 1339us (1566us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1789263755.976621:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 33 00000100:00100000:2.0:1789263755.977819:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263755.977908:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888595968 00000100:00100000:3.0:1789263755.977916:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888595968 00000100:00100000:3.0:1789263755.977960:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 16 00000100:00100000:3.0:1789263755.977978:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+60:11258:x1876178888595968:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789263755.978193:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+61:11258:x1876178888595968:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 Request processed in 216us (375us total) trans 4294967351 rc 0/0 00000100:00100000:3.0:1789263755.978201:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 16 00000100:00100000:0.0:1789263755.979446:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263755.979487:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888596224 00000100:00100000:1.0:1789263755.979494:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888596224 00000100:00100000:1.0:1789263755.979536:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 84 00000100:00100000:1.0:1789263755.979544:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989ae0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+61:11258:x1876178888596224:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789263755.979621:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989ae0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+61:11258:x1876178888596224:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 Request processed in 77us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263755.979630:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 84 00000100:00100000:0.0:1789263755.980707:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263755.980756:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888596352 00000100:00100000:2.0:1789263755.980762:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888596352 00000100:00100000:2.0:1789263755.980806:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 85 00000100:00100000:2.0:1789263755.980815:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989ae3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+61:11258:x1876178888596352:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789263755.980826:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263755.980852:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804c00/0xce1582440fb1df08 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11d87 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.980913:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805400/0xce1582440fb1df0f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.980923:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805400/0xce1582440fb1df0f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.980931:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805400/0xce1582440fb1df0f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789263755.980960:0:6487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789263755.980972:0:6487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805400/0xce1582440fb1df0f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.980995:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804c00/0xce1582440fb1df08 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d87 expref: 63 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.981011:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805400/0xce1582440fb1df0f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d87 expref: 62 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.981020:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9dd8829ede00) 00010000:00010000:2.0:1789263755.981022:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789263755.981025:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bb805400, rc 0) 00000100:00100000:2.0:1789263755.981065:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989ae3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+62:11258:x1876178888596352:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 253us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263755.981070:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 85 00000100:00100000:2.0:1789263755.982386:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263755.983016:0:13766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888596480 00000100:00100000:3.0:1789263755.983024:0:13766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888596480 00000100:00100000:3.0:1789263755.983069:0:13766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 34 00000100:00100000:3.0:1789263755.983098:0:13766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+5:2398:x1876178888596480:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789263755.983116:0:13766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263755.983133:0:13766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fce086e6/0xce1582440fb1df16 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11d8e expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789263755.983156:0:13766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa5ff8c, blocks: 0x0 00010000:00010000:3.0:1789263755.983172:0:13766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=198s v=(0 0) 00010000:00010000:3.0:1789263755.983177:0:13766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789263755.983185:0:13766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fce086e6/0xce1582440fb1df16 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d8e expref: 6 pid: 13766 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263755.983198:0:13766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fce086e6/0xce1582440fb1df16 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d8e expref: 6 pid: 13766 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263755.983206:0:13766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981530a00, rc 0) 00000100:00100000:3.0:1789263755.983239:0:13766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+6:2398:x1876178888596480:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 164us (855us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263755.983244:0:13766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 34 00000100:00100000:0.0:1789263755.984602:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263755.984652:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888596736 00000100:00100000:1.0:1789263755.984659:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888596736 00000100:00100000:1.0:1789263755.984700:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 86 00000100:00100000:1.0:1789263755.984709:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989ae2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+62:11258:x1876178888596736:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789263755.984781:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989ae2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+62:11258:x1876178888596736:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 Request processed in 72us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263755.984800:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 86 00000100:00100000:0.0:1789263755.986215:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263755.986271:0:8395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888596864 00000100:00100000:1.0:1789263755.986289:0:8395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888596864 00000100:00100000:1.0:1789263755.986334:0:8395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 35 00000100:00100000:1.0:1789263755.986343:0:8395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989ae1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+6:11258:x1876178888596864:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789263755.986358:0:8395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263755.986377:0:8395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f5e2071d/0xce1582440fb1df1d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11d95 expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263755.986418:0:8395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fce086e6/0xce1582440fb1df16 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d8e expref: 7 pid: 13766 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263755.986427:0:8395:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789263755.986431:0:8395:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789263755.986439:0:8395:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5e2071d/0xce1582440fb1df1d lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d95 expref: 7 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263755.986471:0:8395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fce086e6/0xce1582440fb1df16 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d8e expref: 7 pid: 13766 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263755.986485:0:8395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fce086e6/0xce1582440fb1df16 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d8e expref: 7 pid: 13766 timeout: 298 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263755.986499:0:8395:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8395:1876178898083584:192.168.203.20@tcp:104: 00000100:00100000:1.0:1789263755.986578:0:8395:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd98a6fb9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789263755.988130:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263755.988148:0:8395:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8395:1876178898083584:192.168.203.20@tcp:104: 00010000:00010000:1.0:1789263755.988203:0:8395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f5e2071d/0xce1582440fb1df1d lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d95 expref: 7 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263755.988210:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888596992 00000100:00100000:0.0:1789263755.988220:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888596992 00010000:00010000:1.0:1789263755.988248:0:8395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd8841a3000, rc 0) 00010000:00010000:0.0:1789263755.988256:0:6473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fce086e6/0xce1582440fb1df16 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d8e expref: 8 pid: 13766 timeout: 298 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263755.988310:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 55 00000100:00100000:1.0:1789263755.988319:0:8395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989ae1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+8:11258:x1876178888596864:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 1974us (2104us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263755.988329:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+8:2398:x1876178888596992:12345-192.168.203.20@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1789263755.988340:0:8395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 35 00010000:00010000:0.0:1789263755.988346:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789263755.988368:0:6473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fce086e6/0xce1582440fb1df16 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d8e expref: 7 pid: 13766 timeout: 298 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263755.988387:0:6473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fce086e6/0xce1582440fb1df16 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d8e expref: 7 pid: 13766 timeout: 298 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263755.988408:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fce086e6/0xce1582440fb1df16 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d8e expref: 7 pid: 13766 timeout: 298 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263755.988422:0:6473:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789263755.988426:0:6473:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789263755.988434:0:6473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f5e2071d/0xce1582440fb1df1d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d95 expref: 6 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263755.988444:0:6473:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5e2071d/0xce1582440fb1df1d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d95 expref: 6 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263755.988475:0:6473:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f5e2071d/0xce1582440fb1df1d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d95 expref: 6 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263755.988490:0:6473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989ae1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6473:1876178898083712:192.168.203.20@tcp:105: 00000100:00100000:0.0:1789263755.988558:0:6473:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd983852cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789263755.989691:0:6473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989ae1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6473:1876178898083712:192.168.203.20@tcp:105: 00010000:00010000:0.0:1789263755.989709:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789263755.989753:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+6:2398:x1876178888596992:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 1433us (1634us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263755.989762:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 55 00000100:00100000:2.0:1789263755.990597:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263755.990675:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888597120 00000100:00100000:3.0:1789263755.990682:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888597120 00002000:00100000:3.0:1789263755.990723:0:8400:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9dd9bfa90e00 x1876178888597120/t0(0) o4->3ce90ea2-917f-4b54-98b0-25e051f2317f@192.168.203.20@tcp:591/0 lens 504/0 e 0 to 0 dl 1789263766 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789263755.990742:0:8400:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dd9bfa90e00 with x1876178888597120 ext(0->8) 00002000:00010000:3.0:1789263755.990747:0:8400:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dd9bfa90e00 00000100:00100000:3.0:1789263755.990774:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 0 00000100:00100000:3.0:1789263755.990782:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+6:2398:x1876178888597120:12345-192.168.203.20@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789263755.991646:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+8:2398:x1876178888597120:12345-192.168.203.20@tcp:4:lhsmtool_posix.0 Request processed in 853us (1039us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1789263755.991656:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 0 00002000:00100000:3.0:1789263755.991663:0:8400:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9dd9bfa90e00 x1876178888597120/t4294967303(0) o4->3ce90ea2-917f-4b54-98b0-25e051f2317f@192.168.203.20@tcp:591/0 lens 504/448 e 0 to 0 dl 1789263766 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789263755.991673:0:8400:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dd9bfa90e00 with x1876178888597120 ext(0->8) 00002000:00010000:3.0:1789263755.991687:0:8400:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dd9bfa90e00 00000100:00100000:3.0:1789263755.993170:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263755.993284:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888597248 00000100:00100000:1.0:1789263755.993296:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888597248 00000100:00100000:1.0:1789263755.993362:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 87 00000100:00100000:1.0:1789263755.993385:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+62:11258:x1876178888597248:12345-192.168.203.20@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789263755.995467:0:6466:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967351 is committed 00000004:00080000:3.0:1789263755.995482:0:6466:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00010000:00010000:1.0:1789263755.995535:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58400/0xce1582440fb1dc45 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263755.995553:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58400/0xce1582440fb1dc45 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789263755.995557:0:6466:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:1.0:1789263755.995573:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58400/0xce1582440fb1dc45 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263755.995583:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883f58400 already unused, calling callback (ffffffffc18c14f0) 00000020:00080000:3.0:1789263755.995586:0:6466:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9dd9b7996180 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1789263755.995591:0:6466:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9dd883f84900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9dd9b79966c0 00010000:00010000:1.0:1789263755.995591:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58400/0xce1582440fb1dc45 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263755.995603:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000020:00080000:3.0:1789263755.995608:0:6466:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9dd883f84600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9dd881f6ec00 00010000:00010000:1.0:1789263755.995629:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58400/0xce1582440fb1dc45 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263755.995638:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989ae1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898083840:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1789263755.995665:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9dd8829edb00) 00010000:00010000:1.0:1789263755.995671:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000020:00080000:3.0:1789263755.995673:0:6519:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00010000:00010000:1.0:1789263755.995678:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58400/0xce1582440fb1dc45 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263755.995700:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58400/0xce1582440fb1dc45 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263755.995713:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789263755.995739:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59e00/0xce1582440fb1dc4c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263755.995746:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59e00/0xce1582440fb1dc4c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263755.995753:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59e00/0xce1582440fb1dc4c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263755.995760:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883f59e00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263755.995766:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59e00/0xce1582440fb1dc4c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263755.995771:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898083968:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1789263755.995777:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59e00/0xce1582440fb1dc4c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263755.995804:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dd8829ed600) 00000100:00100000:2.0:1789263755.995805:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+21:11258:x1876178888597248:12345-192.168.203.20@tcp:44:lhsmtool_posix.0 Request processed in 2416us (2627us total) trans 0 rc 0/0 00010000:00010000:1.0:1789263755.995816:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263755.995820:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59e00/0xce1582440fb1dc4c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263755.995828:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59e00/0xce1582440fb1dc4c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263755.995829:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 87 00000020:00080000:3.0:1789263755.995833:0:6519:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1789263755.995845:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789263755.995869:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981682200/0xce1582440fb1dc8b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263755.995878:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981682200/0xce1582440fb1dc8b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263755.995893:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981682200/0xce1582440fb1dc8b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263755.995894:0:8392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898083840 00010000:00010000:1.0:1789263755.995900:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981682200 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263755.995906:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981682200/0xce1582440fb1dc8b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263755.995911:0:8392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898083840 00000100:00100000:0.0:1789263755.995912:0:8394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898083968 00010000:00010000:1.0:1789263755.995918:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981682200/0xce1582440fb1dc8b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263755.995920:0:8394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898083968 00010000:00010000:1.0:1789263755.995938:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9dd8829ed000) 00010000:00010000:1.0:1789263755.995942:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263755.995946:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981682200/0xce1582440fb1dc8b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263755.995953:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981682200/0xce1582440fb1dc8b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263755.995969:0:8392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00010000:00010000:1.0:1789263755.995982:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1dda3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263755.995990:0:8392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bb95fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1876178898083840:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789263755.995992:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789263755.996015:0:8394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882a6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3621:x1876178898083968:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1789263755.996017:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1dda3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263755.996033:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1dda3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263755.996039:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981531600 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263755.996042:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1dda3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1789263755.996047:0:8394:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00010000:00010000:1.0:1789263755.996064:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1dda3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263755.996123:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd9bb596400) 00002000:00010000:0.0:1789263755.996125:0:8394:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 13, mtime: 0x6aa5ff8a, atime: 0x6aa5ff8b, ctime: 0x6aa5ff8a, blocks: 0x8 00010000:00010000:1.0:1789263755.996126:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263755.996131:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1dda3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263755.996144:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1dda3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263755.996145:0:8394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cd40203/0xce1582440fb1df24 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263755.996170:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432200/0xce1582440fb1ddc6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263755.996171:0:8394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=198s v=(0 0) 00010000:00010000:1.0:1789263755.996188:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432200/0xce1582440fb1ddc6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263755.996191:0:8394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789263755.996195:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432200/0xce1582440fb1ddc6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263755.996202:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd990432200 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263755.996204:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432200/0xce1582440fb1ddc6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789263755.996208:0:8392:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00010000:00010000:1.0:1789263755.996208:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432200/0xce1582440fb1ddc6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263755.996212:0:8394:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007cd40203/0xce1582440fb1df24 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789263755.996226:0:8392:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1789263756 00010000:00010000:1.0:1789263755.996238:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd9bb596400) 00002000:00010000:3.0:1789263755.996241:0:8392:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00010000:00010000:1.0:1789263755.996243:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263755.996251:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432200/0xce1582440fb1ddc6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789263755.996252:0:8392:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789263756 -> 1789263756 00002000:00010000:3.0:1789263755.996262:0:8392:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1789263755.996268:0:8394:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007cd40203/0xce1582440fb1df24 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263755.996305:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432200/0xce1582440fb1ddc6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263755.996312:0:8394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cd40203/0xce1582440fb1df24 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263755.996320:0:8392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bb95fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3621:x1876178898083840:12345-0@lo:2:osp-syn-0-0.0 Request processed in 338us (608us total) trans 4294967304 rc 0/0 00010000:00010000:0.0:1789263755.996327:0:8394:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007cd40203/0xce1582440fb1df24 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263755.996329:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1ddfe lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263755.996338:0:8392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000004:00080000:2.0:1789263755.996357:0:3621:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9dd989ae1f80/2, rc 0, transno 4294967304 00010000:00010000:1.0:1789263755.996364:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1ddfe lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263755.996369:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989ae1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898083840:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1789263755.996373:0:8394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789263755.996385:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1ddfe lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263755.996395:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981530e00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263755.996403:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1ddfe lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.996404:0:13146:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789263755.996420:0:13146:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007cd40203/0xce1582440fb1df24 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263755.996423:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1ddfe lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.996462:0:13146:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883e73200 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:2.0:1789263755.996469:0:13146:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007cd40203/0xce1582440fb1df24 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263755.996472:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd9bb596400) 00010000:00010000:1.0:1789263755.996477:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263755.996483:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1ddfe lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263755.996493:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1ddfe lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.996495:0:13146:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007cd40203/0xce1582440fb1df24 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263755.996524:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805c00/0xce1582440fb1def3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263755.996524:0:8394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882a6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3621:x1876178898083968:12345-0@lo:6:osp-syn-1-0.0 Request processed in 514us (682us total) trans 4294967302 rc 0/0 00010000:00010000:2.0:1789263755.996530:0:13146:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007cd40203/0xce1582440fb1df24 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263755.996558:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:1.0:1789263755.996565:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805c00/0xce1582440fb1def3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.996570:0:13146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007cd40203/0xce1582440fb1df24 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263755.996585:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805c00/0xce1582440fb1def3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263755.996594:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bb805c00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263755.996598:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805c00/0xce1582440fb1def3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789263755.996601:0:3621:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9dd9bfa93480/2, rc 0, transno 4294967302 00010000:00010000:2.0:1789263755.996604:0:13146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263755.996606:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805c00/0xce1582440fb1def3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263755.996609:0:13146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789263755.996612:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898083968:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1789263755.996613:0:13146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263755.996634:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9dd8829ede00) 00010000:00010000:1.0:1789263755.996637:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789263755.996640:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805c00/0xce1582440fb1def3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263755.996647:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805c00/0xce1582440fb1def3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263755.997166:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263755.997211:0:8395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888597376 00000100:00100000:1.0:1789263755.997221:0:8395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888597376 00000100:00100000:1.0:1789263755.997271:0:8395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 38 00000100:00100000:1.0:1789263755.997282:0:8395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+8:2397:x1876178888597376:12345-192.168.203.20@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1789263755.998352:0:8388:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:2.0:1789263755.998364:0:8388:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:1.0:1789263755.998529:0:8395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+6:2397:x1876178888597376:12345-192.168.203.20@tcp:16:lhsmtool_posix.0 Request processed in 1243us (1358us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263755.998540:0:8395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 38 00000100:00100000:2.0:1789263755.999918:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263755.999982:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888597632 00000100:00100000:0.0:1789263755.999991:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888597632 00000100:00100000:0.0:1789263756.000050:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 88 00000100:00100000:0.0:1789263756.000060:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+15:11258:x1876178888597632:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789263756.000137:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789263756.000160:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805400/0xce1582440fb1df0f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d87 expref: 15 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263756.000174:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9dd8829ede00) 00010000:00010000:0.0:1789263756.000177:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789263756.000199:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73000/0xce1582440fb1df2b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263756.000222:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73000/0xce1582440fb1df2b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263756.000230:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73000/0xce1582440fb1df2b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789263756.000332:0:6487:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008bfc0917 reply state 000000008a523d8c transno 4294967352 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73000/0xce1582440fb1df2b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263756.000344:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73000/0xce1582440fb1df2b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263756.000350:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9dd8829ede00) 00010000:00010000:0.0:1789263756.000353:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789263756.000356:0:6487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789263756.000454:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+16:11258:x1876178888597632:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 Request processed in 396us (540us total) trans 4294967352 rc 0/0 00000100:00100000:0.0:1789263756.000462:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 88 00000100:00100000:3.0:1789263756.001351:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263756.001394:0:8511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888597760 00000100:00100000:2.0:1789263756.001399:0:8511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888597760 00000100:00100000:2.0:1789263756.001429:0:8511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 39 00000100:00100000:2.0:1789263756.001437:0:8511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+6:2397:x1876178888597760:12345-192.168.203.20@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789263756.001545:0:8511:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1789263756.001547:0:8511:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789263756 -> 1789263755 00002000:00010000:2.0:1789263756.001549:0:8511:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1789263755 00002000:00010000:2.0:1789263756.001551:0:8511:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789263756 -> 1789263755 00002000:00010000:2.0:1789263756.001552:0:8511:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1789263756.001590:0:8511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+7:2397:x1876178888597760:12345-192.168.203.20@tcp:2:lhsmtool_posix.0 Request processed in 153us (240us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1789263756.001597:0:8511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 39 00000100:00100000:2.0:1789263756.002631:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263756.002695:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888598016 00000100:00100000:1.0:1789263756.002702:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888598016 00000100:00100000:1.0:1789263756.002743:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 89 00000100:00100000:1.0:1789263756.002752:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+16:11258:x1876178888598016:12345-192.168.203.20@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1789263756.002823:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3e00/0xce1582440fb1df32 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263756.002839:0:6489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2000/0xce1582440fb1deec lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d79 expref: 16 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263756.002848:0:6489:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3e00/0xce1582440fb1df32 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263756.002874:0:6489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2000/0xce1582440fb1deec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d79 expref: 16 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263756.002885:0:6489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2000/0xce1582440fb1deec lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d79 expref: 16 pid: 7434 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263756.002898:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6489:1876178898084096:192.168.203.20@tcp:104: 00000100:00100000:1.0:1789263756.002963:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd98a6fb9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789263756.004011:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263756.004014:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6489:1876178898084096:192.168.203.20@tcp:104: 00010000:00010000:1.0:1789263756.004036:0:6489:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3e00/0xce1582440fb1df32 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263756.004136:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888598144 00000100:00100000:3.0:1789263756.004142:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888598144 00010000:00010000:3.0:1789263756.004166:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2000/0xce1582440fb1deec lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d79 expref: 17 pid: 7434 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263756.004210:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 56 00000100:00100000:3.0:1789263756.004219:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98fe87c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+17:2398:x1876178888598144:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789263756.004230:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789263756.004236:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2000/0xce1582440fb1deec lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d79 expref: 17 pid: 7434 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263756.004248:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2000/0xce1582440fb1deec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d79 expref: 17 pid: 7434 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263756.004279:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2000/0xce1582440fb1deec lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d79 expref: 17 pid: 7434 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263756.004307:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9dd8829ede00) 00010000:00010000:3.0:1789263756.004313:0:6474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3e00/0xce1582440fb1df32 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263756.004320:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3e00/0xce1582440fb1df32 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263756.004327:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3e00/0xce1582440fb1df32 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263756.004350:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789263756.004382:0:6489:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3e00/0xce1582440fb1df32 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263756.004391:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3e00/0xce1582440fb1df32 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263756.004421:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3e00/0xce1582440fb1df32 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263756.004440:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3e00/0xce1582440fb1df32 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263756.004447:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3e00/0xce1582440fb1df32 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263756.004451:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98fe87c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+16:2398:x1876178888598144:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 231us (442us total) trans 0 rc 0/0 00010000:00010000:1.0:1789263756.004458:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd8841a3e00 already unused, calling callback (ffffffffc18c14f0) 00000100:00100000:3.0:1789263756.004464:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 56 00010000:00010000:1.0:1789263756.004465:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3e00/0xce1582440fb1df32 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263756.004475:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3e00/0xce1582440fb1df32 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263756.004487:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9dd8829ede00) 00010000:00010000:1.0:1789263756.004490:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1789263756.004495:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3e00/0xce1582440fb1df32 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263756.004502:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3e00/0xce1582440fb1df32 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263756.004540:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+15:11258:x1876178888598016:12345-192.168.203.20@tcp:55:lhsmtool_posix.0 Request processed in 1789us (1911us total) trans 0 rc -22/-22 00000100:00100000:1.0:1789263756.004548:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 89 00000100:00100000:3.0:1789263756.005579:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263756.005648:0:8394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888598272 00000100:00100000:0.0:1789263756.005654:0:8394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888598272 00000100:00100000:0.0:1789263756.005691:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 40 00000100:00100000:0.0:1789263756.005700:0:8394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+7:2399:x1876178888598272:12345-192.168.203.20@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789263756.005735:0:8394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c2b5897a/0xce1582440fb1df39 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263756.005754:0:8394:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f5e2071d/0xce1582440fb1df1d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d95 expref: 7 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263756.005777:0:8394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789263756.005782:0:8394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789263756.005800:0:8394:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2b5897a/0xce1582440fb1df39 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263756.005830:0:8394:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f5e2071d/0xce1582440fb1df1d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d95 expref: 7 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263756.005844:0:8394:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f5e2071d/0xce1582440fb1df1d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d95 expref: 7 pid: 8395 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263756.005858:0:8394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882a6c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8394:1876178898084224:192.168.203.20@tcp:104: 00000100:00100000:0.0:1789263756.005927:0:8394:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd983852600 going to sleep for 11 seconds 00000100:00100000:0.0:1789263756.007000:0:8394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882a6c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8394:1876178898084224:192.168.203.20@tcp:104: 00010000:00010000:0.0:1789263756.007021:0:8394:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c2b5897a/0xce1582440fb1df39 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263756.007506:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263756.007589:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888598400 00000100:00100000:1.0:1789263756.007596:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888598400 00010000:00010000:1.0:1789263756.007620:0:6472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f5e2071d/0xce1582440fb1df1d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d95 expref: 8 pid: 8395 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263756.007644:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 57 00000100:00100000:1.0:1789263756.007659:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff78380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+8:2398:x1876178888598400:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789263756.007669:0:6472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789263756.007684:0:6472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f5e2071d/0xce1582440fb1df1d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d95 expref: 8 pid: 8395 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263756.007693:0:6472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f5e2071d/0xce1582440fb1df1d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d95 expref: 8 pid: 8395 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263756.007710:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5e2071d/0xce1582440fb1df1d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d95 expref: 8 pid: 8395 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263756.007724:0:6472:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789263756.007728:0:6472:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789263756.007733:0:6472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c2b5897a/0xce1582440fb1df39 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263756.007741:0:6472:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2b5897a/0xce1582440fb1df39 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263756.007766:0:6472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789263756.007794:0:8394:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c2b5897a/0xce1582440fb1df39 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263756.007806:0:8394:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2b5897a/0xce1582440fb1df39 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263756.007822:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff78380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+7:2398:x1876178888598400:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 161us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263756.007831:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 57 00010000:00010000:0.0:1789263756.007831:0:8394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c2b5897a/0xce1582440fb1df39 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263756.007848:0:8394:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2b5897a/0xce1582440fb1df39 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263756.007857:0:8394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2b5897a/0xce1582440fb1df39 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263756.007865:0:8394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883e72800 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:0.0:1789263756.007870:0:8394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2b5897a/0xce1582440fb1df39 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263756.007877:0:8394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2b5897a/0xce1582440fb1df39 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263756.007887:0:8394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2b5897a/0xce1582440fb1df39 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263756.007892:0:8394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2b5897a/0xce1582440fb1df39 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263756.007941:0:8394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+6:2399:x1876178888598272:12345-192.168.203.20@tcp:1:lhsmtool_posix.0 Request processed in 2243us (2370us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263756.007950:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 40 00000100:00100000:3.0:1789263756.009124:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263756.009179:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888598656 00000100:00100000:2.0:1789263756.009184:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888598656 00000100:00100000:2.0:1789263756.009216:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 90 00000100:00100000:2.0:1789263756.009225:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+15:11258:x1876178888598656:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789263756.009288:0:7434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804000/0xce1582440fb1df40 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263756.009302:0:7434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1dd9c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d2c expref: 15 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263756.009311:0:7434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804000/0xce1582440fb1df40 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263756.009350:0:7434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1dd9c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d2c expref: 15 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263756.009362:0:7434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1dd9c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d2c expref: 15 pid: 8417 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263756.009375:0:7434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa93800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7434:1876178898084352:192.168.203.20@tcp:104: 00000100:00100000:2.0:1789263756.009434:0:7434:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9c09d7480 going to sleep for 11 seconds 00000100:00100000:1.0:1789263756.010367:0:7434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa93800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7434:1876178898084352:192.168.203.20@tcp:104: 00010000:00010000:1.0:1789263756.010405:0:7434:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804000/0xce1582440fb1df40 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263756.010645:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263756.010715:0:10303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888598784 00000100:00100000:2.0:1789263756.010720:0:10303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888598784 00010000:00010000:2.0:1789263756.010744:0:10303:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1dd9c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d2c expref: 16 pid: 8417 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263756.010775:0:10303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 58 00000100:00100000:2.0:1789263756.010783:0:10303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3ce90ea2-917f-4b54-98b0-25e051f2317f+16:2397:x1876178888598784:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789263756.010804:0:10303:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789263756.010810:0:10303:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1dd9c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d2c expref: 16 pid: 8417 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263756.010821:0:10303:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1dd9c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d2c expref: 16 pid: 8417 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263756.010838:0:10303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1dd9c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d2c expref: 16 pid: 8417 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263756.010851:0:10303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd9bb596400) 00010000:00010000:2.0:1789263756.010861:0:10303:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804000/0xce1582440fb1df40 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263756.010869:0:10303:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804000/0xce1582440fb1df40 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263756.010874:0:10303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804000/0xce1582440fb1df40 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263756.010896:0:10303:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789263756.010924:0:7434:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804000/0xce1582440fb1df40 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263756.010934:0:7434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804000/0xce1582440fb1df40 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263756.010936:0:10303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3ce90ea2-917f-4b54-98b0-25e051f2317f+15:2397:x1876178888598784:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 152us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263756.010954:0:10303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 58 00010000:00010000:1.0:1789263756.011150:0:7434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3200/0xce1582440fb1df47 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263756.011163:0:7434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2400/0xce1582440fb1defa lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d80 expref: 15 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263756.011170:0:7434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3200/0xce1582440fb1df47 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263756.011193:0:7434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2400/0xce1582440fb1defa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d80 expref: 15 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263756.011206:0:7434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2400/0xce1582440fb1defa lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d80 expref: 15 pid: 6489 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263756.011217:0:7434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7434:1876178898084480:192.168.203.20@tcp:104: 00000100:00100000:1.0:1789263756.011249:0:7434:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd98a6fb0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789263756.012129:0:7434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7434:1876178898084480:192.168.203.20@tcp:104: 00010000:00010000:1.0:1789263756.012152:0:7434:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3200/0xce1582440fb1df47 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263756.012326:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263756.012392:0:7428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888598912 00000100:00100000:1.0:1789263756.012405:0:7428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888598912 00010000:00010000:1.0:1789263756.012426:0:7428:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2400/0xce1582440fb1defa lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d80 expref: 16 pid: 6489 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263756.012457:0:7428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 59 00000100:00100000:1.0:1789263756.012466:0:7428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+16:2397:x1876178888598912:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789263756.012476:0:7428:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789263756.012481:0:7428:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2400/0xce1582440fb1defa lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d80 expref: 16 pid: 6489 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263756.012491:0:7428:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2400/0xce1582440fb1defa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d80 expref: 16 pid: 6489 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263756.012506:0:7428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2400/0xce1582440fb1defa lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d80 expref: 16 pid: 6489 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263756.012518:0:7428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9dd8829ede00) 00010000:00010000:1.0:1789263756.012522:0:7428:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3200/0xce1582440fb1df47 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263756.012529:0:7428:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3200/0xce1582440fb1df47 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263756.012534:0:7428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3200/0xce1582440fb1df47 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263756.012556:0:7428:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789263756.012578:0:7434:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3200/0xce1582440fb1df47 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263756.012585:0:7434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3200/0xce1582440fb1df47 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263756.012592:0:7428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+15:2397:x1876178888598912:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 127us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263756.012609:0:7428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 59 00000001:00080000:2.0:1789263756.012662:0:7434:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967353 00000001:00080000:2.0:1789263756.012751:0:7434:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967354 00000001:00080000:2.0:1789263756.012797:0:7434:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967355 00000100:00100000:2.0:1789263756.012865:0:7434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8838f1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7434:1876178898084608:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789263756.012904:0:7434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263756.012933:0:7434:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd98615ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1789263756.012946:0:8499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898084608 00000100:00100000:3.0:1789263756.012953:0:8499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898084608 00000100:00100000:3.0:1789263756.012989:0:8499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789263756.012997:0:8499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8838f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7434:x1876178898084608:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789263756.013066:0:8499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8838f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7434:x1876178898084608:12345-0@lo:1000:mdt00_003.0 Request processed in 70us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263756.013103:0:8499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789263756.013129:0:7434:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1789263756.013136:0:7434:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9dd989ae1f80, transno 4294967304 00000100:00100000:2.0:1789263756.013156:0:7434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8838f1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7434:1876178898084608:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1789263756.013279:0:7434:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000100:00100000:2.0:1789263756.013333:0:7434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8838f1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7434:1876178898084736:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789263756.013371:0:7434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263756.013391:0:7434:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd882684840 going to sleep for 11 seconds 00000100:00100000:3.0:1789263756.013424:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898084736 00000100:00100000:3.0:1789263756.013429:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898084736 00000100:00100000:3.0:1789263756.013470:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789263756.013478:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8838f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7434:x1876178898084736:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789263756.013584:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8838f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7434:x1876178898084736:12345-0@lo:1000:mdt00_003.0 Request processed in 106us (211us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1789263756.013591:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789263756.013614:0:7434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8838f1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7434:1876178898084736:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1789263756.013649:0:7434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3200/0xce1582440fb1df47 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263756.013659:0:7434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3200/0xce1582440fb1df47 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263756.013668:0:7434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3200/0xce1582440fb1df47 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263756.013675:0:7434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd8841a3200 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263756.013680:0:7434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3200/0xce1582440fb1df47 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263756.013689:0:7434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3200/0xce1582440fb1df47 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263756.013698:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9dd8829ede00) 00010000:00010000:1.0:1789263756.013701:0:7434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789263756.013704:0:7434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3200/0xce1582440fb1df47 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263756.013708:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3200/0xce1582440fb1df47 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263756.013728:0:7434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804a00/0xce1582440fb1de75 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263756.013732:0:7434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804a00/0xce1582440fb1de75 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263756.013741:0:7434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804a00/0xce1582440fb1de75 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263756.013745:0:7434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bb804a00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263756.013746:0:7434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804a00/0xce1582440fb1de75 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263756.013750:0:7434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804a00/0xce1582440fb1de75 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263756.013757:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd9bb596400) 00010000:00010000:1.0:1789263756.013760:0:7434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789263756.013763:0:7434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804a00/0xce1582440fb1de75 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263756.013768:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804a00/0xce1582440fb1de75 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263756.013824:0:7434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3e00/0xce1582440fb1df4e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263756.013837:0:7434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73e00/0xce1582440fb1de91 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d64 expref: 18 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263756.013845:0:7434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3e00/0xce1582440fb1df4e lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263756.013865:0:7434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73e00/0xce1582440fb1de91 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d64 expref: 18 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263756.013888:0:7434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73e00/0xce1582440fb1de91 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d64 expref: 18 pid: 6487 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263756.013899:0:7434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7434:1876178898084864:192.168.203.20@tcp:104: 00000100:00100000:1.0:1789263756.013952:0:7434:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd98a6fb240 going to sleep for 11 seconds 00000100:00100000:1.0:1789263756.016129:0:7434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7434:1876178898084864:192.168.203.20@tcp:104: 00010000:00010000:1.0:1789263756.016155:0:7434:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3e00/0xce1582440fb1df4e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263756.016714:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263756.016754:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888599040 00000100:00100000:2.0:1789263756.016762:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888599040 00010000:00010000:2.0:1789263756.016807:0:8409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73e00/0xce1582440fb1de91 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d64 expref: 19 pid: 6487 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263756.016846:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 60 00000100:00100000:2.0:1789263756.016861:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882a6c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+19:2397:x1876178888599040:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789263756.016876:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789263756.016882:0:8409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73e00/0xce1582440fb1de91 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d64 expref: 19 pid: 6487 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263756.016893:0:8409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73e00/0xce1582440fb1de91 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d64 expref: 19 pid: 6487 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263756.016914:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73e00/0xce1582440fb1de91 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d64 expref: 19 pid: 6487 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263756.016928:0:8409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd9bb596400) 00010000:00010000:2.0:1789263756.016934:0:8409:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3e00/0xce1582440fb1df4e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263756.016956:0:8409:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3e00/0xce1582440fb1df4e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263756.016963:0:8409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3e00/0xce1582440fb1df4e lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263756.017004:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789263756.017031:0:7434:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3e00/0xce1582440fb1df4e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263756.017040:0:7434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3e00/0xce1582440fb1df4e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263756.017051:0:7434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3e00/0xce1582440fb1df4e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263756.017053:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882a6c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+18:2397:x1876178888599040:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 198us (339us total) trans 0 rc 0/0 00010000:00010000:1.0:1789263756.017064:0:7434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3e00/0xce1582440fb1df4e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263756.017070:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 60 00010000:00010000:1.0:1789263756.017102:0:7434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3e00/0xce1582440fb1df4e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263756.017111:0:7434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd8841a3e00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263756.017115:0:7434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3e00/0xce1582440fb1df4e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263756.017122:0:7434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3e00/0xce1582440fb1df4e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263756.017139:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd9bb596400) 00010000:00010000:1.0:1789263756.017141:0:7434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263756.017145:0:7434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3e00/0xce1582440fb1df4e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263756.017150:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3e00/0xce1582440fb1df4e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263756.017161:0:7434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804000/0xce1582440fb1df40 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263756.017166:0:7434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804000/0xce1582440fb1df40 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263756.017172:0:7434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804000/0xce1582440fb1df40 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263756.017177:0:7434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bb804000 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263756.017180:0:7434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804000/0xce1582440fb1df40 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263756.017185:0:7434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804000/0xce1582440fb1df40 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263756.017192:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd9bb596400) 00010000:00010000:1.0:1789263756.017194:0:7434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789263756.017197:0:7434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804000/0xce1582440fb1df40 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263756.017202:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804000/0xce1582440fb1df40 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263756.017333:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+17:11258:x1876178888598656:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 Request processed in 8109us (8212us total) trans 4294967357 rc 0/0 00000100:00100000:1.0:1789263756.017342:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 90 00000020:00080000:1.0:1789263756.017346:0:7434:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789263756.017396:0:13757:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789263756.017400:0:13757:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789263756.017424:0:13757:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789263756.017431:0:13757:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789263756.018667:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263756.018713:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888599296 00000100:00100000:3.0:1789263756.018721:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888599296 00000100:00100000:3.0:1789263756.018780:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 17 00000100:00100000:3.0:1789263756.018803:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8838f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+17:11258:x1876178888599296:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789263756.019063:0:6490:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789263756.019144:0:6490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00010000:00010000:3.0:1789263756.019176:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1df55 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263756.019190:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1df55 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263756.019200:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1df55 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263756.019208:0:6490:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1df55 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263756.019215:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1df55 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263756.019222:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1df55 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263756.019242:0:6490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789263756.019291:0:7427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263756.019299:0:7427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1df55 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263756.019308:0:7427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981530600 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263756.019312:0:7427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1df55 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263756.019320:0:7427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1df55 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263756.019328:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8838f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+19:11258:x1876178888599296:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 Request processed in 536us (660us total) trans 4294967359 rc 0/0 00010000:00010000:1.0:1789263756.019335:0:7427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9dd8829ede00) 00000100:00100000:3.0:1789263756.019339:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 17 00010000:00010000:1.0:1789263756.019342:0:7427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00000020:00080000:3.0:1789263756.019346:0:6490:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789263756.019349:0:7427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1df55 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263756.019357:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1df55 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263756.019370:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263756.019373:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263756.019375:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263756.717262:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789263756.977297:0:14216:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789263756.977306:0:14216:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789263756.977333:0:14216:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789263756.977339:0:14216:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789263757.015285:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263757.015352:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888599424 00000100:00100000:1.0:1789263757.015362:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888599424 00000100:00080000:0.0:1789263757.015425:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789263757.015438:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 91 00000100:00100000:1.0:1789263757.015450:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882a6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+19:11275:x1876178888599424:12345-192.168.203.20@tcp:34:lfs.0 00010000:00010000:1.0:1789263757.015524:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3000/0xce1582440fb1df5c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.015537:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3000/0xce1582440fb1df5c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.015545:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3000/0xce1582440fb1df5c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.015556:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1df63 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.015561:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1df63 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.015565:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1df63 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.015647:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3600/0xce1582440fb1df6a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.015656:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3600/0xce1582440fb1df6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.015664:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3600/0xce1582440fb1df6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789263757.015705:0:6487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3600/0xce1582440fb1df6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.015718:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3000/0xce1582440fb1df5c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.015822:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3000/0xce1582440fb1df5c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.015830:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3000/0xce1582440fb1df5c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.015841:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd8841a3000 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263757.015847:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3000/0xce1582440fb1df5c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.015855:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3000/0xce1582440fb1df5c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.015869:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dd8829ed600) 00010000:00010000:1.0:1789263757.015872:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263757.015877:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3000/0xce1582440fb1df5c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.015883:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3000/0xce1582440fb1df5c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.015897:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1df63 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.015903:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1df63 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.015909:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1df63 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.015914:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd8841a2600 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263757.015924:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1df63 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.015944:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1df63 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.015953:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9dd8829ed000) 00010000:00010000:1.0:1789263757.015956:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263757.015959:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1df63 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.015964:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1df63 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.015977:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3600/0xce1582440fb1df6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.015982:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3600/0xce1582440fb1df6a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.015987:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3600/0xce1582440fb1df6a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.015992:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd8841a3600 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263757.015994:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3600/0xce1582440fb1df6a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.015999:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3600/0xce1582440fb1df6a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.016005:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd8829edb00) 00010000:00010000:1.0:1789263757.016007:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263757.016016:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3600/0xce1582440fb1df6a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.016022:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3600/0xce1582440fb1df6a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263757.016131:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882a6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+19:11275:x1876178888599424:12345-192.168.203.20@tcp:34:lfs.0 Request processed in 682us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263757.016140:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 91 00000100:00100000:0.0:1789263757.036251:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263757.036572:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888599680 00000100:00100000:1.0:1789263757.036581:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888599680 00000100:00100000:1.0:1789263757.036639:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 92 00000100:00100000:1.0:1789263757.036651:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882a6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+19:11278:x1876178888599680:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:1.0:1789263757.036673:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263757.036691:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3600/0xce1582440fb1df71 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11d9c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.036761:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1df78 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.036775:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1df78 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.036799:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1df78 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.036816:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3000/0xce1582440fb1df7f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.036823:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3000/0xce1582440fb1df7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.036838:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3000/0xce1582440fb1df7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.036947:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2200/0xce1582440fb1df86 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.036957:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2200/0xce1582440fb1df86 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.036965:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2200/0xce1582440fb1df86 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789263757.036975:0:6489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:1.0:1789263757.037050:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1df78 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.037058:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1df78 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.037065:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1df78 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.037071:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd8841a2600 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263757.037093:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1df78 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.037102:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1df78 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.037113:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dd8829ed600) 00010000:00010000:1.0:1789263757.037116:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263757.037125:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1df78 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.037129:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1df78 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.037138:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3000/0xce1582440fb1df7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.037141:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3000/0xce1582440fb1df7f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.037145:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3000/0xce1582440fb1df7f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.037149:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd8841a3000 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263757.037151:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3000/0xce1582440fb1df7f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.037155:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3000/0xce1582440fb1df7f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.037162:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9dd8829edb00) 00010000:00010000:1.0:1789263757.037164:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263757.037166:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3000/0xce1582440fb1df7f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.037169:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3000/0xce1582440fb1df7f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.037206:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3600/0xce1582440fb1df71 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d9c expref: 22 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.037234:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2200/0xce1582440fb1df86 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d9c expref: 21 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.037242:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd8829ed000) 00010000:00010000:1.0:1789263757.037245:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789263757.037247:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd8841a2200, rc 0) 00000100:00100000:1.0:1789263757.037296:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882a6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+21:11278:x1876178888599680:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 650us (1054us total) trans 4294967360 rc 0/0 00000100:00100000:1.0:1789263757.037302:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 92 00000100:00100000:0.0:1789263757.039177:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263757.039202:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888599808 00000100:00100000:3.0:1789263757.039209:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888599808 00000100:00100000:3.0:1789263757.039247:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 93 00000100:00100000:3.0:1789263757.039254:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882a6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+21:11278:x1876178888599808:12345-192.168.203.20@tcp:54:lfs.0 00010000:00010000:3.0:1789263757.039295:0:7434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1df94 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.039309:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1df94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.039317:0:7434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1df94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.039336:0:7434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1df94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.039341:0:7434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1df94 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.039346:0:7434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1df94 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.039349:0:7434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981530200 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263757.039351:0:7434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1df94 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.039358:0:7434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1df94 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.039377:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd8829ed000) 00010000:00010000:3.0:1789263757.039380:0:7434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789263757.039384:0:7434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1df94 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.039390:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1df94 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263757.039451:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882a6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+21:11278:x1876178888599808:12345-192.168.203.20@tcp:54:lfs.0 Request processed in 196us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263757.039460:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 93 00000100:00100000:0.0:1789263757.040675:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263757.040740:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888600064 00000100:00100000:2.0:1789263757.040748:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888600064 00000100:00100000:2.0:1789263757.040803:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 18 00000100:00100000:2.0:1789263757.040815:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882a6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+21:11278:x1876178888600064:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:2.0:1789263757.041001:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882a6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+22:11278:x1876178888600064:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 188us (330us total) trans 4294967361 rc 0/0 00000100:00100000:2.0:1789263757.041009:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 18 00000100:00100000:0.0:1789263757.054327:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263757.054375:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888600320 00000100:00100000:1.0:1789263757.054386:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888600320 00000100:00100000:1.0:1789263757.054446:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 94 00000100:00100000:1.0:1789263757.054455:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+22:10799:x1876178888600320:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:1.0:1789263757.054479:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263757.054497:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3600/0xce1582440fb1df9b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11da3 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.054590:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3000/0xce1582440fb1dfa2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.054604:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2200/0xce1582440fb1df86 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d9c expref: 23 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.054612:0:6488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3000/0xce1582440fb1dfa2 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.054642:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2200/0xce1582440fb1df86 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d9c expref: 23 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.054670:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2200/0xce1582440fb1df86 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d9c expref: 23 pid: 6489 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263757.054682:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6488:1876178898084992:192.168.203.20@tcp:104: 00000100:00100000:1.0:1789263757.054756:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd883e96e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789263757.056670:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6488:1876178898084992:192.168.203.20@tcp:104: 00000100:00100000:2.0:1789263757.056673:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00010000:00010000:1.0:1789263757.056705:0:6488:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3000/0xce1582440fb1dfa2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263757.056761:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888600448 00000100:00100000:0.0:1789263757.056768:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888600448 00010000:00010000:0.0:1789263757.056811:0:6473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2200/0xce1582440fb1df86 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d9c expref: 24 pid: 6489 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263757.056845:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 61 00000100:00100000:0.0:1789263757.056853:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88397ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+24:2398:x1876178888600448:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789263757.056866:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789263757.056872:0:6473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2200/0xce1582440fb1df86 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d9c expref: 24 pid: 6489 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263757.056884:0:6473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2200/0xce1582440fb1df86 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d9c expref: 24 pid: 6489 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263757.056903:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2200/0xce1582440fb1df86 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d9c expref: 24 pid: 6489 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263757.056992:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd8829ed000) 00010000:00010000:0.0:1789263757.056998:0:6473:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3000/0xce1582440fb1dfa2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263757.057006:0:6473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3000/0xce1582440fb1dfa2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263757.057014:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3000/0xce1582440fb1dfa2 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263757.057038:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789263757.057062:0:6488:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3000/0xce1582440fb1dfa2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.057072:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3000/0xce1582440fb1dfa2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263757.057109:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88397ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+23:2398:x1876178888600448:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 253us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263757.057118:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 61 00000004:00200000:1.0:1789263757.057121:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:1.0:1789263757.057234:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3600/0xce1582440fb1df9b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11da3 expref: 24 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.057250:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3000/0xce1582440fb1dfa2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11da3 expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.057256:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd8829ed000) 00010000:00010000:1.0:1789263757.057258:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789263757.057260:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd8841a3000, rc 0) 00000100:00100000:1.0:1789263757.057288:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+23:10799:x1876178888600320:12345-192.168.203.20@tcp:101:bash.0 Request processed in 2834us (2967us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1789263757.057306:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 94 00000100:00100000:2.0:1789263757.058628:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263757.058673:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888600576 00000100:00100000:3.0:1789263757.058679:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888600576 00000100:00100000:3.0:1789263757.058724:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 95 00000100:00100000:3.0:1789263757.058732:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882612300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+23:10799:x1876178888600576:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:3.0:1789263757.058749:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263757.058762:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1dfb0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11daa expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.058803:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1dfb7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.058813:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1dfb7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.058822:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1dfb7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.058906:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1dfb0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11daa expref: 25 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.058927:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1dfb7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11daa expref: 24 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.058935:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd8829ed000) 00010000:00010000:3.0:1789263757.058938:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789263757.058940:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981530c00, rc 0) 00000100:00100000:3.0:1789263757.058978:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882612300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+24:10799:x1876178888600576:12345-192.168.203.20@tcp:101:bash.0 Request processed in 247us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263757.058985:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 95 00000100:00100000:0.0:1789263757.060109:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263757.060184:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888600832 00000100:00100000:3.0:1789263757.060190:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888600832 00000100:00100000:3.0:1789263757.060226:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 96 00000100:00100000:3.0:1789263757.060236:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882a6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+24:10799:x1876178888600832:12345-192.168.203.20@tcp:36:bash.0 00010000:00010000:3.0:1789263757.060406:0:7434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1dfbe lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.060418:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1dfbe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.060427:0:7434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1dfbe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789263757.060485:0:7434:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00000004:00010000:3.0:1789263757.060511:0:7434:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001b0fbe3a reply state 000000004a87403a transno 4294967364 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1dfbe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.060522:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1dfbe lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.060539:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd8829ed000) 00010000:00010000:3.0:1789263757.060541:0:7434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789263757.060544:0:7434:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1789263757.060583:0:7434:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967364 00000100:00100000:3.0:1789263757.060674:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882a6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+28:10799:x1876178888600832:12345-192.168.203.20@tcp:36:bash.0 Request processed in 439us (568us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1789263757.060681:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 96 00000020:00080000:3.0:1789263757.060686:0:7434:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1789263757.061732:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263757.061792:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888600960 00000100:00100000:1.0:1789263757.061799:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888600960 00000100:00100000:1.0:1789263757.061837:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 97 00000100:00100000:1.0:1789263757.061843:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882612680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+28:10799:x1876178888600960:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:1.0:1789263757.061855:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263757.061872:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1dfc5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11db1 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.061913:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1dfc5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11db1 expref: 29 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.061932:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1dfc5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11db1 expref: 29 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.061949:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd8829ed000) 00010000:00010000:1.0:1789263757.061952:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789263757.061954:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd8841a2600, rc 0) 00000100:00100000:1.0:1789263757.061993:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882612680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+29:10799:x1876178888600960:12345-192.168.203.20@tcp:101:bash.0 Request processed in 149us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263757.061999:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 97 00000100:00100000:2.0:1789263757.063281:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263757.063324:0:8395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888601088 00000100:00100000:1.0:1789263757.063338:0:8395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888601088 00000100:00080000:0.0:1789263757.063387:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789263757.063405:0:8395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 41 00000100:00100000:1.0:1789263757.063415:0:8395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+6:10799:x1876178888601088:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:1.0:1789263757.063426:0:8395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263757.063458:0:8395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000044cd56d0/0xce1582440fb1dfcc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11db8 expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789263757.063493:0:8395:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6aa5ff8b, atime: 0x6aa5ff8b, ctime: 0x6aa5ff8b, blocks: 0x8 00010000:00010000:1.0:1789263757.063515:0:8395:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=199s v=(0 0) 00010000:00010000:1.0:1789263757.063520:0:8395:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789263757.063528:0:8395:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044cd56d0/0xce1582440fb1dfcc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11db8 expref: 7 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.063549:0:8395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000044cd56d0/0xce1582440fb1dfcc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11db8 expref: 7 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.063559:0:8395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd8841a3600, rc 0) 00000100:00100000:1.0:1789263757.063603:0:8395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+7:10799:x1876178888601088:12345-192.168.203.20@tcp:101:bash.0 Request processed in 185us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263757.063611:0:8395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 41 00000100:00100000:0.0:1789263757.064406:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263757.064481:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888601216 00000100:00100000:2.0:1789263757.064487:0:8398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888601216 00002000:00010000:2.0:1789263757.064510:0:8398:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:2.0:1789263757.064515:0:8398:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dd882a6ea00 with x1876178888601216 ext(0->18446744073709551615) 00002000:00010000:2.0:1789263757.064522:0:8398:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dd882a6ea00. 00000100:00100000:2.0:1789263757.064619:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 1 00000100:00100000:2.0:1789263757.064637:0:8398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882a6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+7:2399:x1876178888601216:12345-192.168.203.20@tcp:10:bash.0 00002000:00010000:2.0:1789263757.064946:0:8398:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1789263757.064950:0:8398:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789263755 -> 1789263757 00002000:00010000:2.0:1789263757.064959:0:8398:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 1789263755 -> 1789263755 00002000:00010000:2.0:1789263757.064961:0:8398:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789263755 -> 1789263757 00002000:00010000:2.0:1789263757.064964:0:8398:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1789263757.065006:0:8398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882a6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+8:2399:x1876178888601216:12345-192.168.203.20@tcp:10:bash.0 Request processed in 379us (600us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1789263757.065015:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 1 00002000:00010000:2.0:1789263757.065018:0:8398:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:2.0:1789263757.065022:0:8398:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dd882a6ea00 with x1876178888601216 ext(0->18446744073709551615) 00002000:00010000:2.0:1789263757.065027:0:8398:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dd882a6ea00. 00000100:00100000:2.0:1789263757.094019:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263757.094072:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888601344 00000100:00100000:3.0:1789263757.094120:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888601344 00000100:00100000:3.0:1789263757.094186:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 98 00000100:00100000:3.0:1789263757.094198:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+29:11292:x1876178888601344:12345-192.168.203.20@tcp:34:lfs.0 00010000:00010000:3.0:1789263757.094260:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1dfd3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.094276:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1dfd3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.094288:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1dfd3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.094302:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1dfda lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.094310:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1dfda lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.094317:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1dfda lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.094400:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1dfe1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.094409:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1dfe1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.094416:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1dfe1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789263757.094455:0:6489:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1dfe1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.094465:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1dfd3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.094472:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1dfd3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.094478:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1dfd3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.094484:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981530200 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263757.094487:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1dfd3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.094495:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1dfd3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.094505:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dd8829ed600) 00010000:00010000:3.0:1789263757.094508:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789263757.094512:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1dfd3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.094525:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1dfd3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.094538:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1dfda lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.094543:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1dfda lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.094549:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1dfda lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.094554:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981530400 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263757.094557:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1dfda lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.094562:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1dfda lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.094570:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9dd9bb595c00) 00010000:00010000:3.0:1789263757.094573:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789263757.094575:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1dfda lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.094581:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1dfda lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.094594:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1dfe1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.094601:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1dfe1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.094613:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1dfe1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.094619:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981530e00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263757.094621:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1dfe1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.094642:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1dfe1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.094651:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd8829ed000) 00010000:00010000:3.0:1789263757.094653:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789263757.094656:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1dfe1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.094662:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1dfe1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263757.094742:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+29:11292:x1876178888601344:12345-192.168.203.20@tcp:34:lfs.0 Request processed in 547us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263757.094750:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 98 00000100:00100000:0.0:1789263757.113155:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263757.113213:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888601600 00000100:00100000:3.0:1789263757.113224:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888601600 00000100:00100000:3.0:1789263757.113275:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 99 00000100:00100000:3.0:1789263757.113284:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882a6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+29:11295:x1876178888601600:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:3.0:1789263757.113308:0:7434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263757.113330:0:7434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1dfe8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11dbf expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.113418:0:7434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1dfef lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.113429:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1dfef lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.113438:0:7434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1dfef lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.113447:0:7434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1dff6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.113452:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1dff6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.113456:0:7434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1dff6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.113538:0:7434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1dffd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.113546:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1dffd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.113553:0:7434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1dffd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789263757.113562:0:7434:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1789263757.113624:0:7434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1dfef lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.113629:0:7434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1dfef lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.113638:0:7434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1dfef lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.113642:0:7434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981530400 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263757.113645:0:7434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1dfef lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.113650:0:7434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1dfef lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.113659:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dd8829ed600) 00010000:00010000:3.0:1789263757.113661:0:7434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789263757.113664:0:7434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1dfef lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.113668:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1dfef lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.113677:0:7434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1dff6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.113680:0:7434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1dff6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.113684:0:7434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1dff6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.113687:0:7434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981530200 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263757.113689:0:7434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1dff6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.113698:0:7434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1dff6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.113703:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9dd9bb595c00) 00010000:00010000:3.0:1789263757.113704:0:7434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789263757.113706:0:7434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1dff6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.113709:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1dff6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.113735:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1dfe8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11dbf expref: 32 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.113743:0:7434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1dffd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11dbf expref: 31 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.113747:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd8829ed000) 00010000:00010000:3.0:1789263757.113748:0:7434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789263757.113750:0:7434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981531600, rc 0) 00000100:00100000:3.0:1789263757.113811:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882a6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+31:11295:x1876178888601600:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 529us (663us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1789263757.113817:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 99 00000100:00100000:0.0:1789263757.115411:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263757.115460:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888601728 00000100:00100000:1.0:1789263757.115467:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888601728 00000100:00100000:1.0:1789263757.115508:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 100 00000100:00100000:1.0:1789263757.115519:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882a6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+31:11295:x1876178888601728:12345-192.168.203.20@tcp:54:lfs.0 00010000:00010000:1.0:1789263757.115567:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3c00/0xce1582440fb1e00b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.115578:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3000/0xce1582440fb1dfa2 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11da3 expref: 31 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.115584:0:6488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3c00/0xce1582440fb1e00b lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.115623:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3000/0xce1582440fb1dfa2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11da3 expref: 31 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.115645:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3000/0xce1582440fb1dfa2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11da3 expref: 31 pid: 6488 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263757.115659:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6488:1876178898085120:192.168.203.20@tcp:104: 00000100:00100000:1.0:1789263757.115755:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd883e96e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789263757.116583:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6488:1876178898085120:192.168.203.20@tcp:104: 00010000:00010000:1.0:1789263757.116613:0:6488:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3c00/0xce1582440fb1e00b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263757.116760:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263757.116934:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888601984 00000100:00100000:3.0:1789263757.116941:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888601984 00000100:00100000:3.0:1789263757.116986:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 19 00000100:00100000:3.0:1789263757.116995:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882a6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+32:6152:x1876178888601984:12345-192.168.203.20@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789263757.117225:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882a6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+33:6152:x1876178888601984:12345-192.168.203.20@tcp:35:ldlm_bl.0 Request processed in 230us (465us total) trans 4294967367 rc 0/0 00000100:00100000:3.0:1789263757.117233:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 19 00000100:00100000:2.0:1789263757.118100:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263757.118129:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888602112 00000100:00100000:3.0:1789263757.118135:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888602112 00010000:00010000:3.0:1789263757.118158:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3000/0xce1582440fb1dfa2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11da3 expref: 33 pid: 6488 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263757.118187:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 62 00000100:00100000:3.0:1789263757.118196:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa28a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+33:2398:x1876178888602112:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789263757.118206:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789263757.118213:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3000/0xce1582440fb1dfa2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11da3 expref: 33 pid: 6488 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.118224:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3000/0xce1582440fb1dfa2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11da3 expref: 33 pid: 6488 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.118242:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3000/0xce1582440fb1dfa2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11da3 expref: 33 pid: 6488 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.118257:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd8829ed000) 00010000:00010000:3.0:1789263757.118262:0:6474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3c00/0xce1582440fb1e00b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.118271:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3c00/0xce1582440fb1e00b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.118278:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3c00/0xce1582440fb1e00b lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.118310:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789263757.118337:0:6488:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3c00/0xce1582440fb1e00b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263757.118339:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa28a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+32:2398:x1876178888602112:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 145us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263757.118353:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 62 00010000:00010000:1.0:1789263757.118358:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3c00/0xce1582440fb1e00b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.118377:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3c00/0xce1582440fb1e00b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.118382:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3c00/0xce1582440fb1e00b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.118387:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3c00/0xce1582440fb1e00b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.118391:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd8841a3c00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263757.118394:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3c00/0xce1582440fb1e00b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.118408:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3c00/0xce1582440fb1e00b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.118419:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd8829ed000) 00010000:00010000:1.0:1789263757.118423:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789263757.118427:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3c00/0xce1582440fb1e00b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.118433:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3c00/0xce1582440fb1e00b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263757.118474:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882a6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+31:11295:x1876178888601728:12345-192.168.203.20@tcp:54:lfs.0 Request processed in 2957us (3068us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263757.118482:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 100 00000100:00100000:2.0:1789263757.119309:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263757.119346:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888602368 00000100:00100000:3.0:1789263757.119351:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888602368 00000100:00100000:3.0:1789263757.119389:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 20 00000100:00100000:3.0:1789263757.119397:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+31:11295:x1876178888602368:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:3.0:1789263757.119521:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+32:11295:x1876178888602368:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 124us (212us total) trans 4294967368 rc 0/0 00000100:00100000:3.0:1789263757.119528:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 20 00000100:00100000:0.0:1789263757.152363:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263757.152418:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888602624 00000100:00100000:3.0:1789263757.152428:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888602624 00000100:00100000:3.0:1789263757.152485:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 101 00000100:00100000:3.0:1789263757.152497:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882a6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+32:11306:x1876178888602624:12345-192.168.203.20@tcp:101:cat.0 00010000:00010000:3.0:1789263757.152525:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263757.152546:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1e012 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11dc6 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.152610:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1e019 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.152621:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1e019 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.152629:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1e019 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.152660:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1e020 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.152667:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1e020 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.152673:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1e020 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.152771:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1e027 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.152793:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1e027 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.152801:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1e027 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789263757.152811:0:6489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:3.0:1789263757.152879:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1e019 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.152884:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1e019 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.152888:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1e019 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.152892:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981530200 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263757.152895:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1e019 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.152907:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1e019 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.152917:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dd8829ed600) 00010000:00010000:3.0:1789263757.152920:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789263757.152924:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1e019 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.152930:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1e019 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.152942:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1e020 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.152949:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1e020 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.152954:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1e020 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.152959:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981530400 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263757.152962:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1e020 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.152968:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1e020 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.152974:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9dd9bb595c00) 00010000:00010000:3.0:1789263757.152977:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789263757.152979:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1e020 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.152994:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1e020 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.153033:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1e012 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11dc6 expref: 35 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.153046:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1e027 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11dc6 expref: 34 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.153052:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd8829ed000) 00010000:00010000:3.0:1789263757.153054:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789263757.153055:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981530a00, rc 0) 00000100:00100000:3.0:1789263757.153154:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882a6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+34:11306:x1876178888602624:12345-192.168.203.20@tcp:101:cat.0 Request processed in 659us (797us total) trans 4294967369 rc 0/0 00000100:00100000:3.0:1789263757.153163:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 101 00000100:00100000:0.0:1789263757.155569:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263757.155628:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888602880 00000100:00100000:3.0:1789263757.155638:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888602880 00000100:00100000:3.0:1789263757.155700:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 21 00000100:00100000:3.0:1789263757.155714:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a38450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+34:11306:x1876178888602880:12345-192.168.203.20@tcp:35:cat.0 00000100:00100000:3.0:1789263757.156002:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a38450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+35:11306:x1876178888602880:12345-192.168.203.20@tcp:35:cat.0 Request processed in 292us (439us total) trans 4294967370 rc 0/0 00000100:00100000:3.0:1789263757.156011:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 21 00000100:00100000:2.0:1789263757.165377:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263757.165443:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888603136 00000100:00100000:3.0:1789263757.165453:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888603136 00000100:00100000:3.0:1789263757.165515:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 102 00000100:00100000:3.0:1789263757.165527:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+35:11307:x1876178888603136:12345-192.168.203.20@tcp:36:rm.0 00010000:00010000:3.0:1789263757.165594:0:7434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1789263757.165620:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1dfc5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11db1 expref: 35 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.165653:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1e027 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11dc6 expref: 34 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.165668:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1dffd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11dbf expref: 33 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.165680:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1dfb7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11daa expref: 32 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.165692:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd8829ed000) 00010000:00010000:3.0:1789263757.165697:0:7434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789263757.165717:0:7434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1e035 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.165731:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1e035 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.165740:0:7434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1e035 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.165753:0:7434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1e03c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.165760:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1e03c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.165789:0:7434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1e03c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.165858:0:7434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1e043 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.165866:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1e043 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.165873:0:7434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1e043 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789263757.166063:0:7434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:3.0:1789263757.166071:0:7434:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 199455993757ns, next at 200455991344ns, rc = 0 00010000:00010000:3.0:1789263757.166166:0:7434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432200/0xce1582440fb1e04a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.166176:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432200/0xce1582440fb1e04a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.166183:0:7434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432200/0xce1582440fb1e04a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.166190:0:7434:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432200/0xce1582440fb1e04a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.166196:0:7434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432200/0xce1582440fb1e04a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.166202:0:7434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432200/0xce1582440fb1e04a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.166232:0:7434:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789263757.166252:0:7434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1e043 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.166258:0:7434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1e043 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.166265:0:7434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1e043 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.166271:0:7434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981530200 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263757.166276:0:7434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1e043 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.166276:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263757.166287:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432200/0xce1582440fb1e04a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.166289:0:7434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1e043 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.166304:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd990432200 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:3.0:1789263757.166308:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd8829ed000) 00010000:00010000:3.0:1789263757.166312:0:7434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789263757.166316:0:7434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1e043 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.166319:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432200/0xce1582440fb1e04a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.166324:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1e043 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.166331:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432200/0xce1582440fb1e04a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40018480000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.166342:0:7434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1e035 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.166345:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd8829ed000) 00010000:00010000:3.0:1789263757.166352:0:7434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1e035 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.166359:0:7434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1e035 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.166364:0:6476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789263757.166373:0:7434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981530e00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263757.166375:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432200/0xce1582440fb1e04a lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.166378:0:7434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1e035 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.166388:0:7434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1e035 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.166398:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dd8829ed600) 00010000:00010000:1.0:1789263757.166406:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432200/0xce1582440fb1e04a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.166411:0:7434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789263757.166416:0:7434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1e035 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.166421:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263757.166424:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1e035 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.166425:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263757.166428:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:3.0:1789263757.166441:0:7434:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a0f4d4f2 reply state 00000000b99a7df8 transno 4294967371 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1e03c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.166452:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1e03c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.166458:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9dd9bb595c00) 00010000:00010000:3.0:1789263757.166460:0:7434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789263757.166463:0:7434:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789263757.166534:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+33:11307:x1876178888603136:12345-192.168.203.20@tcp:36:rm.0 Request processed in 1009us (1164us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1789263757.166541:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 102 00000100:00100000:0.0:1789263757.186979:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263757.187053:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888603392 00000100:00100000:1.0:1789263757.187067:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888603392 00000100:00100000:1.0:1789263757.187154:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 103 00000100:00100000:1.0:1789263757.187162:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882a6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+33:11313:x1876178888603392:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:1.0:1789263757.187185:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263757.187203:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3c00/0xce1582440fb1e051 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11dcd expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.187292:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e058 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.187305:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e058 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.187315:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e058 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.187323:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2c00/0xce1582440fb1e05f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.187329:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2c00/0xce1582440fb1e05f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.187334:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2c00/0xce1582440fb1e05f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789263757.187624:0:6488:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:1.0:1789263757.187738:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1e066 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.187746:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1e066 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.187752:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1e066 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.187775:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e058 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.187792:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e058 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.187798:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e058 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.187804:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd8841a2a00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263757.187808:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e058 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.187814:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e058 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.187824:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dd8829ed600) 00010000:00010000:1.0:1789263757.187826:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263757.187829:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e058 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.187856:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e058 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789263757.187871:0:6488:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f147fd1c reply state 000000000051e6d6 transno 4294967372 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2c00/0xce1582440fb1e05f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.187881:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2c00/0xce1582440fb1e05f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.187888:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9dd9bb595c00) 00010000:00010000:1.0:1789263757.187891:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789263757.187893:0:6488:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789263757.187918:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3c00/0xce1582440fb1e051 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11dcd expref: 36 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.187932:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1e066 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11dcd expref: 35 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.187939:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd8829ed200) 00010000:00010000:1.0:1789263757.187941:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789263757.187943:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd8841a2e00, rc 0) 00000100:00100000:1.0:1789263757.188016:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882a6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+36:11313:x1876178888603392:12345-192.168.203.20@tcp:101:bash.0 Request processed in 854us (1052us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1789263757.188022:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 103 00000100:00100000:0.0:1789263757.190037:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263757.190114:0:8511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888603520 00000100:00100000:2.0:1789263757.190123:0:8511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888603520 00000100:00080000:0.0:1789263757.190184:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789263757.190191:0:8511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 42 00000100:00100000:2.0:1789263757.190202:0:8511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882a6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+7:2400:x1876178888603520:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:2.0:1789263757.190217:0:8511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263757.190234:0:8511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000081dcba21/0xce1582440fb1e074 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11dd4 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789263757.190257:0:8511:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789263757.190277:0:8511:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=199s v=(0 0) 00010000:00010000:2.0:1789263757.190282:0:8511:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789263757.190292:0:8511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081dcba21/0xce1582440fb1e074 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11dd4 expref: 8 pid: 8511 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263757.190329:0:8511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000081dcba21/0xce1582440fb1e074 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11dd4 expref: 8 pid: 8511 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263757.190342:0:8511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bb805000, rc 0) 00000100:00100000:2.0:1789263757.190412:0:8511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882a6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+8:2400:x1876178888603520:12345-192.168.203.20@tcp:101:bash.0 Request processed in 212us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263757.190419:0:8511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 42 00000100:00100000:2.0:1789263757.191997:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263757.192059:0:8394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888603648 00000100:00100000:0.0:1789263757.192068:0:8394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888603648 00000100:00100000:0.0:1789263757.192135:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 43 00000100:00100000:0.0:1789263757.192151:0:8394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+8:11313:x1876178888603648:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:0.0:1789263757.192164:0:8394:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263757.192175:0:8394:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000112939d1/0xce1582440fb1e07b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11ddb expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263757.192196:0:8394:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000081dcba21/0xce1582440fb1e074 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11dd4 expref: 9 pid: 8511 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263757.192202:0:8394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789263757.192205:0:8394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789263757.192208:0:8394:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000112939d1/0xce1582440fb1e07b lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ddb expref: 9 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263757.192232:0:8394:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000081dcba21/0xce1582440fb1e074 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11dd4 expref: 9 pid: 8511 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263757.192246:0:8394:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000081dcba21/0xce1582440fb1e074 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11dd4 expref: 9 pid: 8511 timeout: 299 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263757.192272:0:8394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882a6d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8394:1876178898085248:192.168.203.20@tcp:104: 00000100:00100000:0.0:1789263757.192360:0:8394:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd983852840 going to sleep for 11 seconds 00000100:00100000:3.0:1789263757.193880:0:8394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882a6d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8394:1876178898085248:192.168.203.20@tcp:104: 00010000:00010000:3.0:1789263757.193905:0:8394:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000112939d1/0xce1582440fb1e07b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ddb expref: 9 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.193927:0:8394:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd883e73e00, rc 0) 00000100:00100000:2.0:1789263757.193966:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263757.193976:0:8394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+9:11313:x1876178888603648:12345-192.168.203.20@tcp:101:bash.0 Request processed in 1825us (1984us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263757.193983:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 43 00000100:00100000:1.0:1789263757.194019:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888603776 00000100:00100000:1.0:1789263757.194026:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888603776 00010000:00010000:1.0:1789263757.194053:0:6472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000081dcba21/0xce1582440fb1e074 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11dd4 expref: 9 pid: 8511 timeout: 299 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263757.194128:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 63 00000100:00100000:1.0:1789263757.194137:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98fe86450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+9:2397:x1876178888603776:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789263757.194149:0:6472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789263757.194168:0:6472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000081dcba21/0xce1582440fb1e074 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11dd4 expref: 9 pid: 8511 timeout: 299 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.194182:0:6472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000081dcba21/0xce1582440fb1e074 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11dd4 expref: 9 pid: 8511 timeout: 299 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.194204:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081dcba21/0xce1582440fb1e074 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11dd4 expref: 9 pid: 8511 timeout: 299 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.194214:0:6472:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789263757.194217:0:6472:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789263757.194222:0:6472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000112939d1/0xce1582440fb1e07b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ddb expref: 8 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.194232:0:6472:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000112939d1/0xce1582440fb1e07b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ddb expref: 8 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.194269:0:6472:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000112939d1/0xce1582440fb1e07b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ddb expref: 8 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263757.194282:0:6472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6472:1876178898085376:192.168.203.20@tcp:105: 00000100:00100000:1.0:1789263757.194339:0:6472:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd883e96600 going to sleep for 11 seconds 00000100:00100000:2.0:1789263757.196123:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263757.196231:0:6472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6472:1876178898085376:192.168.203.20@tcp:105: 00010000:00010000:1.0:1789263757.196249:0:6472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789263757.196304:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98fe86450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+8:2397:x1876178888603776:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 2167us (2339us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263757.196311:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 63 00000100:00100000:3.0:1789263757.196537:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888604032 00000100:00100000:3.0:1789263757.196542:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888604032 00000100:00100000:3.0:1789263757.196574:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 22 00000100:00100000:3.0:1789263757.196583:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+36:11313:x1876178888604032:12345-192.168.203.20@tcp:35:bash.0 00000100:00100000:3.0:1789263757.196831:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+37:11313:x1876178888604032:12345-192.168.203.20@tcp:35:bash.0 Request processed in 248us (714us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1789263757.196836:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 22 00000100:00100000:2.0:1789263757.260903:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263757.260958:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888604160 00000100:00100000:0.0:1789263757.260968:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888604160 00000100:00100000:0.0:1789263757.261042:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 104 00000100:00100000:0.0:1789263757.261054:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+37:11329:x1876178888604160:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:0.0:1789263757.261101:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263757.261127:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73a00/0xce1582440fb1e082 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11de2 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263757.261190:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73200/0xce1582440fb1e089 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263757.261204:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73200/0xce1582440fb1e089 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263757.261215:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73200/0xce1582440fb1e089 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789263757.261255:0:6489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1789263757.261258:0:6489:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789263757.261274:0:6489:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73200/0xce1582440fb1e089 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263757.261295:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73a00/0xce1582440fb1e082 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11de2 expref: 39 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263757.261310:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73200/0xce1582440fb1e089 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11de2 expref: 38 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263757.261326:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dd8829ed600) 00010000:00010000:0.0:1789263757.261329:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789263757.261332:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd883e73200, rc 0) 00000100:00100000:0.0:1789263757.261391:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+38:11329:x1876178888604160:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 340us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263757.261397:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 104 00000100:00100000:0.0:1789263757.263333:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263757.263386:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888604416 00000100:00100000:3.0:1789263757.263394:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888604416 00000100:00100000:3.0:1789263757.263437:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 105 00000100:00100000:3.0:1789263757.263447:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882a6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+38:11329:x1876178888604416:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:3.0:1789263757.263463:0:7434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263757.263477:0:7434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1e090 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11de9 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.263553:0:7434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e097 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.263568:0:7434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1e066 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11dcd expref: 39 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.263588:0:7434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e097 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.263650:0:7434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1e066 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11dcd expref: 39 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.263663:0:7434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1e066 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11dcd expref: 39 pid: 6488 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263757.263676:0:7434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff78700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7434:1876178898085504:192.168.203.20@tcp:104: 00000100:00100000:3.0:1789263757.263788:0:7434:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd986221c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789263757.264616:0:7434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff78700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7434:1876178898085504:192.168.203.20@tcp:104: 00010000:00010000:1.0:1789263757.264636:0:7434:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e097 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263757.264927:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263757.264975:0:10303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888604544 00000100:00100000:2.0:1789263757.264982:0:10303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888604544 00010000:00010000:2.0:1789263757.265006:0:10303:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1e066 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11dcd expref: 40 pid: 6488 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263757.265037:0:10303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 64 00000100:00100000:2.0:1789263757.265046:0:10303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882a6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3ce90ea2-917f-4b54-98b0-25e051f2317f+40:2398:x1876178888604544:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789263757.265057:0:10303:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789263757.265064:0:10303:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1e066 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11dcd expref: 40 pid: 6488 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263757.265111:0:10303:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1e066 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11dcd expref: 40 pid: 6488 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263757.265144:0:10303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1e066 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11dcd expref: 40 pid: 6488 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263757.265160:0:10303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd8829ed200) 00010000:00010000:2.0:1789263757.265164:0:10303:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e097 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263757.265171:0:10303:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e097 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263757.265178:0:10303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e097 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263757.265197:0:10303:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789263757.265225:0:7434:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e097 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263757.265231:0:10303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882a6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3ce90ea2-917f-4b54-98b0-25e051f2317f+39:2398:x1876178888604544:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 185us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263757.265242:0:10303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 64 00010000:00010000:1.0:1789263757.265242:0:7434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e097 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789263757.265258:0:7434:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1789263757.265357:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1e090 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11de9 expref: 40 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.265372:0:7434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e097 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11de9 expref: 39 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.265379:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd8829ed200) 00010000:00010000:1.0:1789263757.265382:0:7434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789263757.265384:0:7434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd990433200, rc 0) 00000100:00100000:1.0:1789263757.265415:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882a6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+39:11329:x1876178888604416:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 1971us (2088us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1789263757.265429:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 105 00000100:00100000:0.0:1789263757.266583:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263757.266626:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888604800 00000100:00100000:1.0:1789263757.266633:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888604800 00000100:00100000:1.0:1789263757.266675:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 106 00000100:00100000:1.0:1789263757.266683:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882a6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+39:11329:x1876178888604800:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:1.0:1789263757.266698:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263757.266701:0:6488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789263757.266714:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e097 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11de9 expref: 39 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.266725:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd8829ed200) 00010000:00010000:1.0:1789263757.266733:0:6488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789263757.266744:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3c00/0xce1582440fb1e0a5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11df0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.266817:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e0ac lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.266827:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e0ac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.266835:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e0ac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789263757.266844:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1789263757.266904:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3c00/0xce1582440fb1e0a5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11df0 expref: 41 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.266930:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e0ac lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11df0 expref: 40 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.266937:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd8829ed800) 00010000:00010000:1.0:1789263757.266940:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789263757.266942:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd8841a2a00, rc 0) 00000100:00100000:1.0:1789263757.266978:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882a6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+40:11329:x1876178888604800:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 295us (395us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1789263757.266985:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 106 00000100:00100000:3.0:1789263757.268466:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263757.268521:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888604928 00000100:00100000:0.0:1789263757.268529:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888604928 00000100:00100000:0.0:1789263757.268576:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 107 00000100:00100000:0.0:1789263757.268586:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+40:11329:x1876178888604928:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:0.0:1789263757.268610:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263757.268624:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72200/0xce1582440fb1e0ba lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11df7 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263757.268668:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72200/0xce1582440fb1e0ba lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11df7 expref: 41 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263757.268683:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72200/0xce1582440fb1e0ba lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11df7 expref: 41 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263757.268701:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd8829ed800) 00010000:00010000:0.0:1789263757.268705:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789263757.268708:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd883e72200, rc 0) 00000100:00100000:0.0:1789263757.268811:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+41:11329:x1876178888604928:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 226us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263757.268818:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 107 00000100:00100000:0.0:1789263757.271029:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263757.271133:0:8395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888605056 00000100:00100000:1.0:1789263757.271146:0:8395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888605056 00000100:00100000:1.0:1789263757.271205:0:8395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 44 00000100:00100000:1.0:1789263757.271219:0:8395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882a6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+8:2399:x1876178888605056:12345-192.168.203.20@tcp:1:lfs.0 00010000:00010000:1.0:1789263757.271275:0:8395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056ceb6a3/0xce1582440fb1e0c1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.271306:0:8395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000112939d1/0xce1582440fb1e07b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ddb expref: 8 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.271313:0:8395:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789263757.271318:0:8395:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789263757.271321:0:8395:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056ceb6a3/0xce1582440fb1e0c1 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.271355:0:8395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000112939d1/0xce1582440fb1e07b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ddb expref: 8 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.271388:0:8395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000112939d1/0xce1582440fb1e07b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ddb expref: 8 pid: 8394 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263757.271405:0:8395:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8395:1876178898085632:192.168.203.20@tcp:104: 00000100:00100000:1.0:1789263757.271503:0:8395:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd883e96900 going to sleep for 11 seconds 00000100:00100000:1.0:1789263757.272603:0:8395:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8395:1876178898085632:192.168.203.20@tcp:104: 00010000:00010000:1.0:1789263757.272624:0:8395:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000056ceb6a3/0xce1582440fb1e0c1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263757.272847:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263757.272990:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888605184 00000100:00100000:3.0:1789263757.272998:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888605184 00002000:00100000:3.0:1789263757.273045:0:8400:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9dd882a6f100 x1876178888605184/t0(0) o4->3ce90ea2-917f-4b54-98b0-25e051f2317f@192.168.203.20@tcp:593/0 lens 504/0 e 0 to 0 dl 1789263768 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789263757.273056:0:8400:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dd882a6f100 with x1876178888605184 ext(0->8) 00010000:00010000:3.0:1789263757.273064:0:8400:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000112939d1/0xce1582440fb1e07b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ddb expref: 9 pid: 8394 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.273095:0:8400:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000112939d1/0xce1582440fb1e07b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ddb expref: 9 pid: 8394 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789263757.273102:0:8400:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9dd882a6f100 00000100:00100000:3.0:1789263757.273134:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 1 00000100:00100000:3.0:1789263757.273146:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882a6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+9:2398:x1876178888605184:12345-192.168.203.20@tcp:4:lfs.0 00000100:00100000:3.0:1789263757.275400:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882a6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+11:2398:x1876178888605184:12345-192.168.203.20@tcp:4:lfs.0 Request processed in 2247us (2543us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1789263757.275415:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 1 00002000:00100000:3.0:1789263757.275426:0:8400:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9dd882a6f100 x1876178888605184/t4294967303(0) o4->3ce90ea2-917f-4b54-98b0-25e051f2317f@192.168.203.20@tcp:593/0 lens 504/448 e 0 to 0 dl 1789263768 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789263757.275437:0:8400:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dd882a6f100 with x1876178888605184 ext(0->8) 00010000:00010000:3.0:1789263757.275448:0:8400:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000112939d1/0xce1582440fb1e07b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ddb expref: 11 pid: 8394 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.275468:0:8400:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000112939d1/0xce1582440fb1e07b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ddb expref: 11 pid: 8394 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789263757.275475:0:8400:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9dd882a6f100 00000100:00100000:2.0:1789263757.276642:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263757.276741:0:7428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888605312 00000100:00100000:1.0:1789263757.276758:0:7428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888605312 00010000:00010000:1.0:1789263757.276826:0:7428:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000112939d1/0xce1582440fb1e07b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ddb expref: 11 pid: 8394 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263757.276874:0:7428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 65 00000100:00100000:1.0:1789263757.276886:0:7428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa84380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+11:2400:x1876178888605312:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789263757.276907:0:7428:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789263757.276929:0:7428:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1789263757.276931:0:7428:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1789263757 00002000:00010000:1.0:1789263757.276934:0:7428:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1789263757 00002000:00010000:1.0:1789263757.276936:0:7428:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1789263757 00002000:00010000:1.0:1789263757.276938:0:7428:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1789263757.276944:0:7428:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000112939d1/0xce1582440fb1e07b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ddb expref: 11 pid: 8394 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.276982:0:7428:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000112939d1/0xce1582440fb1e07b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ddb expref: 11 pid: 8394 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.277018:0:7428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000112939d1/0xce1582440fb1e07b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ddb expref: 11 pid: 8394 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.277042:0:7428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789263757.277047:0:7428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789263757.277054:0:7428:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000056ceb6a3/0xce1582440fb1e0c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.277064:0:7428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056ceb6a3/0xce1582440fb1e0c1 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.277167:0:7428:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789263757.277217:0:8395:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000056ceb6a3/0xce1582440fb1e0c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263757.277232:0:8395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000056ceb6a3/0xce1582440fb1e0c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263757.277249:0:7428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa84380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+10:2400:x1876178888605312:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 364us (609us total) trans 0 rc 0/0 00010000:00010000:2.0:1789263757.277261:0:8395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056ceb6a3/0xce1582440fb1e0c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263757.277262:0:7428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 65 00010000:00010000:2.0:1789263757.277296:0:8395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000056ceb6a3/0xce1582440fb1e0c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263757.277304:0:8395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000056ceb6a3/0xce1582440fb1e0c1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263757.277311:0:8395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd8841a3c00 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:2.0:1789263757.277315:0:8395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000056ceb6a3/0xce1582440fb1e0c1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263757.277324:0:8395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000056ceb6a3/0xce1582440fb1e0c1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263757.277348:0:8395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000056ceb6a3/0xce1582440fb1e0c1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263757.277357:0:8395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000056ceb6a3/0xce1582440fb1e0c1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263757.277436:0:8395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882a6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+9:2399:x1876178888605056:12345-192.168.203.20@tcp:1:lfs.0 Request processed in 6219us (6416us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263757.277448:0:8395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 44 00000100:00100000:0.0:1789263757.278554:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263757.278594:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888605568 00000100:00100000:3.0:1789263757.278602:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888605568 00000100:00100000:3.0:1789263757.278645:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 23 00000100:00100000:3.0:1789263757.278655:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882a6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+41:11329:x1876178888605568:12345-192.168.203.20@tcp:35:lfs.0 00000004:00010000:3.0:1789263757.278707:0:6490:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e0ac lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11df0 expref: 41 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789263757.278926:0:6490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967376 00000001:00080000:3.0:1789263757.278965:0:6490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967377 00000001:00080000:3.0:1789263757.279332:0:6490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967378 00010000:00010000:3.0:1789263757.279367:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e0c8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.279380:0:6490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72200/0xce1582440fb1e0ba lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11df7 expref: 45 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.279393:0:6490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e0c8 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.279424:0:6490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72200/0xce1582440fb1e0ba lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11df7 expref: 45 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.279434:0:6490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72200/0xce1582440fb1e0ba lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11df7 expref: 45 pid: 6489 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263757.279444:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff78e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6490:1876178898085760:192.168.203.20@tcp:104: 00000100:00100000:3.0:1789263757.279503:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd986221900 going to sleep for 11 seconds 00000100:00100000:1.0:1789263757.280459:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff78e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6490:1876178898085760:192.168.203.20@tcp:104: 00010000:00010000:1.0:1789263757.280491:0:6490:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e0c8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263757.280688:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263757.280727:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888605696 00000100:00100000:2.0:1789263757.280734:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888605696 00010000:00010000:2.0:1789263757.280769:0:8409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72200/0xce1582440fb1e0ba lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11df7 expref: 46 pid: 6489 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263757.280817:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 66 00000100:00100000:2.0:1789263757.280823:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e32d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+46:2398:x1876178888605696:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789263757.280834:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789263757.280839:0:8409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72200/0xce1582440fb1e0ba lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11df7 expref: 46 pid: 6489 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263757.280847:0:8409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72200/0xce1582440fb1e0ba lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11df7 expref: 46 pid: 6489 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263757.280859:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72200/0xce1582440fb1e0ba lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11df7 expref: 46 pid: 6489 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263757.280869:0:8409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd8829ed800) 00010000:00010000:2.0:1789263757.280873:0:8409:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e0c8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263757.280878:0:8409:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e0c8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263757.280882:0:8409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e0c8 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263757.280898:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789263757.280929:0:6490:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e0c8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.280943:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e0c8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263757.280945:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e32d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+45:2398:x1876178888605696:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 116us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263757.280953:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 66 00000001:00080000:1.0:1789263757.281105:0:6490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967379 00000001:00080000:1.0:1789263757.281246:0:6490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000100:00100000:1.0:1789263757.281369:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6490:1876178898085888:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789263757.281571:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263757.281615:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd98a326e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789263757.281619:0:8499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898085888 00000100:00100000:3.0:1789263757.281625:0:8499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898085888 00000100:00100000:3.0:1789263757.281685:0:8499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789263757.281693:0:8499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6490:x1876178898085888:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789263757.281775:0:8499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6490:x1876178898085888:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 84us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263757.281794:0:8499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789263757.281819:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6490:1876178898085888:0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:0.0:1789263757.281863:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1789263757.281962:0:6490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000100:00100000:1.0:1789263757.282024:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6490:1876178898086016:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789263757.282056:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263757.282097:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd883e96e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789263757.282167:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898086016 00000100:00100000:3.0:1789263757.282172:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898086016 00000100:00100000:3.0:1789263757.282208:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789263757.282216:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6490:x1876178898086016:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789263757.282326:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6490:x1876178898086016:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 110us (268us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1789263757.282332:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789263757.282370:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6490:1876178898086016:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789263757.282403:0:6490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:1.0:1789263757.282441:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e0c8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.282450:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e0c8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.282457:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e0c8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.282464:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd990433200 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263757.282468:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e0c8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.282476:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e0c8 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.282494:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd8829ed800) 00010000:00010000:1.0:1789263757.282496:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789263757.282499:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e0c8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.282503:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e0c8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789263757.282568:0:6490:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789263757.282618:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:1.0:1789263757.282629:0:6490:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 199572551252ns, next at 200572548927ns, rc = 0 00000001:00080000:1.0:1789263757.282635:0:6490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00010000:00010000:1.0:1789263757.282657:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd8829ed800) 00010000:00010000:1.0:1789263757.282660:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789263757.282665:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e0ac lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11df0 expref: 49 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263757.282750:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882a6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+48:11329:x1876178888605568:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 4096us (4201us total) trans 4294967384 rc 0/0 00000100:00100000:1.0:1789263757.282758:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 23 00000020:00080000:1.0:1789263757.282761:0:6490:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789263757.284264:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263757.284318:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888605824 00000100:00100000:1.0:1789263757.284328:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888605824 00000100:00100000:1.0:1789263757.284370:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 108 00000100:00100000:1.0:1789263757.284377:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+48:11329:x1876178888605824:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:1.0:1789263757.284394:0:7434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263757.284409:0:7434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2800/0xce1582440fb1e0cf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11dfe expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.284469:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2800/0xce1582440fb1e0cf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11dfe expref: 49 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.284483:0:7434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2800/0xce1582440fb1e0cf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11dfe expref: 49 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.284499:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd8829ed200) 00010000:00010000:1.0:1789263757.284502:0:7434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789263757.284506:0:7434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd8841a2800, rc 0) 00000100:00100000:1.0:1789263757.284552:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+49:11329:x1876178888605824:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 174us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263757.284559:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 108 00000100:00100000:3.0:1789263757.285867:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263757.285917:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888606080 00000100:00100000:2.0:1789263757.285932:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888606080 00000100:00100000:2.0:1789263757.285974:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 24 00000100:00100000:2.0:1789263757.285982:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+49:11329:x1876178888606080:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:2.0:1789263757.286202:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+50:11329:x1876178888606080:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 220us (341us total) trans 4294967385 rc 0/0 00000100:00100000:2.0:1789263757.286212:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 24 00000100:00100000:0.0:1789263757.317139:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263757.317201:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888606208 00000100:00100000:1.0:1789263757.317210:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888606208 00000100:00100000:1.0:1789263757.317263:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 109 00000100:00100000:1.0:1789263757.317275:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+50:11339:x1876178888606208:12345-192.168.203.20@tcp:34:lfs.0 00010000:00010000:1.0:1789263757.317347:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e0d6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.317377:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e0d6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.317388:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e0d6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.317400:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3800/0xce1582440fb1e0dd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.317430:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3800/0xce1582440fb1e0dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.317438:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3800/0xce1582440fb1e0dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.317504:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3a00/0xce1582440fb1e0e4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.317512:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3a00/0xce1582440fb1e0e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.317519:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3a00/0xce1582440fb1e0e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789263757.317571:0:6488:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3a00/0xce1582440fb1e0e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.317582:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e0d6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.317588:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e0d6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.317595:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e0d6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.317601:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd8841a2a00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263757.317606:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e0d6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.317613:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e0d6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.317638:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dd8829ed600) 00010000:00010000:1.0:1789263757.317641:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263757.317646:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e0d6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.317652:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e0d6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.317667:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3800/0xce1582440fb1e0dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.317673:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3800/0xce1582440fb1e0dd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.317679:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3800/0xce1582440fb1e0dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.317684:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd8841a3800 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263757.317688:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3800/0xce1582440fb1e0dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.317694:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3800/0xce1582440fb1e0dd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.317702:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9dd9bb595c00) 00010000:00010000:1.0:1789263757.317704:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263757.317707:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3800/0xce1582440fb1e0dd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.317712:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3800/0xce1582440fb1e0dd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.317734:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3a00/0xce1582440fb1e0e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.317740:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3a00/0xce1582440fb1e0e4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.317746:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3a00/0xce1582440fb1e0e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.317751:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd8841a3a00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263757.317762:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3a00/0xce1582440fb1e0e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.317768:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3a00/0xce1582440fb1e0e4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.317787:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd8829ed200) 00010000:00010000:1.0:1789263757.317790:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263757.317793:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3a00/0xce1582440fb1e0e4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.317799:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3a00/0xce1582440fb1e0e4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263757.317879:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+50:11339:x1876178888606208:12345-192.168.203.20@tcp:34:lfs.0 Request processed in 606us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263757.317886:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 109 00000100:00100000:0.0:1789263757.337488:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263757.337590:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888606464 00000100:00100000:3.0:1789263757.337600:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888606464 00000100:00100000:3.0:1789263757.337659:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 110 00000100:00100000:3.0:1789263757.337669:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+50:11342:x1876178888606464:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:3.0:1789263757.337690:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263757.337708:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433800/0xce1582440fb1e0eb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11e05 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.338395:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1e0f2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.338411:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1e0f2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.338422:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1e0f2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.338431:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432200/0xce1582440fb1e0f9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.338436:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432200/0xce1582440fb1e0f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.338441:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432200/0xce1582440fb1e0f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.338536:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e100 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.338542:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e100 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.338552:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e100 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789263757.338559:0:6489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789263757.338623:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1e0f2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.338628:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1e0f2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.338633:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1e0f2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.338636:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd990433600 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263757.338640:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1e0f2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.338647:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1e0f2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.338659:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dd8829ed600) 00010000:00010000:3.0:1789263757.338662:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789263757.338666:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1e0f2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.338672:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1e0f2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.338685:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432200/0xce1582440fb1e0f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.338690:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432200/0xce1582440fb1e0f9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.338698:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432200/0xce1582440fb1e0f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.338701:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd990432200 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263757.338703:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432200/0xce1582440fb1e0f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.338707:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432200/0xce1582440fb1e0f9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.338712:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9dd9bb595c00) 00010000:00010000:3.0:1789263757.338714:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789263757.338716:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432200/0xce1582440fb1e0f9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.338719:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432200/0xce1582440fb1e0f9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.338744:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433800/0xce1582440fb1e0eb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e05 expref: 53 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.338752:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e100 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e05 expref: 52 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.338756:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd8829ed200) 00010000:00010000:3.0:1789263757.338758:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789263757.338759:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd990433200, rc 0) 00000100:00100000:3.0:1789263757.338829:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+52:11342:x1876178888606464:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 1158us (1353us total) trans 4294967386 rc 0/0 00000100:00100000:3.0:1789263757.338844:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 110 00000100:00100000:3.0:1789263757.340192:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263757.340240:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888606592 00000100:00100000:1.0:1789263757.340247:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888606592 00000100:00100000:1.0:1789263757.340286:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 111 00000100:00100000:1.0:1789263757.340306:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+52:11342:x1876178888606592:12345-192.168.203.20@tcp:54:lfs.0 00010000:00010000:1.0:1789263757.340347:0:7434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3a00/0xce1582440fb1e10e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.340357:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3a00/0xce1582440fb1e10e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.340366:0:7434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3a00/0xce1582440fb1e10e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.340385:0:7434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3a00/0xce1582440fb1e10e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.340391:0:7434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3a00/0xce1582440fb1e10e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.340397:0:7434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3a00/0xce1582440fb1e10e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.340403:0:7434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd8841a3a00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263757.340407:0:7434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3a00/0xce1582440fb1e10e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.340413:0:7434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3a00/0xce1582440fb1e10e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.340421:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd8829ed200) 00010000:00010000:1.0:1789263757.340423:0:7434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789263757.340426:0:7434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3a00/0xce1582440fb1e10e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.340431:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3a00/0xce1582440fb1e10e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263757.340489:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+52:11342:x1876178888606592:12345-192.168.203.20@tcp:54:lfs.0 Request processed in 186us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263757.340497:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 111 00000100:00100000:0.0:1789263757.341311:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263757.341353:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888606848 00000100:00100000:1.0:1789263757.341365:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888606848 00000100:00100000:1.0:1789263757.341398:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 25 00000100:00100000:1.0:1789263757.341407:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+52:11342:x1876178888606848:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:1.0:1789263757.341545:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+53:11342:x1876178888606848:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 140us (234us total) trans 4294967387 rc 0/0 00000100:00100000:1.0:1789263757.341550:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 25 00000100:00100000:3.0:1789263757.357292:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789263757.357315:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898086144:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789263757.357382:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263757.357433:0:8499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898086144 00000100:00100000:0.0:1789263757.357442:0:8499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898086144 00000100:00100000:0.0:1789263757.357490:0:8499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789263757.357500:0:8499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1876178898086144:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789263757.357530:0:8499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1789263757.357581:0:8499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1876178898086144:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263757.357589:0:8499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789263757.357626:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898086144:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789263757.371211:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263757.371274:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888607104 00000100:00100000:1.0:1789263757.371296:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888607104 00000100:00100000:1.0:1789263757.371352:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 112 00000100:00100000:1.0:1789263757.371364:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+53:11352:x1876178888607104:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:1.0:1789263757.371389:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263757.371393:0:6488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789263757.371417:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73200/0xce1582440fb1e089 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11de2 expref: 53 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.371431:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dd8829ed600) 00010000:00010000:1.0:1789263757.371435:0:6488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789263757.371447:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3a00/0xce1582440fb1e115 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11e0c expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.371542:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3800/0xce1582440fb1e11c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.371569:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e100 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e05 expref: 53 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.371578:0:6488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3800/0xce1582440fb1e11c lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.371609:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e100 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e05 expref: 53 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.371622:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e100 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e05 expref: 53 pid: 6489 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263757.371637:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6488:1876178898086272:192.168.203.20@tcp:104: 00000100:00100000:1.0:1789263757.371729:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd883e96180 going to sleep for 11 seconds 00000100:00100000:1.0:1789263757.372606:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6488:1876178898086272:192.168.203.20@tcp:104: 00010000:00010000:1.0:1789263757.372626:0:6488:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3800/0xce1582440fb1e11c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263757.372793:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263757.372865:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888607232 00000100:00100000:3.0:1789263757.372870:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888607232 00010000:00010000:3.0:1789263757.372890:0:6473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e100 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e05 expref: 54 pid: 6489 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263757.372921:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 67 00000100:00100000:3.0:1789263757.372929:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+54:2397:x1876178888607232:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789263757.372940:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789263757.372947:0:6473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e100 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e05 expref: 54 pid: 6489 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.372959:0:6473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e100 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e05 expref: 54 pid: 6489 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.372976:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e100 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e05 expref: 54 pid: 6489 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.372988:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd8829ed200) 00010000:00010000:3.0:1789263757.372991:0:6473:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3800/0xce1582440fb1e11c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.373005:0:6473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3800/0xce1582440fb1e11c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.373012:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3800/0xce1582440fb1e11c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.373036:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789263757.373058:0:6488:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3800/0xce1582440fb1e11c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.373067:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3800/0xce1582440fb1e11c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263757.373073:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+53:2397:x1876178888607232:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 144us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263757.373113:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 67 00000004:00200000:1.0:1789263757.373122:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1789263757.373232:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3a00/0xce1582440fb1e115 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e0c expref: 54 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.373259:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3800/0xce1582440fb1e11c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e0c expref: 53 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.373267:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd8829ed200) 00010000:00010000:1.0:1789263757.373270:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789263757.373273:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd8841a3800, rc 0) 00000100:00100000:1.0:1789263757.373302:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+53:11352:x1876178888607104:12345-192.168.203.20@tcp:101:bash.0 Request processed in 1941us (2101us total) trans 4294967388 rc 0/0 00000100:00100000:1.0:1789263757.373309:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 112 00000100:00100000:0.0:1789263757.374429:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263757.374470:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888607360 00000100:00100000:3.0:1789263757.374477:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888607360 00000100:00100000:3.0:1789263757.374514:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 113 00000100:00100000:3.0:1789263757.374523:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883f5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+53:11352:x1876178888607360:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:3.0:1789263757.374540:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263757.374553:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1e12a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11e13 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.374577:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1e131 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.374588:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1e131 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.374596:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1e131 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.374685:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1e12a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e13 expref: 55 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.374709:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1e131 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e13 expref: 54 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.374716:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd8829ed200) 00010000:00010000:3.0:1789263757.374718:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789263757.374721:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981530200, rc 0) 00000100:00100000:3.0:1789263757.374764:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883f5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+54:11352:x1876178888607360:12345-192.168.203.20@tcp:101:bash.0 Request processed in 242us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263757.374771:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 113 00000100:00100000:3.0:1789263757.375906:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263757.375946:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888607616 00000100:00100000:1.0:1789263757.375953:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888607616 00000100:00100000:1.0:1789263757.375989:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 114 00000100:00100000:1.0:1789263757.375997:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+54:11352:x1876178888607616:12345-192.168.203.20@tcp:36:bash.0 00010000:00010000:1.0:1789263757.376186:0:7434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e138 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.376198:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e138 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.376207:0:7434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e138 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789263757.376263:0:7434:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00000004:00010000:1.0:1789263757.376286:0:7434:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004b322dd6 reply state 00000000104000cc transno 4294967390 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e138 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.376298:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e138 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.376313:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd8829ed200) 00010000:00010000:1.0:1789263757.376316:0:7434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789263757.376319:0:7434:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789263757.376393:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+57:11352:x1876178888607616:12345-192.168.203.20@tcp:36:bash.0 Request processed in 396us (487us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1789263757.376400:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 114 00000020:00080000:1.0:1789263757.376404:0:7434:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789263757.377333:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263757.377369:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888607744 00000100:00100000:1.0:1789263757.377376:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888607744 00000100:00100000:1.0:1789263757.377412:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 115 00000100:00100000:1.0:1789263757.377420:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883f5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+57:11352:x1876178888607744:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:1.0:1789263757.377433:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263757.377445:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3400/0xce1582440fb1e13f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11e1a expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.377497:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3c00/0xce1582440fb1e146 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.377509:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3800/0xce1582440fb1e11c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e0c expref: 58 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.377517:0:6488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3c00/0xce1582440fb1e146 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.377543:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3800/0xce1582440fb1e11c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e0c expref: 58 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.377556:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3800/0xce1582440fb1e11c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e0c expref: 58 pid: 6488 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263757.377577:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6488:1876178898086400:192.168.203.20@tcp:104: 00000100:00100000:1.0:1789263757.377645:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd883e96180 going to sleep for 11 seconds 00000100:00100000:1.0:1789263757.378952:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6488:1876178898086400:192.168.203.20@tcp:104: 00010000:00010000:1.0:1789263757.378973:0:6488:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3c00/0xce1582440fb1e146 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263757.379051:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263757.379147:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888607872 00000100:00100000:3.0:1789263757.379154:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888607872 00010000:00010000:3.0:1789263757.379181:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3800/0xce1582440fb1e11c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e0c expref: 59 pid: 6488 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263757.379211:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 68 00000100:00100000:3.0:1789263757.379220:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883f5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+59:2397:x1876178888607872:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789263757.379230:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789263757.379237:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3800/0xce1582440fb1e11c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e0c expref: 59 pid: 6488 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.379249:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3800/0xce1582440fb1e11c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e0c expref: 59 pid: 6488 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.379268:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3800/0xce1582440fb1e11c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e0c expref: 59 pid: 6488 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.379298:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd8829ed200) 00010000:00010000:3.0:1789263757.379303:0:6474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3c00/0xce1582440fb1e146 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.379312:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3c00/0xce1582440fb1e146 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.379319:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3c00/0xce1582440fb1e146 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.379341:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789263757.379361:0:6488:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3c00/0xce1582440fb1e146 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.379370:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3c00/0xce1582440fb1e146 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263757.379389:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883f5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+58:2397:x1876178888607872:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 169us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263757.379397:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 68 00000004:00200000:1.0:1789263757.379407:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1789263757.379413:0:6488:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789263757.379432:0:6488:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3c00/0xce1582440fb1e146 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.379462:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3400/0xce1582440fb1e13f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e1a expref: 58 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.379478:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3c00/0xce1582440fb1e146 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e1a expref: 57 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.379485:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd8829ed200) 00010000:00010000:1.0:1789263757.379488:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789263757.379490:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd8841a3c00, rc 0) 00000100:00100000:1.0:1789263757.379524:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883f5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+57:11352:x1876178888607744:12345-192.168.203.20@tcp:101:bash.0 Request processed in 2105us (2193us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263757.379536:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 115 00000100:00100000:0.0:1789263757.380853:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263757.380920:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888608128 00000100:00100000:2.0:1789263757.380927:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888608128 00000100:00100000:2.0:1789263757.380971:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 26 00000100:00100000:2.0:1789263757.380980:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd987344450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+57:11352:x1876178888608128:12345-192.168.203.20@tcp:35:bash.0 00000100:00100000:2.0:1789263757.381183:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd987344450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+58:11352:x1876178888608128:12345-192.168.203.20@tcp:35:bash.0 Request processed in 203us (331us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1789263757.381190:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 26 00000100:00100000:0.0:1789263757.404634:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263757.404734:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888608256 00000100:00100000:3.0:1789263757.404748:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888608256 00000100:00100000:3.0:1789263757.404825:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 116 00000100:00100000:3.0:1789263757.404845:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9838fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+58:11358:x1876178888608256:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:3.0:1789263757.404878:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263757.404903:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1e14d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11e21 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.404982:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1e154 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.404998:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1e154 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.405011:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1e154 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789263757.405115:0:6489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1789263757.405119:0:6489:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789263757.405143:0:6489:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1e154 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.405174:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1e14d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e21 expref: 60 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.405194:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1e154 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e21 expref: 59 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263757.405205:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dd8829ed600) 00010000:00010000:3.0:1789263757.405208:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789263757.405212:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981530c00, rc 0) 00000100:00100000:3.0:1789263757.405342:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9838fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+59:11358:x1876178888608256:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 507us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263757.405350:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 116 00000100:00100000:0.0:1789263757.406879:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263757.406963:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888608384 00000100:00100000:1.0:1789263757.406978:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888608384 00000100:00100000:1.0:1789263757.407049:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 117 00000100:00100000:1.0:1789263757.407060:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9838ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+59:11358:x1876178888608384:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:1.0:1789263757.407109:0:7434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263757.407132:0:7434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3400/0xce1582440fb1e15b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11e28 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.407195:0:7434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3a00/0xce1582440fb1e162 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.407209:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3a00/0xce1582440fb1e162 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.407220:0:7434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3a00/0xce1582440fb1e162 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.407231:0:7434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1e169 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.407237:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1e169 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.407244:0:7434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1e169 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.407313:0:7434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1e170 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.407340:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1e170 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.407348:0:7434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1e170 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789263757.407398:0:7434:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1789263757.407402:0:7434:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789263757.407419:0:7434:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1e170 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.407430:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1e170 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.407438:0:7434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3a00/0xce1582440fb1e162 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.407444:0:7434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3a00/0xce1582440fb1e162 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.407451:0:7434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3a00/0xce1582440fb1e162 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.407456:0:7434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd8841a3a00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263757.407460:0:7434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3a00/0xce1582440fb1e162 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.407468:0:7434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3a00/0xce1582440fb1e162 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.407481:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dd8829ed600) 00010000:00010000:1.0:1789263757.407484:0:7434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263757.407495:0:7434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3a00/0xce1582440fb1e162 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.407501:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3a00/0xce1582440fb1e162 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.407514:0:7434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1e169 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.407521:0:7434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1e169 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.407526:0:7434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1e169 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.407531:0:7434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd8841a2e00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263757.407534:0:7434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1e169 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.407539:0:7434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1e169 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.407547:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9dd9bb595c00) 00010000:00010000:1.0:1789263757.407550:0:7434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263757.407552:0:7434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1e169 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.407558:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1e169 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.407583:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3400/0xce1582440fb1e15b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e28 expref: 61 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.407607:0:7434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1e170 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e28 expref: 60 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.407614:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd8829ed200) 00010000:00010000:1.0:1789263757.407616:0:7434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789263757.407618:0:7434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd8841a2600, rc 0) 00000100:00100000:1.0:1789263757.407698:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9838ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+60:11358:x1876178888608384:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 634us (820us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263757.407707:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 117 00000100:00100000:0.0:1789263757.409542:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263757.409593:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263757.409647:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888608768 00000100:00100000:2.0:1789263757.409654:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888608768 00000100:00100000:1.0:1789263757.409681:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888608640 00000100:00100000:1.0:1789263757.409687:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888608640 00000100:00100000:2.0:1789263757.409702:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 6 00000100:00100000:2.0:1789263757.409714:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9838fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+61:2397:x1876178888608768:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789263757.409728:0:6472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789263757.409735:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 118 00000100:00100000:1.0:1789263757.409746:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9838ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+61:11358:x1876178888608640:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:2.0:1789263757.409749:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1e170 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e28 expref: 61 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.409762:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263757.409767:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd8829ed200) 00010000:00010000:2.0:1789263757.409772:0:6472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789263757.409789:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3000/0xce1582440fb1e177 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11e2f expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263757.409964:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9838fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+61:2397:x1876178888608768:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 252us (368us total) trans 0 rc 0/0 00010000:00010000:1.0:1789263757.409968:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2200/0xce1582440fb1e17e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263757.409975:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 6 00010000:00010000:1.0:1789263757.409995:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3c00/0xce1582440fb1e146 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e1a expref: 61 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.410005:0:6488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2200/0xce1582440fb1e17e lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.410033:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3c00/0xce1582440fb1e146 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e1a expref: 60 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.410053:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3c00/0xce1582440fb1e146 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e1a expref: 60 pid: 6488 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263757.410067:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6488:1876178898086528:192.168.203.20@tcp:104: 00000100:00100000:1.0:1789263757.410162:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd883e96180 going to sleep for 11 seconds 00000100:00100000:1.0:1789263757.411296:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6488:1876178898086528:192.168.203.20@tcp:104: 00010000:00010000:1.0:1789263757.411317:0:6488:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2200/0xce1582440fb1e17e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263757.411538:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263757.411585:0:10303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888608896 00000100:00100000:2.0:1789263757.411591:0:10303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888608896 00010000:00010000:2.0:1789263757.411615:0:10303:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3c00/0xce1582440fb1e146 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e1a expref: 61 pid: 6488 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263757.411645:0:10303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 69 00000100:00100000:2.0:1789263757.411652:0:10303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98fe85850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3ce90ea2-917f-4b54-98b0-25e051f2317f+61:2398:x1876178888608896:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789263757.411662:0:10303:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789263757.411668:0:10303:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3c00/0xce1582440fb1e146 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e1a expref: 61 pid: 6488 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263757.411680:0:10303:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3c00/0xce1582440fb1e146 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e1a expref: 61 pid: 6488 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263757.411696:0:10303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3c00/0xce1582440fb1e146 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e1a expref: 61 pid: 6488 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263757.411710:0:10303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd8829ed200) 00010000:00010000:2.0:1789263757.411721:0:10303:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2200/0xce1582440fb1e17e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263757.411731:0:10303:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2200/0xce1582440fb1e17e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263757.411739:0:10303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2200/0xce1582440fb1e17e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263757.411763:0:10303:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789263757.411796:0:6488:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2200/0xce1582440fb1e17e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.411807:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2200/0xce1582440fb1e17e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263757.411820:0:10303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98fe85850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3ce90ea2-917f-4b54-98b0-25e051f2317f+60:2398:x1876178888608896:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 165us (279us total) trans 0 rc 0/0 00000004:00200000:1.0:1789263757.411823:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000100:00100000:2.0:1789263757.411849:0:10303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 69 00010000:00010000:1.0:1789263757.411971:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3000/0xce1582440fb1e177 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e2f expref: 61 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.411985:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2200/0xce1582440fb1e17e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e2f expref: 60 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.411991:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd8829ed200) 00010000:00010000:1.0:1789263757.411993:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789263757.411995:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd8841a2200, rc 0) 00000100:00100000:1.0:1789263757.412023:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9838ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+60:11358:x1876178888608640:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 2281us (2487us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1789263757.412035:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 118 00000100:00100000:0.0:1789263757.413204:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263757.413237:0:7428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888609152 00000100:00100000:1.0:1789263757.413245:0:7428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888609152 00000100:00100000:1.0:1789263757.413279:0:7428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 7 00000100:00100000:1.0:1789263757.413285:0:7428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9838fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+60:11358:x1876178888609152:12345-192.168.203.20@tcp:103:lfs.0 00010000:00010000:1.0:1789263757.413292:0:7428:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789263757.413304:0:7428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2800/0xce1582440fb1e0cf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11dfe expref: 60 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.413313:0:7428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd8829ed200) 00010000:00010000:1.0:1789263757.413316:0:7428:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789263757.413339:0:7428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9838fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+59:11358:x1876178888609152:12345-192.168.203.20@tcp:103:lfs.0 Request processed in 55us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263757.413343:0:7428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 7 00000100:00100000:0.0:1789263757.414021:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263757.414068:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888609280 00000100:00100000:2.0:1789263757.414074:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888609280 00000100:00100000:2.0:1789263757.414124:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 119 00000100:00100000:2.0:1789263757.414133:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9838fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+59:11358:x1876178888609280:12345-192.168.203.20@tcp:58:lfs.0 00010000:00010000:2.0:1789263757.414215:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1e18c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263757.414228:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1e18c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263757.414238:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1e18c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789263757.414370:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1789263757.414423:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9838fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+59:11358:x1876178888609280:12345-192.168.203.20@tcp:58:lfs.0 Request processed in 291us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263757.414430:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 119 00000100:00100000:0.0:1789263757.415422:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263757.415490:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888609408 00000100:00100000:1.0:1789263757.415496:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888609408 00000100:00100000:1.0:1789263757.415536:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 120 00000100:00100000:1.0:1789263757.415544:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989ae1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+59:11358:x1876178888609408:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:1.0:1789263757.415556:0:7434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263757.415568:0:7434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3400/0xce1582440fb1e193 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11e36 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.415606:0:7434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1e18c lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.415617:0:7434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3400/0xce1582440fb1e193 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e36 expref: 60 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.415646:0:7434:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1e18c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.415659:0:7434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3400/0xce1582440fb1e193 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e36 expref: 60 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.415667:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd8829ed200) 00010000:00010000:1.0:1789263757.415669:0:7434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789263757.415672:0:7434:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3400/0xce1582440fb1e193 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e36 expref: 60 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263757.415677:0:7434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd8841a3400, rc 0) 00000100:00100000:1.0:1789263757.415711:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989ae1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+60:11358:x1876178888609408:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 167us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263757.415718:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 120 00010000:00010000:1.0:1789263757.741241:0:13689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789263758.061493:0:13757:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789263758.061502:0:13757:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789263758.061692:0:13757:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1789263758.061700:0:13757:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789263758.061824:0:13757:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7dc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13757:1876178898086656:192.168.203.20@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789263758.061922:0:13757:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd883e96900 going to sleep for 11 seconds 00000100:00100000:0.0:1789263758.063885:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263758.064036:0:13757:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7dc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13757:1876178898086656:192.168.203.20@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789263758.064202:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888609536 00000100:00100000:2.0:1789263758.064209:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888609536 00000100:00100000:2.0:1789263758.064259:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 121 00000100:00100000:2.0:1789263758.064269:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989ae2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+60:11359:x1876178888609536:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789263758.064297:0:6488:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789263758.064393:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989ae2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+60:11359:x1876178888609536:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 Request processed in 125us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263758.064401:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 121 00000100:00100000:0.0:1789263758.066179:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263758.066220:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888609664 00000100:00100000:2.0:1789263758.066240:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888609664 00000100:00100000:2.0:1789263758.066275:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 122 00000100:00100000:2.0:1789263758.066283:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989ae1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+60:11359:x1876178888609664:12345-192.168.203.20@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789263758.066344:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805a00/0xce1582440fb1e19a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.066360:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805a00/0xce1582440fb1e19a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.066371:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805a00/0xce1582440fb1e19a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.066387:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804c00/0xce1582440fb1e1a1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.066394:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804c00/0xce1582440fb1e1a1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.066401:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804c00/0xce1582440fb1e1a1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.066421:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804000/0xce1582440fb1e1a8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.066428:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804000/0xce1582440fb1e1a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.066436:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804000/0xce1582440fb1e1a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789263758.066473:0:8417:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789263758.066477:0:8417:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789263758.066496:0:8417:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804000/0xce1582440fb1e1a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.066507:0:8417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805a00/0xce1582440fb1e19a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.066514:0:8417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805a00/0xce1582440fb1e19a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.066521:0:8417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805a00/0xce1582440fb1e19a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.066527:0:8417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bb805a00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263758.066531:0:8417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805a00/0xce1582440fb1e19a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.066538:0:8417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805a00/0xce1582440fb1e19a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.066550:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9dd8829ed700) 00010000:00010000:2.0:1789263758.066553:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789263758.066558:0:8417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805a00/0xce1582440fb1e19a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.066564:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805a00/0xce1582440fb1e19a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.066575:0:8417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804c00/0xce1582440fb1e1a1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.066580:0:8417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804c00/0xce1582440fb1e1a1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.066586:0:8417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804c00/0xce1582440fb1e1a1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.066598:0:8417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bb804c00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263758.066601:0:8417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804c00/0xce1582440fb1e1a1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.066608:0:8417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804c00/0xce1582440fb1e1a1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.066615:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff9dd9ba858300) 00010000:00010000:2.0:1789263758.066616:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789263758.066618:0:8417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804c00/0xce1582440fb1e1a1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.066624:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804c00/0xce1582440fb1e1a1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.066638:0:8417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804000/0xce1582440fb1e1a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.066644:0:8417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804000/0xce1582440fb1e1a8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.066650:0:8417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804000/0xce1582440fb1e1a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.066655:0:8417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bb804000 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263758.066658:0:8417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804000/0xce1582440fb1e1a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.066664:0:8417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804000/0xce1582440fb1e1a8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.066681:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd8829ed200) 00010000:00010000:2.0:1789263758.066683:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789263758.066685:0:8417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804000/0xce1582440fb1e1a8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.066689:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804000/0xce1582440fb1e1a8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263758.066756:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989ae1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+60:11359:x1876178888609664:12345-192.168.203.20@tcp:34:lhsmtool_posix.0 Request processed in 472us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263758.066763:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 122 00000100:00100000:1.0:1789263758.068435:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263758.068504:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888609920 00000100:00100000:3.0:1789263758.068512:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888609920 00000100:00100000:3.0:1789263758.068552:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 123 00000100:00100000:3.0:1789263758.068561:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+60:11359:x1876178888609920:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789263758.068576:0:7434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263758.068597:0:7434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1e1af lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11e3d expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263758.068673:0:7434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1e1b6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263758.068696:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1e1b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263758.068705:0:7434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1e1b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789263758.068767:0:7434:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789263758.068841:0:7434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1e1b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263758.068848:0:7434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1e1b6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263758.068855:0:7434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1e1b6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263758.068861:0:7434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981531600 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263758.068865:0:7434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1e1b6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263758.068872:0:7434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1e1b6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263758.068882:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd8829ed200) 00010000:00010000:3.0:1789263758.068884:0:7434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789263758.068888:0:7434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1e1b6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263758.068895:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1e1b6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263758.068930:0:7434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1e1af lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e3d expref: 62 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263758.068947:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9dd8829ed700) 00010000:00010000:3.0:1789263758.068950:0:7434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789263758.068954:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1e1af lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e3d expref: 62 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263758.068964:0:7434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981530e00, rc 0) 00000100:00100000:3.0:1789263758.069016:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+61:11359:x1876178888609920:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 456us (585us total) trans 4294967393 rc 301/301 00000100:00100000:3.0:1789263758.069023:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 123 00000100:00100000:0.0:1789263758.070151:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263758.070204:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888610048 00000100:00100000:1.0:1789263758.070216:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888610048 00000100:00100000:1.0:1789263758.070258:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 124 00000100:00100000:1.0:1789263758.070267:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989ae3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+61:11359:x1876178888610048:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789263758.070286:0:6487:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789263758.070364:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989ae3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+61:11359:x1876178888610048:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 Request processed in 90us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263758.070372:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 124 00000100:00100000:0.0:1789263758.071666:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263758.071703:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888610304 00000100:00100000:2.0:1789263758.071709:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888610304 00000100:00100000:2.0:1789263758.071747:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 125 00000100:00100000:2.0:1789263758.071756:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989ae1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+61:11359:x1876178888610304:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789263758.071781:0:8417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263758.071784:0:8417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789263758.071805:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1e154 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e21 expref: 61 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.071821:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dd8829ed600) 00010000:00010000:2.0:1789263758.071825:0:8417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789263758.071836:0:8417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804a00/0xce1582440fb1e1c4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11e44 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789263758.072148:0:8417:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:2.0:1789263758.072277:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805c00/0xce1582440fb1e1cb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.072300:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805c00/0xce1582440fb1e1cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.072309:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805c00/0xce1582440fb1e1cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.072354:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804a00/0xce1582440fb1e1c4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e44 expref: 63 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.072376:0:8417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805c00/0xce1582440fb1e1cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e44 expref: 62 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.072387:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9dd9ba858000) 00010000:00010000:2.0:1789263758.072389:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789263758.072392:0:8417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bb805c00, rc 0) 00000100:00100000:2.0:1789263758.072435:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989ae1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+62:11359:x1876178888610304:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 680us (774us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1789263758.072443:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 125 00000100:00100000:0.0:1789263758.074406:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263758.074464:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888610560 00000100:00100000:3.0:1789263758.074473:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888610560 00000100:00100000:3.0:1789263758.074524:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 126 00000100:00100000:3.0:1789263758.074533:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+62:11359:x1876178888610560:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789263758.074572:0:7434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789263758.074589:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805c00/0xce1582440fb1e1cb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e44 expref: 62 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263758.074603:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9dd9ba858000) 00010000:00010000:3.0:1789263758.074613:0:7434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789263758.074632:0:7434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1e1d9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263758.074645:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1e1d9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263758.074653:0:7434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1e1d9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263758.074682:0:7434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e1e0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x587d17fb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263758.074690:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e1e0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x587d17fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263758.074697:0:7434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e1e0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x587d17fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263758.074731:0:7434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1e1d9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263758.074738:0:7434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1e1d9 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263758.074745:0:7434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1e1d9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263758.074751:0:7434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981530a00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263758.074755:0:7434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1e1d9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263758.074762:0:7434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1e1d9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263758.074782:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dd8829ed600) 00010000:00010000:3.0:1789263758.074786:0:7434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789263758.074789:0:7434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1e1d9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263758.074796:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1e1d9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263758.074813:0:7434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e1e0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x587d17fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263758.074817:0:7434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e1e0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x587d17fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263758.074821:0:7434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e1e0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x587d17fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263758.074824:0:7434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd990433200 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263758.074826:0:7434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e1e0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x587d17fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263758.074830:0:7434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e1e0 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x587d17fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263758.074835:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x587d17fb (ffff9dd9bb595a00) 00010000:00010000:3.0:1789263758.074836:0:7434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789263758.074838:0:7434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e1e0 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x587d17fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263758.074841:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e1e0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x587d17fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263758.074900:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+61:11359:x1876178888610560:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 Request processed in 368us (501us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789263758.074904:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 126 00000100:00100000:0.0:1789263758.077592:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263758.077681:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888610688 00000100:00100000:1.0:1789263758.077690:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888610688 00000100:00100000:1.0:1789263758.077743:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 127 00000100:00100000:1.0:1789263758.077754:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+61:11359:x1876178888610688:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789263758.077785:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263758.077806:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3000/0xce1582440fb1e1e7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11e4b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263758.077840:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1e1ee lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263758.077852:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1e1ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263758.077863:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1e1ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263758.077969:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3000/0xce1582440fb1e1e7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e4b expref: 63 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263758.077988:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1e1ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e4b expref: 62 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263758.078008:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9dd8829ed800) 00010000:00010000:1.0:1789263758.078011:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789263758.078014:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd8841a2e00, rc 0) 00000100:00100000:1.0:1789263758.078146:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+62:11359:x1876178888610688:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 390us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263758.078155:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 127 00000100:00100000:0.0:1789263758.079572:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263758.079641:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888610944 00000100:00100000:2.0:1789263758.079648:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888610944 00000100:00100000:2.0:1789263758.079688:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 128 00000100:00100000:2.0:1789263758.079698:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+62:11359:x1876178888610944:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789263758.079754:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805600/0xce1582440fb1e1f5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.079767:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805600/0xce1582440fb1e1f5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.079804:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805600/0xce1582440fb1e1f5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789263758.079943:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00010000:2.0:1789263758.079991:0:8417:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c2c1aab6 reply state 00000000ee19bfd4 transno 4294967395 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805600/0xce1582440fb1e1f5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.080000:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805600/0xce1582440fb1e1f5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.080004:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9dd8829ed800) 00010000:00010000:2.0:1789263758.080006:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1789263758.080008:0:8417:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789263758.080073:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+64:11359:x1876178888610944:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 Request processed in 377us (504us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1789263758.080138:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 128 00000100:00100000:0.0:1789263758.080943:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263758.080980:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888611072 00000100:00100000:3.0:1789263758.080986:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888611072 00000100:00100000:3.0:1789263758.081023:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 129 00000100:00100000:3.0:1789263758.081039:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+64:11359:x1876178888611072:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789263758.081054:0:7434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263758.081065:0:7434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433800/0xce1582440fb1e1fc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11e52 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263758.081126:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433800/0xce1582440fb1e1fc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e52 expref: 65 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263758.081138:0:7434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433800/0xce1582440fb1e1fc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e52 expref: 65 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263758.081152:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9dd8829ed800) 00010000:00010000:3.0:1789263758.081155:0:7434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789263758.081158:0:7434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd990433800, rc 0) 00000100:00100000:3.0:1789263758.081197:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+65:11359:x1876178888611072:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 159us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263758.081203:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 129 00000100:00100000:0.0:1789263758.085551:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263758.085661:0:8511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888611200 00000100:00100000:2.0:1789263758.085687:0:8511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888611200 00000100:00100000:2.0:1789263758.085765:0:8511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 45 00000100:00100000:2.0:1789263758.085789:0:8511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8842e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+8:2398:x1876178888611200:12345-192.168.203.20@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789263758.086153:0:8511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8842e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+9:2398:x1876178888611200:12345-192.168.203.20@tcp:2:lhsmtool_posix.0 Request processed in 367us (615us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1789263758.086162:0:8511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 45 00000100:00100000:0.0:1789263758.087331:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263758.087388:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888611456 00000100:00100000:1.0:1789263758.087400:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888611456 00000100:00100000:1.0:1789263758.087486:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 27 00000100:00100000:1.0:1789263758.087495:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8842e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+65:11359:x1876178888611456:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789263758.087671:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8842e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+66:11359:x1876178888611456:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 Request processed in 178us (348us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1789263758.087676:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 27 00000100:00100000:0.0:1789263758.088647:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263758.088698:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888611712 00000100:00100000:1.0:1789263758.088707:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888611712 00000100:00100000:1.0:1789263758.088752:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 130 00000100:00100000:1.0:1789263758.088760:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8842e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+66:11359:x1876178888611712:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789263758.088846:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8842e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+66:11359:x1876178888611712:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 Request processed in 85us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263758.088854:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 130 00000100:00100000:0.0:1789263758.089979:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263758.090023:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888611840 00000100:00100000:2.0:1789263758.090029:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888611840 00000100:00100000:2.0:1789263758.090066:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 131 00000100:00100000:2.0:1789263758.090098:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8842e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+66:11359:x1876178888611840:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789263758.090126:0:8417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263758.090141:0:8417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804000/0xce1582440fb1e203 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11e59 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.090196:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804c00/0xce1582440fb1e20a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.090214:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804c00/0xce1582440fb1e20a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.090222:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804c00/0xce1582440fb1e20a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789263758.090259:0:8417:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789263758.090275:0:8417:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804c00/0xce1582440fb1e20a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.090299:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804000/0xce1582440fb1e203 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e59 expref: 68 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.090322:0:8417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804c00/0xce1582440fb1e20a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e59 expref: 67 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.090330:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9dd8829ed800) 00010000:00010000:2.0:1789263758.090332:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789263758.090335:0:8417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bb804c00, rc 0) 00000100:00100000:2.0:1789263758.090382:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8842e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+67:11359:x1876178888611840:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 308us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263758.090390:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 131 00000100:00100000:0.0:1789263758.091648:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263758.091697:0:8394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888611968 00000100:00100000:3.0:1789263758.091705:0:8394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888611968 00000100:00100000:3.0:1789263758.091792:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 46 00000100:00100000:3.0:1789263758.091800:0:8394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8842eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+9:2397:x1876178888611968:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789263758.091812:0:8394:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263758.091825:0:8394:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002376e077/0xce1582440fb1e211 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11e60 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789263758.091850:0:8394:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa5ff8e, blocks: 0x0 00010000:00010000:3.0:1789263758.091863:0:8394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=200s v=(0 0) 00010000:00010000:3.0:1789263758.091874:0:8394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789263758.091880:0:8394:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002376e077/0xce1582440fb1e211 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e60 expref: 10 pid: 8394 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263758.091893:0:8394:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002376e077/0xce1582440fb1e211 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e60 expref: 10 pid: 8394 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263758.091902:0:8394:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd990433200, rc 0) 00000100:00100000:3.0:1789263758.091942:0:8394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8842eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+10:2397:x1876178888611968:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 143us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263758.091949:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 46 00000100:00100000:0.0:1789263758.093376:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263758.093460:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888612224 00000100:00100000:3.0:1789263758.093469:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888612224 00000100:00100000:3.0:1789263758.093523:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 132 00000100:00100000:3.0:1789263758.093532:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8842eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+67:11359:x1876178888612224:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789263758.093675:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8842eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+67:11359:x1876178888612224:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 Request processed in 140us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263758.093682:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 132 00000100:00100000:0.0:1789263758.095175:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263758.095220:0:8395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888612352 00000100:00100000:2.0:1789263758.095228:0:8395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888612352 00000100:00100000:2.0:1789263758.095270:0:8395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 47 00000100:00100000:2.0:1789263758.095279:0:8395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8842ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+10:11359:x1876178888612352:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789263758.095294:0:8395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263758.095315:0:8395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf4d6e42/0xce1582440fb1e218 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11e67 expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.095343:0:8395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002376e077/0xce1582440fb1e211 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e60 expref: 11 pid: 8394 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.095353:0:8395:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789263758.095357:0:8395:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789263758.095362:0:8395:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf4d6e42/0xce1582440fb1e218 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e67 expref: 11 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.095393:0:8395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002376e077/0xce1582440fb1e211 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e60 expref: 11 pid: 8394 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.095407:0:8395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002376e077/0xce1582440fb1e211 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e60 expref: 11 pid: 8394 timeout: 300 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263758.095420:0:8395:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa84380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8395:1876178898086784:192.168.203.20@tcp:104: 00000100:00100000:2.0:1789263758.095505:0:8395:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9863249c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789263758.096902:0:8395:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa84380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8395:1876178898086784:192.168.203.20@tcp:104: 00010000:00010000:2.0:1789263758.096930:0:8395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bf4d6e42/0xce1582440fb1e218 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e67 expref: 11 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.096962:0:8395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bb804a00, rc 0) 00000100:00100000:2.0:1789263758.097017:0:8395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8842ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+11:11359:x1876178888612352:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 1739us (1847us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263758.097027:0:8395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 47 00000100:00100000:0.0:1789263758.097224:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263758.097270:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888612480 00000100:00100000:2.0:1789263758.097277:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888612480 00010000:00010000:2.0:1789263758.097303:0:8409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002376e077/0xce1582440fb1e211 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e60 expref: 11 pid: 8394 timeout: 300 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263758.097335:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 70 00000100:00100000:2.0:1789263758.097343:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8842e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+11:2397:x1876178888612480:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789263758.097355:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789263758.097376:0:8409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002376e077/0xce1582440fb1e211 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e60 expref: 11 pid: 8394 timeout: 300 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.097388:0:8409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002376e077/0xce1582440fb1e211 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e60 expref: 11 pid: 8394 timeout: 300 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.097408:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002376e077/0xce1582440fb1e211 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e60 expref: 11 pid: 8394 timeout: 300 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.097420:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789263758.097424:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789263758.097431:0:8409:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bf4d6e42/0xce1582440fb1e218 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e67 expref: 10 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.097449:0:8409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf4d6e42/0xce1582440fb1e218 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e67 expref: 10 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.097478:0:8409:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000bf4d6e42/0xce1582440fb1e218 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e67 expref: 10 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263758.097490:0:8409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa84380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8409:1876178898086912:192.168.203.20@tcp:105: 00000100:00100000:2.0:1789263758.097538:0:8409:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9863249c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789263758.098864:0:8409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa84380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8409:1876178898086912:192.168.203.20@tcp:105: 00010000:00010000:2.0:1789263758.098880:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789263758.098916:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8842e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+10:2397:x1876178888612480:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 1573us (1692us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263758.098930:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 70 00000100:00100000:0.0:1789263758.099909:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263758.099964:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888612608 00000100:00100000:2.0:1789263758.099972:0:8398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888612608 00002000:00100000:2.0:1789263758.100011:0:8398:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9dd989affb80 x1876178888612608/t0(0) o4->3ce90ea2-917f-4b54-98b0-25e051f2317f@192.168.203.20@tcp:594/0 lens 504/0 e 0 to 0 dl 1789263769 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789263758.100022:0:8398:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dd989affb80 with x1876178888612608 ext(0->12) 00002000:00010000:2.0:1789263758.100026:0:8398:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dd989affb80 00000100:00100000:2.0:1789263758.100056:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 2 00000100:00100000:2.0:1789263758.100065:0:8398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989affb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+10:2397:x1876178888612608:12345-192.168.203.20@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789263758.101032:0:8398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989affb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+12:2397:x1876178888612608:12345-192.168.203.20@tcp:4:lhsmtool_posix.0 Request processed in 965us (1121us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1789263758.101053:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 2 00002000:00100000:2.0:1789263758.101061:0:8398:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9dd989affb80 x1876178888612608/t4294967309(0) o4->3ce90ea2-917f-4b54-98b0-25e051f2317f@192.168.203.20@tcp:594/0 lens 504/448 e 0 to 0 dl 1789263769 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789263758.101071:0:8398:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dd989affb80 with x1876178888612608 ext(0->12) 00002000:00010000:2.0:1789263758.101093:0:8398:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dd989affb80 00000100:00100000:0.0:1789263758.102523:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263758.102579:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888612736 00000100:00100000:1.0:1789263758.102586:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888612736 00000100:00100000:1.0:1789263758.102634:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 133 00000100:00100000:1.0:1789263758.102642:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989afc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+67:11359:x1876178888612736:12345-192.168.203.20@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789263758.103703:0:6466:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967396 is committed 00000004:00080000:3.0:1789263758.103727:0:6466:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00010000:00010000:1.0:1789263758.103745:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73000/0xce1582440fb1df2b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1789263758.103750:0:6466:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9dd883e963c0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1789263758.103757:0:6466:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9dd883f84800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9dd882616d80 00000020:00080000:3.0:1789263758.103761:0:6466:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9dd883f84f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9dd883fb7a00 00010000:00010000:1.0:1789263758.103761:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73000/0xce1582440fb1df2b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263758.103783:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73000/0xce1582440fb1df2b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263758.103790:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883e73000 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263758.103795:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73000/0xce1582440fb1df2b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263758.103802:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73000/0xce1582440fb1df2b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789263758.103805:0:6466:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:0.0:1789263758.103808:0:6519:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00010000:00010000:1.0:1789263758.103823:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9dd8829ede00) 00010000:00010000:1.0:1789263758.103828:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789263758.103831:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1789263758.103835:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73000/0xce1582440fb1df2b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1789263758.103841:0:6466:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9dd98615ab40 refcount 2 committed 0 result 0 batchid 2 00010000:00010000:1.0:1789263758.103844:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73000/0xce1582440fb1df2b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1789263758.103846:0:6466:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9dd9bb641a00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9dd983e71180 00000100:00100000:2.0:1789263758.103847:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898087040:0@lo:6:osp-syn-1-0.0 00000020:00080000:3.0:1789263758.103859:0:6466:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9dd9bb641100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9dd8840cea00 00010000:00010000:1.0:1789263758.103881:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1dfbe lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263758.103890:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1dfbe lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263758.103890:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989afed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898087168:0@lo:6:osp-syn-0-0.0 00000020:00080000:3.0:1789263758.103893:0:6466:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000100:00100000:2.0:1789263758.103901:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789263758.103907:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1dfbe lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263758.103925:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981530600 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263758.103940:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1dfbe lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263758.103949:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789263758.103950:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1dfbe lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263758.103961:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd8829ed000) 00010000:00010000:1.0:1789263758.103964:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263758.103968:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1dfbe lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263758.103972:0:8511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898087040 00010000:00010000:1.0:1789263758.103975:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1dfbe lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263758.103978:0:8511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898087040 00000100:00100000:3.0:1789263758.103980:0:13766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898087168 00000100:00100000:3.0:1789263758.103987:0:13766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898087168 00000020:00080000:0.0:1789263758.103996:0:6519:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00010000:00010000:1.0:1789263758.104003:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1e03c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263758.104011:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1e03c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263758.104017:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1e03c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263758.104018:0:8511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00010000:00010000:1.0:1789263758.104029:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981530400 already unused, calling callback (ffffffffc18c14f0) 00000100:00100000:2.0:1789263758.104032:0:8511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3618:x1876178898087040:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1789263758.104034:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1e03c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263758.104045:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1e03c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263758.104047:0:13766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000020:00080000:0.0:1789263758.104054:0:6519:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00002000:00080000:2.0:1789263758.104057:0:8511:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00000100:00100000:3.0:1789263758.104063:0:13766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989afce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3620:x1876178898087168:12345-0@lo:6:osp-syn-0-0.0 00000100:00080000:0.0:1789263758.104065:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789263758.104103:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9dd9bb595c00) 00010000:00010000:1.0:1789263758.104107:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00002000:00010000:2.0:1789263758.104111:0:8511:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6aa5ff8d, atime: 0x6aa5ff8d, ctime: 0x6aa5ff8d, blocks: 0x8 00010000:00010000:1.0:1789263758.104111:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1e03c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1789263758.104113:0:13766:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00010000:00010000:2.0:1789263758.104127:0:8511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c5e1146/0xce1582440fb1e21f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263758.104127:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1e03c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263758.104134:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7e9b825/0xce1582440fb1e226 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263758.104149:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2c00/0xce1582440fb1e05f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.104155:0:8511:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=200s v=(0 0) 00010000:00010000:3.0:1789263758.104166:0:13766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000044cd56d0/0xce1582440fb1dfcc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11db8 expref: 11 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.104166:0:8511:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789263758.104166:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2c00/0xce1582440fb1e05f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.104178:0:8511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c5e1146/0xce1582440fb1e21f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263758.104187:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2c00/0xce1582440fb1e05f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263758.104190:0:13766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789263758.104199:0:13766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789263758.104206:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd8841a2c00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263758.104208:0:13766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7e9b825/0xce1582440fb1e226 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.104210:0:8511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004c5e1146/0xce1582440fb1e21f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263758.104212:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2c00/0xce1582440fb1e05f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263758.104233:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2c00/0xce1582440fb1e05f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263758.104240:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9dd9bb595c00) 00010000:00010000:1.0:1789263758.104245:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789263758.104254:0:8511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c5e1146/0xce1582440fb1e21f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263758.104255:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2c00/0xce1582440fb1e05f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263758.104258:0:13766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000044cd56d0/0xce1582440fb1dfcc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11db8 expref: 11 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263758.104277:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2c00/0xce1582440fb1e05f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.104279:0:8511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004c5e1146/0xce1582440fb1e21f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263758.104289:0:13766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000044cd56d0/0xce1582440fb1dfcc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11db8 expref: 11 pid: 8395 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263758.104308:0:13766:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff79c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:13766:1876178898087296:192.168.203.20@tcp:104: 00010000:00010000:2.0:1789263758.104310:0:8511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789263758.104319:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e138 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263758.104327:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e138 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263758.104333:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e138 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263758.104340:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd8841a2a00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263758.104344:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e138 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263758.104345:0:13146:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263758.104355:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e138 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263758.104363:0:13146:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004c5e1146/0xce1582440fb1e21f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263758.104367:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd8829ed200) 00000100:00100000:3.0:1789263758.104372:0:13766:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd986221e40 going to sleep for 11 seconds 00010000:00010000:1.0:1789263758.104374:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789263758.104376:0:13146:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bb804000 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263758.104379:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e138 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263758.104384:0:13146:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004c5e1146/0xce1582440fb1e21f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263758.104389:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e138 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263758.104408:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805600/0xce1582440fb1e1f5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263758.104413:0:13146:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004c5e1146/0xce1582440fb1e21f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263758.104416:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805600/0xce1582440fb1e1f5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263758.104423:0:8511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3618:x1876178898087040:12345-0@lo:6:osp-syn-1-0.0 Request processed in 394us (527us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1789263758.104437:0:8511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00010000:1.0:1789263758.104437:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805600/0xce1582440fb1e1f5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263758.104438:0:13146:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004c5e1146/0xce1582440fb1e21f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789263758.104444:0:3618:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9dd9bfa84380/2, rc 0, transno 4294967305 00010000:00010000:0.0:1789263758.104454:0:13146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004c5e1146/0xce1582440fb1e21f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263758.104456:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898087040:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1789263758.104459:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bb805600 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263758.104468:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805600/0xce1582440fb1e1f5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263758.104477:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805600/0xce1582440fb1e1f5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263758.104481:0:13146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263758.104485:0:13146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263758.104487:0:13146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263758.104490:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9dd8829ed800) 00010000:00010000:1.0:1789263758.104494:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789263758.104498:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805600/0xce1582440fb1e1f5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263758.104504:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805600/0xce1582440fb1e1f5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263758.104585:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989afc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+16:11359:x1876178888612736:12345-192.168.203.20@tcp:44:lhsmtool_posix.0 Request processed in 1943us (2067us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263758.104594:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 133 00000100:00100000:0.0:1789263758.105865:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263758.105917:0:8395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888612992 00000100:00100000:2.0:1789263758.105925:0:8395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888612992 00000100:00100000:0.0:1789263758.105926:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263758.105966:0:8395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 50 00000100:00100000:2.0:1789263758.105975:0:8395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88431ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+12:2397:x1876178888612992:12345-192.168.203.20@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1789263758.106066:0:13766:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff79c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:13766:1876178898087296:192.168.203.20@tcp:104: 00010000:00010000:3.0:1789263758.106120:0:13766:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b7e9b825/0xce1582440fb1e226 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263758.106201:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888612864 00000100:00100000:1.0:1789263758.106215:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888612864 00010000:00010000:1.0:1789263758.106279:0:6473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000044cd56d0/0xce1582440fb1dfcc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11db8 expref: 13 pid: 8395 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263758.106329:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 71 00000100:00100000:1.0:1789263758.106342:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88431e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+13:2397:x1876178888612864:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789263758.106362:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789263758.106369:0:6473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000044cd56d0/0xce1582440fb1dfcc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11db8 expref: 13 pid: 8395 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263758.106408:0:6473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000044cd56d0/0xce1582440fb1dfcc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11db8 expref: 13 pid: 8395 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263758.106439:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000044cd56d0/0xce1582440fb1dfcc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11db8 expref: 13 pid: 8395 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263758.106458:0:6473:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789263758.106463:0:6473:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789263758.106468:0:6473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b7e9b825/0xce1582440fb1e226 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263758.106477:0:6473:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7e9b825/0xce1582440fb1e226 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263758.106504:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789263758.106545:0:13766:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b7e9b825/0xce1582440fb1e226 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263758.106558:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7e9b825/0xce1582440fb1e226 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263758.106568:0:13766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7e9b825/0xce1582440fb1e226 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263758.106577:0:13766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b7e9b825/0xce1582440fb1e226 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263758.106595:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88431e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+12:2397:x1876178888612864:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 254us (666us total) trans 0 rc 0/0 00010000:00010000:3.0:1789263758.106598:0:13766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789263758.106607:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 71 00010000:00010000:1.0:1789263758.106644:0:7427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263758.106653:0:7427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b7e9b825/0xce1582440fb1e226 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263758.106660:0:7427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd990432200 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263758.106665:0:7427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7e9b825/0xce1582440fb1e226 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263758.106685:0:7427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7e9b825/0xce1582440fb1e226 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263758.106697:0:7427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b7e9b825/0xce1582440fb1e226 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263758.106703:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7e9b825/0xce1582440fb1e226 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263758.106728:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263758.106729:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263758.106730:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789263758.106839:0:13766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989afce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3620:x1876178898087168:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2779us (2890us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1789263758.106850:0:13766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000004:00080000:1.0:1789263758.106898:0:3620:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9dd989afed80/2, rc 0, transno 4294967310 00000100:00100000:1.0:1789263758.106917:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989afed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898087168:0@lo:6:osp-syn-0-0.0 00000001:00080000:0.0:1789263758.107163:0:8388:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:0.0:1789263758.107176:0:8388:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000100:00100000:2.0:1789263758.107276:0:8395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88431ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+6:2397:x1876178888612992:12345-192.168.203.20@tcp:16:lhsmtool_posix.0 Request processed in 1299us (1412us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263758.107286:0:8395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 50 00000100:00100000:0.0:1789263758.108624:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263758.108732:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888613248 00000100:00100000:2.0:1789263758.108739:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888613248 00000100:00100000:2.0:1789263758.108799:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 134 00000100:00100000:2.0:1789263758.108809:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88431d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+16:11359:x1876178888613248:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789263758.108855:0:8417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789263758.108879:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804c00/0xce1582440fb1e20a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e59 expref: 16 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.108911:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9dd8829ed800) 00010000:00010000:2.0:1789263758.108916:0:8417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789263758.108945:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805400/0xce1582440fb1e22d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.108957:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805400/0xce1582440fb1e22d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.108967:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805400/0xce1582440fb1e22d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789263758.109055:0:8417:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004a5fd965 reply state 00000000589ea058 transno 4294967397 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805400/0xce1582440fb1e22d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.109064:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805400/0xce1582440fb1e22d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.109069:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9dd8829ed800) 00010000:00010000:2.0:1789263758.109070:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789263758.109072:0:8417:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789263758.109183:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88431d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+17:11359:x1876178888613248:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 Request processed in 375us (572us total) trans 4294967397 rc 0/0 00000100:00100000:2.0:1789263758.109190:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 134 00000100:00100000:0.0:1789263758.110029:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263758.110066:0:8511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888613376 00000100:00100000:2.0:1789263758.110071:0:8511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888613376 00000100:00100000:2.0:1789263758.110127:0:8511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 51 00000100:00100000:2.0:1789263758.110136:0:8511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88431df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+6:2397:x1876178888613376:12345-192.168.203.20@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789263758.110216:0:8511:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789263758.110224:0:8511:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1789263757 00002000:00010000:2.0:1789263758.110226:0:8511:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1789263757 00002000:00010000:2.0:1789263758.110227:0:8511:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1789263758 -> 1789263757 00002000:00010000:2.0:1789263758.110229:0:8511:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1789263758.110266:0:8511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88431df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+7:2397:x1876178888613376:12345-192.168.203.20@tcp:2:lhsmtool_posix.0 Request processed in 128us (234us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1789263758.110273:0:8511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 51 00000100:00100000:3.0:1789263758.111145:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263758.111195:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888613632 00000100:00100000:1.0:1789263758.111207:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888613632 00000100:00100000:1.0:1789263758.111261:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 135 00000100:00100000:1.0:1789263758.111268:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+17:11359:x1876178888613632:12345-192.168.203.20@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1789263758.111324:0:7434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2400/0xce1582440fb1e234 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263758.111338:0:7434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1e1ee lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e4b expref: 17 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263758.111345:0:7434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2400/0xce1582440fb1e234 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263758.111386:0:7434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1e1ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e4b expref: 17 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263758.111401:0:7434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1e1ee lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e4b expref: 17 pid: 6487 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263758.111414:0:7434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7434:1876178898087424:192.168.203.20@tcp:104: 00000100:00100000:1.0:1789263758.111503:0:7434:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd883e96900 going to sleep for 11 seconds 00000100:00100000:0.0:1789263758.112546:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263758.112555:0:7434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7434:1876178898087424:192.168.203.20@tcp:104: 00010000:00010000:1.0:1789263758.112593:0:7434:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2400/0xce1582440fb1e234 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263758.112648:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888613760 00000100:00100000:3.0:1789263758.112657:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888613760 00010000:00010000:3.0:1789263758.112688:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1e1ee lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e4b expref: 18 pid: 6487 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263758.112737:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 72 00000100:00100000:3.0:1789263758.112749:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88431f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+18:2398:x1876178888613760:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789263758.112763:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789263758.112769:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1e1ee lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e4b expref: 18 pid: 6487 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263758.112793:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1e1ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e4b expref: 18 pid: 6487 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263758.112808:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1e1ee lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e4b expref: 18 pid: 6487 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263758.112820:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9dd8829ed800) 00010000:00010000:3.0:1789263758.112825:0:6474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2400/0xce1582440fb1e234 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263758.112834:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2400/0xce1582440fb1e234 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263758.112841:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2400/0xce1582440fb1e234 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263758.112865:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789263758.112890:0:7434:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2400/0xce1582440fb1e234 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263758.112900:0:7434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2400/0xce1582440fb1e234 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263758.112913:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88431f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+17:2398:x1876178888613760:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 165us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263758.112922:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 72 00010000:00010000:1.0:1789263758.112943:0:7434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2400/0xce1582440fb1e234 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263758.112952:0:7434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2400/0xce1582440fb1e234 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263758.112960:0:7434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2400/0xce1582440fb1e234 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263758.112967:0:7434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd8841a2400 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263758.112973:0:7434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2400/0xce1582440fb1e234 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263758.112993:0:7434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2400/0xce1582440fb1e234 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263758.113008:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9dd8829ed800) 00010000:00010000:1.0:1789263758.113010:0:7434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1789263758.113013:0:7434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2400/0xce1582440fb1e234 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263758.113018:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2400/0xce1582440fb1e234 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263758.113113:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+16:11359:x1876178888613632:12345-192.168.203.20@tcp:55:lhsmtool_posix.0 Request processed in 1840us (1965us total) trans 0 rc -22/-22 00000100:00100000:1.0:1789263758.113123:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 135 00000100:00100000:0.0:1789263758.113933:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263758.113984:0:8392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888613888 00000100:00100000:2.0:1789263758.113989:0:8392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888613888 00000100:00100000:2.0:1789263758.114023:0:8392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 52 00000100:00100000:2.0:1789263758.114031:0:8392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88431d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+7:2398:x1876178888613888:12345-192.168.203.20@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789263758.114066:0:8392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000981037cc/0xce1582440fb1e23b lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.114099:0:8392:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bf4d6e42/0xce1582440fb1e218 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e67 expref: 7 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.114106:0:8392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789263758.114111:0:8392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789263758.114114:0:8392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000981037cc/0xce1582440fb1e23b lrc: 4/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.114140:0:8392:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bf4d6e42/0xce1582440fb1e218 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e67 expref: 7 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.114151:0:8392:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bf4d6e42/0xce1582440fb1e218 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e67 expref: 7 pid: 8395 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263758.114180:0:8392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa72a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8392:1876178898087552:192.168.203.20@tcp:104: 00000100:00100000:2.0:1789263758.114241:0:8392:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd986324240 going to sleep for 11 seconds 00000100:00100000:2.0:1789263758.114946:0:8392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa72a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8392:1876178898087552:192.168.203.20@tcp:104: 00010000:00010000:2.0:1789263758.114965:0:8392:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000981037cc/0xce1582440fb1e23b lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263758.115209:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263758.115249:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888614016 00000100:00100000:1.0:1789263758.115259:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888614016 00010000:00010000:1.0:1789263758.115298:0:6472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bf4d6e42/0xce1582440fb1e218 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e67 expref: 8 pid: 8395 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263758.115345:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 73 00000100:00100000:1.0:1789263758.115364:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88431c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+8:2398:x1876178888614016:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789263758.115378:0:6472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789263758.115402:0:6472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bf4d6e42/0xce1582440fb1e218 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e67 expref: 8 pid: 8395 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263758.115416:0:6472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bf4d6e42/0xce1582440fb1e218 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e67 expref: 8 pid: 8395 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263758.115456:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf4d6e42/0xce1582440fb1e218 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e67 expref: 8 pid: 8395 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263758.115471:0:6472:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789263758.115475:0:6472:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789263758.115480:0:6472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000981037cc/0xce1582440fb1e23b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263758.115491:0:6472:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000981037cc/0xce1582440fb1e23b lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263758.115519:0:6472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789263758.115544:0:8392:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000981037cc/0xce1582440fb1e23b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.115553:0:8392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000981037cc/0xce1582440fb1e23b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263758.115574:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88431c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+7:2398:x1876178888614016:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 221us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263758.115581:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 73 00010000:00010000:2.0:1789263758.115583:0:8392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000981037cc/0xce1582440fb1e23b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.115593:0:8392:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000981037cc/0xce1582440fb1e23b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.115601:0:8392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000981037cc/0xce1582440fb1e23b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.115609:0:8392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bb804c00 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:2.0:1789263758.115614:0:8392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000981037cc/0xce1582440fb1e23b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.115637:0:8392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000981037cc/0xce1582440fb1e23b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.115649:0:8392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000981037cc/0xce1582440fb1e23b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.115655:0:8392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000981037cc/0xce1582440fb1e23b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263758.115704:0:8392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88431d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+6:2398:x1876178888613888:12345-192.168.203.20@tcp:1:lhsmtool_posix.0 Request processed in 1674us (1773us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263758.115709:0:8392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 52 00000100:00100000:0.0:1789263758.116685:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263758.116733:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888614272 00000100:00100000:1.0:1789263758.116741:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888614272 00000100:00100000:1.0:1789263758.116796:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 136 00000100:00100000:1.0:1789263758.116805:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88431c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+16:11359:x1876178888614272:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789263758.116879:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3600/0xce1582440fb1e242 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263758.116895:0:6487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1e131 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e13 expref: 16 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263758.116904:0:6487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3600/0xce1582440fb1e242 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263758.116941:0:6487:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1e131 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e13 expref: 16 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263758.116955:0:6487:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1e131 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e13 expref: 16 pid: 6489 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263758.116969:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6487:1876178898087680:192.168.203.20@tcp:104: 00000100:00100000:1.0:1789263758.117045:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd883e96900 going to sleep for 11 seconds 00000100:00100000:1.0:1789263758.117958:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6487:1876178898087680:192.168.203.20@tcp:104: 00000100:00100000:0.0:1789263758.117961:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00010000:00010000:1.0:1789263758.117981:0:6487:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3600/0xce1582440fb1e242 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263758.118023:0:10303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888614400 00000100:00100000:2.0:1789263758.118030:0:10303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888614400 00010000:00010000:2.0:1789263758.118059:0:10303:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1e131 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e13 expref: 17 pid: 6489 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263758.118123:0:10303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 74 00000100:00100000:2.0:1789263758.118134:0:10303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88431d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3ce90ea2-917f-4b54-98b0-25e051f2317f+17:2398:x1876178888614400:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789263758.118151:0:10303:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789263758.118158:0:10303:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1e131 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e13 expref: 17 pid: 6489 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.118172:0:10303:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1e131 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e13 expref: 17 pid: 6489 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.118209:0:10303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1e131 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e13 expref: 17 pid: 6489 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.118226:0:10303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd8829ed200) 00010000:00010000:2.0:1789263758.118233:0:10303:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3400/0xce1582440fb1e193 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e36 expref: 16 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.118243:0:10303:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3600/0xce1582440fb1e242 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.118259:0:10303:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3600/0xce1582440fb1e242 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.118268:0:10303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3600/0xce1582440fb1e242 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.118291:0:10303:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789263758.118313:0:6487:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3600/0xce1582440fb1e242 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263758.118323:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3600/0xce1582440fb1e242 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263758.118336:0:10303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88431d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3ce90ea2-917f-4b54-98b0-25e051f2317f+16:2398:x1876178888614400:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 205us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263758.118345:0:10303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 74 00010000:00010000:1.0:1789263758.118607:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e249 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263758.118621:0:6487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433800/0xce1582440fb1e1fc lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e52 expref: 16 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263758.118630:0:6487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e249 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263758.118657:0:6487:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433800/0xce1582440fb1e1fc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e52 expref: 16 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263758.118678:0:6487:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433800/0xce1582440fb1e1fc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e52 expref: 16 pid: 7434 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263758.118692:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6487:1876178898087808:192.168.203.20@tcp:104: 00000100:00100000:1.0:1789263758.118752:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd883e96180 going to sleep for 11 seconds 00000100:00100000:1.0:1789263758.119758:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6487:1876178898087808:192.168.203.20@tcp:104: 00010000:00010000:1.0:1789263758.119799:0:6487:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e249 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263758.119967:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263758.120009:0:7428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888614528 00000100:00100000:1.0:1789263758.120015:0:7428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888614528 00010000:00010000:1.0:1789263758.120041:0:7428:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433800/0xce1582440fb1e1fc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e52 expref: 17 pid: 7434 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263758.120066:0:7428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 75 00000100:00100000:1.0:1789263758.120072:0:7428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98fe87850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+17:2398:x1876178888614528:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789263758.120123:0:7428:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789263758.120132:0:7428:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433800/0xce1582440fb1e1fc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e52 expref: 17 pid: 7434 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263758.120143:0:7428:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433800/0xce1582440fb1e1fc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e52 expref: 17 pid: 7434 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263758.120161:0:7428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433800/0xce1582440fb1e1fc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e52 expref: 17 pid: 7434 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263758.120186:0:7428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9dd8829ed800) 00010000:00010000:1.0:1789263758.120190:0:7428:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e249 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263758.120196:0:7428:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e249 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263758.120201:0:7428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e249 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263758.120220:0:7428:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789263758.120245:0:6487:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e249 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263758.120256:0:7428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98fe87850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+16:2398:x1876178888614528:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 183us (290us total) trans 0 rc 0/0 00010000:00010000:2.0:1789263758.120257:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e249 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263758.120265:0:7428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 75 00000001:00080000:2.0:1789263758.120366:0:6487:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967398 00000001:00080000:2.0:1789263758.120473:0:6487:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967399 00000001:00080000:2.0:1789263758.120506:0:6487:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967400 00000100:00100000:2.0:1789263758.120584:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa72a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6487:1876178898087936:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789263758.120625:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263758.120656:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9861e6b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789263758.120674:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898087936 00000100:00100000:3.0:1789263758.120685:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898087936 00000100:00100000:3.0:1789263758.120711:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789263758.120716:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883f5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6487:x1876178898087936:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789263758.120796:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883f5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6487:x1876178898087936:12345-0@lo:1000:mdt00_000.0 Request processed in 79us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263758.120805:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789263758.120820:0:6487:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:2.0:1789263758.120831:0:6487:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:2.0:1789263758.120849:0:6487:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9dd989afed80 x1876178898087168/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789263774 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789263758.120859:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa72a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6487:1876178898087936:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1789263758.120947:0:6487:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967401 00000100:00100000:2.0:1789263758.120997:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa72a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6487:1876178898088064:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789263758.121024:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263758.121043:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9c0b043c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789263758.121072:0:8499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898088064 00000100:00100000:0.0:1789263758.121095:0:8499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898088064 00000100:00100000:0.0:1789263758.121130:0:8499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789263758.121140:0:8499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd990713850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6487:x1876178898088064:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789263758.121221:0:8499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd990713850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6487:x1876178898088064:12345-0@lo:1000:mdt00_000.0 Request processed in 84us (196us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1789263758.121226:0:8499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789263758.121244:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa72a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6487:1876178898088064:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1789263758.121271:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e249 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.121280:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e249 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.121287:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e249 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.121293:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd8841a2a00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263758.121297:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e249 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.121306:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e249 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.121328:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9dd8829ed800) 00010000:00010000:2.0:1789263758.121332:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789263758.121337:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e249 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.121344:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e249 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.121368:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1e18c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.121374:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1e18c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.121380:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1e18c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.121386:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bb805800 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263758.121389:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1e18c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.121396:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1e18c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.121406:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd8829ed200) 00010000:00010000:2.0:1789263758.121409:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789263758.121413:0:6487:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3400/0xce1582440fb1e193 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e36 expref: 19 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.121423:0:6487:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3400/0xce1582440fb1e193 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e36 expref: 19 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.121437:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3400/0xce1582440fb1e193 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e36 expref: 19 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.121461:0:6487:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3400/0xce1582440fb1e193 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e36 expref: 19 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263758.121473:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa73b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6487:1876178898088192:192.168.203.20@tcp:105: 00000100:00100000:2.0:1789263758.121522:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd985e14900 going to sleep for 11 seconds 00000100:00100000:2.0:1789263758.123016:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa73b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6487:1876178898088192:192.168.203.20@tcp:105: 00010000:00010000:2.0:1789263758.123053:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1e18c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.123062:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1e18c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.123122:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1e250 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.123139:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1e250 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.123151:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1e250 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.123159:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1e250 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.123164:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1e250 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.123180:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1e250 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.123186:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bb804400 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263758.123189:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1e250 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.123195:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1e250 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.123205:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd8829ed200) 00010000:00010000:2.0:1789263758.123207:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789263758.123210:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1e250 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.123215:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1e250 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.123233:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3600/0xce1582440fb1e242 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.123243:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3600/0xce1582440fb1e242 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.123249:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3600/0xce1582440fb1e242 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.123254:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd8841a3600 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263758.123257:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3600/0xce1582440fb1e242 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.123273:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3600/0xce1582440fb1e242 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.123284:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd8829ed200) 00010000:00010000:2.0:1789263758.123287:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789263758.123291:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3600/0xce1582440fb1e242 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.123297:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3600/0xce1582440fb1e242 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263758.123344:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263758.123402:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888614656 00000100:00100000:0.0:1789263758.123409:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888614656 00000100:00100000:2.0:1789263758.123447:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88431c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+20:11359:x1876178888614272:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 Request processed in 6640us (6773us total) trans 4294967402 rc 0/0 00000100:00100000:0.0:1789263758.123454:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 28 00000100:00100000:2.0:1789263758.123464:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 136 00000100:00100000:0.0:1789263758.123466:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+20:11358:x1876178888614656:12345-192.168.203.20@tcp:49:lfs.0 00000020:00080000:2.0:1789263758.123472:0:6487:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1789263758.123473:0:13757:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789263758.123477:0:13757:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:0.0:1789263758.123559:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+19:11358:x1876178888614656:12345-192.168.203.20@tcp:49:lfs.0 Request processed in 96us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263758.123566:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 28 00000040:00080000:1.0:1789263758.123961:0:13757:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1789263758.123969:0:13757:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789263758.124388:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263758.124594:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888614912 00000100:00100000:1.0:1789263758.124599:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888614912 00000100:00100000:1.0:1789263758.124635:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 29 00000100:00100000:1.0:1789263758.124643:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+19:11359:x1876178888614912:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789263758.124832:0:6490:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000100:00100000:3.0:1789263758.124854:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000001:00080000:1.0:1789263758.124860:0:6490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00010000:00010000:1.0:1789263758.124887:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2400/0xce1582440fb1e257 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263758.124896:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888615168 00010000:00010000:1.0:1789263758.124900:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2400/0xce1582440fb1e257 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263758.124902:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888615168 00010000:00010000:1.0:1789263758.124922:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2400/0xce1582440fb1e257 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263758.124930:0:6490:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2400/0xce1582440fb1e257 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263758.124937:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2400/0xce1582440fb1e257 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263758.124944:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2400/0xce1582440fb1e257 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263758.124945:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 137 00000100:00100000:2.0:1789263758.124956:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+22:11358:x1876178888615168:12345-192.168.203.20@tcp:58:lfs.0 00010000:00010000:1.0:1789263758.124974:0:6490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789263758.125030:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+22:11359:x1876178888614912:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 Request processed in 387us (642us total) trans 4294967404 rc 0/0 00000100:00100000:1.0:1789263758.125039:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 29 00000020:00080000:1.0:1789263758.125043:0:6490:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:2.0:1789263758.125046:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00010000:00010000:0.0:1789263758.125111:0:6475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1789263758.125112:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+21:11358:x1876178888615168:12345-192.168.203.20@tcp:58:lfs.0 Request processed in 156us (257us total) trans 0 rc 0/0 00010000:00010000:0.0:1789263758.125118:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2400/0xce1582440fb1e257 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263758.125123:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 137 00010000:00010000:0.0:1789263758.125130:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd8841a2400 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:0.0:1789263758.125133:0:6475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2400/0xce1582440fb1e257 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263758.125138:0:6475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2400/0xce1582440fb1e257 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263758.125146:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9dd8829ed800) 00010000:00010000:0.0:1789263758.125148:0:6475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789263758.125150:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2400/0xce1582440fb1e257 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263758.125154:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2400/0xce1582440fb1e257 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263758.125167:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263758.125168:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263758.125169:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789263758.139001:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263758.139105:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888615296 00000100:00100000:1.0:1789263758.139116:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888615296 00000100:00100000:0.0:1789263758.139220:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 138 00000100:00100000:0.0:1789263758.139235:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+21:11361:x1876178888615296:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:0.0:1789263758.139258:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263758.139278:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72c00/0xce1582440fb1e25e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11e6e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263758.139337:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72e00/0xce1582440fb1e265 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263758.139352:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72e00/0xce1582440fb1e265 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263758.139363:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72e00/0xce1582440fb1e265 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263758.139390:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73800/0xce1582440fb1e26c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263758.139398:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73800/0xce1582440fb1e26c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263758.139405:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73800/0xce1582440fb1e26c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263758.139490:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73200/0xce1582440fb1e273 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263758.139517:0:6489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2200/0xce1582440fb1e17e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e2f expref: 22 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263758.139527:0:6489:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73200/0xce1582440fb1e273 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263758.139560:0:6489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2200/0xce1582440fb1e17e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e2f expref: 22 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263758.139574:0:6489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2200/0xce1582440fb1e17e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e2f expref: 22 pid: 6488 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263758.139588:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88431c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6489:1876178898088320:192.168.203.20@tcp:104: 00000100:00100000:0.0:1789263758.139697:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd983852600 going to sleep for 11 seconds 00000100:00100000:0.0:1789263758.141021:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88431c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6489:1876178898088320:192.168.203.20@tcp:104: 00010000:00010000:0.0:1789263758.141045:0:6489:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73200/0xce1582440fb1e273 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263758.141164:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263758.141230:0:14127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888615552 00000100:00100000:0.0:1789263758.141236:0:14127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888615552 00000100:00100000:2.0:1789263758.141358:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 30 00000100:00100000:2.0:1789263758.141371:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+23:6153:x1876178888615552:12345-192.168.203.20@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789263758.141565:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+24:6153:x1876178888615552:12345-192.168.203.20@tcp:35:ldlm_bl.0 Request processed in 197us (399us total) trans 4294967405 rc 0/0 00000100:00100000:2.0:1789263758.141586:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 30 00000100:00100000:3.0:1789263758.142692:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263758.142745:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888615680 00000100:00100000:2.0:1789263758.142751:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888615680 00010000:00010000:2.0:1789263758.142784:0:8409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2200/0xce1582440fb1e17e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e2f expref: 24 pid: 6488 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263758.142814:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 76 00000100:00100000:2.0:1789263758.142821:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+24:2397:x1876178888615680:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789263758.142831:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789263758.142838:0:8409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2200/0xce1582440fb1e17e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e2f expref: 24 pid: 6488 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.142849:0:8409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2200/0xce1582440fb1e17e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e2f expref: 24 pid: 6488 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.142869:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2200/0xce1582440fb1e17e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e2f expref: 24 pid: 6488 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.142883:0:8409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd8829ed200) 00010000:00010000:2.0:1789263758.142888:0:8409:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73200/0xce1582440fb1e273 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.142896:0:8409:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73200/0xce1582440fb1e273 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.142903:0:8409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73200/0xce1582440fb1e273 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263758.142944:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789263758.142974:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+23:2397:x1876178888615680:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 154us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263758.142981:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 76 00010000:00010000:0.0:1789263758.143186:0:6489:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73200/0xce1582440fb1e273 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263758.143203:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73200/0xce1582440fb1e273 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789263758.143273:0:6489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789263758.143278:0:6489:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789263758.143321:0:6489:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73200/0xce1582440fb1e273 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263758.143339:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73200/0xce1582440fb1e273 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263758.143350:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72e00/0xce1582440fb1e265 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263758.143358:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72e00/0xce1582440fb1e265 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263758.143366:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72e00/0xce1582440fb1e265 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263758.143373:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883e72e00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:0.0:1789263758.143378:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72e00/0xce1582440fb1e265 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263758.143388:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72e00/0xce1582440fb1e265 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263758.143402:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dd8829ed600) 00010000:00010000:0.0:1789263758.143405:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789263758.143411:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72e00/0xce1582440fb1e265 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263758.143418:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72e00/0xce1582440fb1e265 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263758.143435:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73800/0xce1582440fb1e26c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263758.143441:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73800/0xce1582440fb1e26c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263758.143454:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73800/0xce1582440fb1e26c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263758.143459:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883e73800 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:0.0:1789263758.143462:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73800/0xce1582440fb1e26c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263758.143469:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73800/0xce1582440fb1e26c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263758.143477:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9dd998733100) 00010000:00010000:0.0:1789263758.143479:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789263758.143482:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73800/0xce1582440fb1e26c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263758.143487:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73800/0xce1582440fb1e26c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263758.143531:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72c00/0xce1582440fb1e25e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e6e expref: 23 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263758.143548:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73200/0xce1582440fb1e273 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e6e expref: 22 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263758.143555:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd8829ed200) 00010000:00010000:0.0:1789263758.143558:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789263758.143560:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd883e73200, rc 0) 00000100:00100000:0.0:1789263758.143630:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+22:11361:x1876178888615296:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 4399us (4638us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263758.143648:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 138 00000040:00080000:3.0:1789263758.469051:0:14267:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789263758.469060:0:14267:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789263758.469111:0:14267:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1789263758.469129:0:14267:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1789263758.765212:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789263759.149279:0:13757:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789263759.149289:0:13757:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789263759.149312:0:13757:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1789263759.149321:0:13757:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789263759.149480:0:13757:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7f100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13757:1876178898088448:192.168.203.20@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789263759.149585:0:13757:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd882b890c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789263759.151920:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263759.151929:0:13757:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7f100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13757:1876178898088448:192.168.203.20@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789263759.152321:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888615808 00000100:00100000:2.0:1789263759.152329:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888615808 00000100:00100000:2.0:1789263759.152392:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 139 00000100:00080000:0.0:1789263759.152400:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789263759.152402:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+22:11374:x1876178888615808:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789263759.152434:0:6487:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789263759.152536:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+22:11374:x1876178888615808:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 Request processed in 136us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263759.152544:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 139 00000100:00100000:3.0:1789263759.153915:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263759.153977:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888616064 00000100:00100000:2.0:1789263759.153984:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888616064 00000100:00100000:2.0:1789263759.154023:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 140 00000100:00100000:2.0:1789263759.154032:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+22:11374:x1876178888616064:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789263759.154045:0:8417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263759.154136:0:8417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804e00/0xce1582440fb1e27a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11e75 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263759.154241:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805e00/0xce1582440fb1e281 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263759.154256:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805e00/0xce1582440fb1e281 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263759.154268:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805e00/0xce1582440fb1e281 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789263759.154291:0:8417:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1789263759.154388:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804e00/0xce1582440fb1e27a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e75 expref: 25 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263759.154404:0:8417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805e00/0xce1582440fb1e281 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e75 expref: 24 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263759.154412:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd8829ed200) 00010000:00010000:2.0:1789263759.154415:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789263759.154419:0:8417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bb805e00, rc 0) 00000100:00100000:2.0:1789263759.154474:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+24:11374:x1876178888616064:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 443us (575us total) trans 4294967406 rc 0/0 00000100:00100000:2.0:1789263759.154482:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 140 00000100:00100000:3.0:1789263759.156241:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263759.156302:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888616192 00000100:00100000:1.0:1789263759.156320:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888616192 00000100:00100000:1.0:1789263759.156373:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 8 00000100:00100000:1.0:1789263759.156380:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa92d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+24:2400:x1876178888616192:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789263759.156390:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789263759.156406:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805e00/0xce1582440fb1e281 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e75 expref: 24 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263759.156422:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd8829ed200) 00010000:00010000:1.0:1789263759.156427:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789263759.156476:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa92d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+23:2400:x1876178888616192:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 95us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263759.156484:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 8 00000100:00100000:3.0:1789263759.156526:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263759.156574:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888616448 00000100:00100000:1.0:1789263759.156579:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888616448 00000100:00100000:1.0:1789263759.156616:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 141 00000100:00100000:1.0:1789263759.156628:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+23:11374:x1876178888616448:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789263759.156685:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3e00/0xce1582440fb1e28f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263759.156699:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3e00/0xce1582440fb1e28f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263759.156709:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3e00/0xce1582440fb1e28f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263759.156877:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3e00/0xce1582440fb1e28f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263759.156899:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3e00/0xce1582440fb1e28f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263759.156913:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3e00/0xce1582440fb1e28f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263759.156919:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd8841a3e00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263759.156923:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3e00/0xce1582440fb1e28f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263759.156932:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3e00/0xce1582440fb1e28f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263759.156941:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd8829ed200) 00010000:00010000:1.0:1789263759.156944:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789263759.156948:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3e00/0xce1582440fb1e28f lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263759.156955:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3e00/0xce1582440fb1e28f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263759.157041:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+24:11374:x1876178888616448:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 Request processed in 417us (514us total) trans 4294967407 rc 0/0 00000100:00100000:1.0:1789263759.157048:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 141 00000040:00080000:0.0:1789263759.157129:0:13757:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789263759.157135:0:13757:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789263759.157576:0:13757:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1789263759.157586:0:13757:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789263759.159664:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263759.159738:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888616704 00000100:00100000:1.0:1789263759.159748:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888616704 00000100:00100000:1.0:1789263759.159844:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 31 00000100:00100000:1.0:1789263759.159855:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88431c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+24:11374:x1876178888616704:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789263759.160049:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88431c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+25:11374:x1876178888616704:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 Request processed in 194us (392us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1789263759.160056:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 31 00010000:00010000:1.0:1789263759.790400:0:13689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789263759.840405:0:14318:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789263759.840414:0:14318:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789263759.840445:0:14318:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1789263759.840452:0:14318:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789263759.899268:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263759.899325:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888616960 00000100:00100000:2.0:1789263759.899336:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888616960 00000100:00100000:2.0:1789263759.899407:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 142 00000100:00100000:2.0:1789263759.899420:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88431f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+25:11394:x1876178888616960:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:2.0:1789263759.899444:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263759.899464:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805200/0xce1582440fb1e296 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11e7c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263759.899575:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804800/0xce1582440fb1e29d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263759.899590:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804800/0xce1582440fb1e29d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263759.899612:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804800/0xce1582440fb1e29d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789263759.899624:0:6487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1789263759.899730:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805200/0xce1582440fb1e296 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e7c expref: 28 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263759.899745:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804800/0xce1582440fb1e29d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e7c expref: 27 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263759.899753:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd8829ed200) 00010000:00010000:2.0:1789263759.899756:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789263759.899775:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bb804800, rc 0) 00000100:00100000:2.0:1789263759.899833:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88431f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+27:11394:x1876178888616960:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 415us (569us total) trans 4294967409 rc 0/0 00000100:00100000:2.0:1789263759.899842:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 142 00000100:00100000:3.0:1789263759.903105:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263759.903321:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888617088 00000100:00100000:0.0:1789263759.903331:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888617088 00000100:00100000:0.0:1789263759.903386:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 143 00000100:00100000:0.0:1789263759.903398:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+27:11394:x1876178888617088:12345-192.168.203.20@tcp:54:lfs.0 00010000:00010000:0.0:1789263759.903463:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72e00/0xce1582440fb1e2ab lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263759.903480:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72e00/0xce1582440fb1e2ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263759.903492:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72e00/0xce1582440fb1e2ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263759.903523:0:8417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72e00/0xce1582440fb1e2ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263759.903530:0:8417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72e00/0xce1582440fb1e2ab lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263759.903541:0:8417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72e00/0xce1582440fb1e2ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263759.903567:0:8417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883e72e00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:0.0:1789263759.903574:0:8417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72e00/0xce1582440fb1e2ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263759.903584:0:8417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72e00/0xce1582440fb1e2ab lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263759.903597:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd8829ed200) 00010000:00010000:0.0:1789263759.903600:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789263759.903604:0:8417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72e00/0xce1582440fb1e2ab lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263759.903611:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72e00/0xce1582440fb1e2ab lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263759.903688:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+27:11394:x1876178888617088:12345-192.168.203.20@tcp:54:lfs.0 Request processed in 292us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263759.903702:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 143 00000100:00100000:0.0:1789263759.944210:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263759.944286:0:8395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888617216 00000100:00100000:2.0:1789263759.944294:0:8395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888617216 00000100:00100000:2.0:1789263759.944388:0:8395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 53 00000100:00100000:2.0:1789263759.944395:0:8395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88431ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+6:2398:x1876178888617216:12345-192.168.203.20@tcp:101:cat.0 00010000:00010000:2.0:1789263759.944410:0:8395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263759.944424:0:8395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002408307c/0xce1582440fb1e2b2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11e83 expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789263759.944451:0:8395:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6aa5ff8d, atime: 0x6aa5ff8d, ctime: 0x6aa5ff8d, blocks: 0x8 00010000:00010000:2.0:1789263759.944466:0:8395:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=202s v=(0 0) 00010000:00010000:2.0:1789263759.944480:0:8395:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789263759.944487:0:8395:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002408307c/0xce1582440fb1e2b2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e83 expref: 7 pid: 8395 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263759.944510:0:8395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002408307c/0xce1582440fb1e2b2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e83 expref: 7 pid: 8395 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263759.944519:0:8395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bb805200, rc 0) 00000100:00100000:2.0:1789263759.944561:0:8395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88431ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+7:2398:x1876178888617216:12345-192.168.203.20@tcp:101:cat.0 Request processed in 167us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263759.944566:0:8395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 53 00000100:00080000:0.0:1789263759.944630:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789263759.946358:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263759.946426:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888617344 00000100:00100000:3.0:1789263759.946433:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888617344 00002000:00100000:3.0:1789263759.946495:0:8400:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff9dd98ff7f100 x1876178888617344/t0(0) o3->3ce90ea2-917f-4b54-98b0-25e051f2317f@192.168.203.20@tcp:595/0 lens 488/0 e 0 to 0 dl 1789263770 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789263759.946521:0:8400:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dd98ff7f100 with x1876178888617344 ext(0->4095) 00002000:00010000:3.0:1789263759.946527:0:8400:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dd98ff7f100 00000100:00100000:3.0:1789263759.946553:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 3 00000100:00100000:3.0:1789263759.946561:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+7:2397:x1876178888617344:12345-192.168.203.20@tcp:3:cat.0 00000100:00100000:3.0:1789263759.946729:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+7:2397:x1876178888617344:12345-192.168.203.20@tcp:3:cat.0 Request processed in 168us (374us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789263759.946737:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 3 00002000:00100000:3.0:1789263759.946744:0:8400:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff9dd98ff7f100 x1876178888617344/t0(0) o3->3ce90ea2-917f-4b54-98b0-25e051f2317f@192.168.203.20@tcp:595/0 lens 488/4536 e 0 to 0 dl 1789263770 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789263759.946753:0:8400:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dd98ff7f100 with x1876178888617344 ext(0->4095) 00002000:00010000:3.0:1789263759.946757:0:8400:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dd98ff7f100 00000100:00100000:3.0:1789263760.315241:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263760.315275:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263760.315299:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263760.315327:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263760.315331:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888617728 00000100:00100000:0.0:1789263760.315331:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888617472 00000100:00100000:1.0:1789263760.315343:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888617728 00000100:00100000:3.0:1789263760.315349:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263760.315350:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888617472 00000100:00100000:3.0:1789263760.315374:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263760.315401:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263760.315411:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888618240 00000100:00100000:1.0:1789263760.315417:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888618240 00000100:00100000:0.0:1789263760.315417:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 332 00000100:00100000:0.0:1789263760.315432:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a05c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+13:2400:x1876178888617472:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1789263760.315439:0:8511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888617984 00000100:00100000:3.0:1789263760.315444:0:8511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888617984 00000100:00100000:1.0:1789263760.315457:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888617600 00000100:00100000:1.0:1789263760.315462:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888617600 00000100:00100000:1.0:1789263760.315485:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888618112 00000100:00100000:1.0:1789263760.315488:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888618112 00000100:00100000:1.0:1789263760.315516:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 140 00000100:00100000:0.0:1789263760.315519:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a05c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+13:2400:x1876178888617472:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 87us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263760.315523:0:8511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888617856 00000100:00100000:3.0:1789263760.315529:0:8511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888617856 00000100:00100000:1.0:1789263760.315530:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8838f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+5:2400:x1876178888617728:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789263760.315531:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 332 00000100:00100000:3.0:1789263760.315556:0:8511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 72 00000100:00100000:3.0:1789263760.315567:0:8511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8838f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+9:2400:x1876178888617984:12345-192.168.203.20@tcp:400:kworker.0 00000100:00080000:0.0:1789263760.315573:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789263760.315577:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8838f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+5:2400:x1876178888617728:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 51us (299us total) trans 0 rc 0/0 00000100:00080000:0.0:1789263760.315588:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789263760.315592:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 140 00000100:00080000:0.0:1789263760.315594:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789263760.315596:0:8392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 73 00000100:00100000:2.0:1789263760.315607:0:8392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8838f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+7:2400:x1876178888617856:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1789263760.315613:0:8511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8838f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+9:2400:x1876178888617984:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 49us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263760.315617:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 141 00000100:00100000:3.0:1789263760.315628:0:8511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 72 00000100:00100000:0.0:1789263760.315628:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 142 00000100:00100000:1.0:1789263760.315634:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8838f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:857a0866-badb-47ac-9591-fbf273e4680e+5:2400:x1876178888618240:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789263760.315636:0:8392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8838f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+7:2400:x1876178888617856:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 31us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263760.315645:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8838f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+27:2400:x1876178888617600:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789263760.315651:0:8392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 73 00000100:00100000:2.0:1789263760.315673:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 143 00000100:00100000:1.0:1789263760.315678:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8838f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:857a0866-badb-47ac-9591-fbf273e4680e+5:2400:x1876178888618240:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 47us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263760.315689:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8838f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:857a0866-badb-47ac-9591-fbf273e4680e+5:2400:x1876178888618112:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1789263760.315690:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 141 00000100:00100000:0.0:1789263760.315690:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8838f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+27:2400:x1876178888617600:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 45us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263760.315705:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 142 00000100:00100000:2.0:1789263760.315729:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8838f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:857a0866-badb-47ac-9591-fbf273e4680e+5:2400:x1876178888618112:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 45us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263760.315736:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 143 00000100:00100000:2.0:1789263760.429303:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1876178898088832:0@lo:400:kworker.0 00000100:00100000:3.0:1789263760.429361:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8838f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:66a76ccf-c64c-4b18-8369-a2861ec3956c:3618:1876178898088704:0@lo:400:kworker.0 00000100:00100000:2.0:1789263760.429386:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263760.429404:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263760.429453:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876178898089216:0@lo:400:kworker.0 00000100:00100000:2.0:1789263760.429457:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1876178898089344:0@lo:400:kworker.0 00000100:00100000:3.0:1789263760.429484:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263760.429506:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263760.429509:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898089728:0@lo:400:kworker.0 00000100:00100000:2.0:1789263760.429535:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9c09f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876178898089856:0@lo:400:kworker.0 00000100:00100000:3.0:1789263760.429543:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263760.429566:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9c09f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898090240:0@lo:400:kworker.0 00000100:00100000:2.0:1789263760.429574:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263760.429600:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9c09f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876178898090368:0@lo:400:kworker.0 00000100:00100000:3.0:1789263760.429609:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263760.429636:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263760.429648:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898088576:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789263760.429651:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898088704 00000100:00100000:3.0:1789263760.429658:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898088704 00000100:00100000:2.0:1789263760.429678:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898088960:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789263760.429690:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263760.429704:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1789263760.429717:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a04c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+24:3618:x1876178898088704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789263760.429720:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263760.429722:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898089088:0@lo:400:kworker.0 00000100:00100000:2.0:1789263760.429751:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1876178898089472:0@lo:400:kworker.0 00000100:00100000:0.0:1789263760.429773:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263760.429799:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a04c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+24:3618:x1876178898088704:12345-0@lo:400:kworker.0 Request processed in 85us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263760.429807:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1789263760.429814:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898089600:0@lo:400:kworker.0 00000100:00100000:2.0:1789263760.429818:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263760.429845:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898089728 00000100:00100000:3.0:1789263760.429851:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898089728 00000100:00100000:2.0:1789263760.429851:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9c09f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1876178898089984:0@lo:400:kworker.0 00000100:00100000:0.0:1789263760.429858:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263760.429882:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898089088 00000100:00100000:3.0:1789263760.429886:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898089088 00000100:00100000:0.0:1789263760.429890:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9c09f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3621:1876178898090112:0@lo:400:kworker.0 00000100:00100000:2.0:1789263760.429892:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263760.429905:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789263760.429914:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c09f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1876178898089728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263760.429926:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263760.429940:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898088832 00000100:00100000:2.0:1789263760.429946:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898088832 00000100:00100000:3.0:1789263760.429960:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c09f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1876178898089728:12345-0@lo:400:kworker.0 Request processed in 48us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263760.429969:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898088576 00000100:00100000:3.0:1789263760.429974:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789263760.429975:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898089216 00000100:00100000:0.0:1789263760.429975:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898088576 00000100:00100000:2.0:1789263760.429982:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898089216 00000100:00100000:3.0:1789263760.429993:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789263760.430003:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88431f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1876178898089088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789263760.430006:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898089344 00000100:00100000:2.0:1789263760.430011:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898089344 00000100:00100000:0.0:1789263760.430025:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898088960 00000100:00100000:0.0:1789263760.430030:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898088960 00000100:00100000:2.0:1789263760.430041:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898089472 00000100:00100000:3.0:1789263760.430047:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88431f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1876178898089088:12345-0@lo:400:kworker.0 Request processed in 47us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263760.430047:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898089472 00000100:00100000:3.0:1789263760.430058:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789263760.430058:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789263760.430072:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898089984 00000100:00100000:2.0:1789263760.430102:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898089984 00000100:00100000:3.0:1789263760.430104:0:8511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898089856 00000100:00100000:3.0:1789263760.430109:0:8511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898089856 00000100:00100000:0.0:1789263760.430110:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88431dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3621:x1876178898088576:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789263760.430124:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898090112 00000100:00100000:2.0:1789263760.430130:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898090112 00002000:00000024:0.0:1789263760.430136:0:8397:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25591488 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789263760.430144:0:8511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898090240 00000100:00100000:3.0:1789263760.430148:0:8511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898090240 00000100:00100000:2.0:1789263760.430160:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789263760.430167:0:8511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898090368 00000100:00100000:3.0:1789263760.430171:0:8511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898090368 00000100:00100000:2.0:1789263760.430172:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1876178898088832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263760.430181:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88431dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+10:3621:x1876178898088576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263760.430186:0:8511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898089600 00000100:00100000:3.0:1789263760.430189:0:8511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898089600 00000100:00100000:0.0:1789263760.430190:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789263760.430214:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789263760.430216:0:8511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789263760.430226:0:8511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3619:x1876178898089856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789263760.430228:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1876178898088832:12345-0@lo:400:kworker.0 Request processed in 59us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263760.430234:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882a6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3620:x1876178898088960:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789263760.430251:0:8397:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25591488 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789263760.430252:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789263760.430265:0:8511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3619:x1876178898089856:12345-0@lo:400:kworker.0 Request processed in 41us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263760.430272:0:8511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789263760.430277:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789263760.430289:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c09f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876178898089216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263760.430291:0:8511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789263760.430299:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882a6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3620:x1876178898088960:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263760.430304:0:8511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c09f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3618:x1876178898090240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263760.430312:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789263760.430343:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c09f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876178898089216:12345-0@lo:400:kworker.0 Request processed in 57us (857us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263760.430345:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789263760.430350:0:8511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c09f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1876178898090240:12345-0@lo:400:kworker.0 Request processed in 47us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263760.430361:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789263760.430362:0:8511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789263760.430363:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1876178898089344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263760.430389:0:8511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789263760.430390:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789263760.430401:0:8511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3619:x1876178898090368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789263760.430405:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882a6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1876178898089472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263760.430409:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1876178898089344:12345-0@lo:400:kworker.0 Request processed in 51us (903us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263760.430423:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789263760.430443:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789263760.430451:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882a6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1876178898089472:12345-0@lo:400:kworker.0 Request processed in 51us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263760.430453:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1876178898089984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263760.430462:0:8511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3619:x1876178898090368:12345-0@lo:400:kworker.0 Request processed in 62us (826us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263760.430468:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789263760.430473:0:8511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789263760.430492:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789263760.430496:0:8511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789263760.430502:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1876178898089984:12345-0@lo:400:kworker.0 Request processed in 50us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263760.430507:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88431fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1876178898090112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263760.430510:0:8511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88431ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1876178898089600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263760.430519:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:0.0:1789263760.430549:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789263760.430554:0:8511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88431ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1876178898089600:12345-0@lo:400:kworker.0 Request processed in 48us (699us total) trans 0 rc 0/0 00000100:00080000:0.0:1789263760.430554:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789263760.430559:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789263760.430563:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789263760.430566:0:8511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789263760.430566:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88431fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1876178898090112:12345-0@lo:400:kworker.0 Request processed in 62us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263760.430577:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789263760.430638:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898088960:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789263760.430645:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1876178898089344:0@lo:400:kworker.0 00000100:00100000:3.0:1789263760.430648:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8838f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:66a76ccf-c64c-4b18-8369-a2861ec3956c:3618:1876178898088704:0@lo:400:kworker.0 00010000:00080000:0.0:1789263760.430659:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd99f9a7480 x1876178898089472/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263776 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789263760.430669:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9c09f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876178898089856:0@lo:400:kworker.0 00000100:00100000:3.0:1789263760.430671:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876178898089216:0@lo:400:kworker.0 00000100:00100000:0.0:1789263760.430672:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1876178898089472:0@lo:400:kworker.0 00000100:00100000:3.0:1789263760.430697:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898089728:0@lo:400:kworker.0 00000100:00100000:2.0:1789263760.430697:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9c09f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876178898090368:0@lo:400:kworker.0 00000100:00100000:0.0:1789263760.430701:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9c09f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1876178898089984:0@lo:400:kworker.0 00000100:00100000:3.0:1789263760.430725:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9c09f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898090240:0@lo:400:kworker.0 00000100:00100000:2.0:1789263760.430729:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1876178898088832:0@lo:400:kworker.0 00000100:00100000:3.0:1789263760.430795:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898088576:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789263760.430807:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898089088:0@lo:400:kworker.0 00000100:00100000:3.0:1789263760.430816:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898089600:0@lo:400:kworker.0 00010000:00080000:3.0:1789263760.430827:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd9c09f7480 x1876178898090112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263776 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263760.430836:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9c09f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3621:1876178898090112:0@lo:400:kworker.0 00000001:00080000:0.0:1789263760.433320:0:9479:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:0.0:1789263760.433351:0:9479:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00010000:00010000:0.0:1789263760.813503:0:13146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789263760.941277:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789263760.941279:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9c09f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898090624:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789263760.941297:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898090752:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789263760.941298:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883e31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898090496:0@lo:41:osp-pre-1-0.0 00000004:00080000:3.0:1789263760.941369:0:8509:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 203231290621ns, next at 204231284561ns, rc = 0 00000100:00100000:2.0:1789263760.941609:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263760.941609:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263760.941677:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898090624 00000100:00100000:0.0:1789263760.941686:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898090624 00000100:00100000:0.0:1789263760.941759:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789263760.941761:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263760.941775:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3621:x1876178898090624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789263760.941810:0:8397:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789263760.941858:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3621:x1876178898090624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263760.941863:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789263760.941890:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898090752 00000100:00100000:0.0:1789263760.941896:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898090752 00000100:00100000:1.0:1789263760.941942:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9c09f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898090624:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789263760.941948:0:8512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789263760.941966:0:8512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1876178898090752:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789263760.941978:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898090496 00000100:00100000:3.0:1789263760.941986:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898090496 00002000:00000024:2.0:1789263760.941991:0:8512:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1789263760.942029:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789263760.942050:0:8512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1876178898090752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263760.942057:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88431ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1876178898090496:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789263760.942117:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789263760.942168:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88431ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1876178898090496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 118us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263760.942176:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789263760.942188:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898090752:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789263760.942219:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883e31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898090496:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789263760.942558:0:8512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789263761.735366:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263761.735434:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888618368 00000100:00100000:2.0:1789263761.735444:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888618368 00000100:00080000:0.0:1789263761.735504:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789263761.735521:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 144 00000100:00100000:2.0:1789263761.735532:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88431e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+27:11040:x1876178888618368:12345-192.168.203.20@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789263761.735650:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88431e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+27:11040:x1876178888618368:12345-192.168.203.20@tcp:60:lhsmtool_posix.0 Request processed in 119us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263761.735659:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 144 00000100:00100000:3.0:1789263761.736670:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263761.736715:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888618496 00000100:00100000:2.0:1789263761.736721:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888618496 00000100:00100000:2.0:1789263761.736767:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 145 00000100:00100000:2.0:1789263761.736776:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c09f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+5:11040:x1876178888618496:12345-192.168.203.20@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789263761.736832:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c09f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+5:11040:x1876178888618496:12345-192.168.203.20@tcp:60:lhsmtool_posix.0 Request processed in 59us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263761.736837:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 145 00000100:00100000:3.0:1789263761.737932:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263761.737973:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888618752 00000100:00100000:2.0:1789263761.737979:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888618752 00000100:00100000:2.0:1789263761.738012:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 32 00000100:00100000:2.0:1789263761.738018:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd987347c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+27:11040:x1876178888618752:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789263761.738229:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd987347c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+28:11040:x1876178888618752:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 Request processed in 209us (296us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1789263761.738249:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 32 00000100:00100000:0.0:1789263761.811454:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263761.811531:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888618880 00000100:00100000:2.0:1789263761.811541:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888618880 00000100:00100000:2.0:1789263761.811598:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 146 00000100:00100000:2.0:1789263761.811608:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88431c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:857a0866-badb-47ac-9591-fbf273e4680e+5:11851:x1876178888618880:12345-192.168.203.20@tcp:101:lsof.0 00010000:00010000:2.0:1789263761.811628:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263761.811648:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1e2b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11e8a expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263761.811724:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804a00/0xce1582440fb1e2c0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263761.811738:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804a00/0xce1582440fb1e2c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263761.811761:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804a00/0xce1582440fb1e2c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789263761.811816:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789263761.811822:0:6488:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789263761.811861:0:6488:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804a00/0xce1582440fb1e2c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263761.811886:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1e2b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e8a expref: 7 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263761.811903:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804a00/0xce1582440fb1e2c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e8a expref: 6 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263761.811930:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd9bb596200) 00010000:00010000:2.0:1789263761.811933:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789263761.811937:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bb804a00, rc 0) 00000100:00100000:2.0:1789263761.811987:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88431c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:857a0866-badb-47ac-9591-fbf273e4680e+6:11851:x1876178888618880:12345-192.168.203.20@tcp:101:lsof.0 Request processed in 381us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263761.811991:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 146 00010000:00010000:1.0:1789263761.837899:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789263762.477302:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898090880:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789263762.477370:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263762.477416:0:8499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898090880 00000100:00100000:3.0:1789263762.477423:0:8499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898090880 00000100:00100000:3.0:1789263762.477479:0:8499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789263762.477490:0:8499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1876178898090880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789263762.477524:0:8499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1789263762.477582:0:8499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1876178898090880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263762.477589:0:8499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789263762.477681:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898090880:0@lo:41:osp-pre-0-1.0 00000001:02000400:1.0:1789263762.690774:0:14515:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 21:42:42 (1789263762) 00010000:00010000:0.0:1789263762.861245:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789263763.117722:0:13759:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789263763.195856:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263763.195933:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888619136 00000100:00100000:2.0:1789263763.195944:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888619136 00000100:00100000:2.0:1789263763.196028:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 147 00000100:00100000:2.0:1789263763.196039:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c09f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+28:12117:x1876178888619136:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789263763.196063:0:8417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263763.196110:0:8417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804000/0xce1582440fb1e2c7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11e91 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263763.196182:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805600/0xce1582440fb1e2ce lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263763.196196:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805600/0xce1582440fb1e2ce lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263763.196206:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805600/0xce1582440fb1e2ce lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263763.196290:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1e2d5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263763.196299:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1e2d5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263763.196306:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1e2d5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789263763.196358:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789263763.196390:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1e2dc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263763.196397:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1e2dc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263763.196401:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1e2dc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789263763.196407:0:8417:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1789263763.196477:0:8417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805600/0xce1582440fb1e2ce lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263763.196484:0:8417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805600/0xce1582440fb1e2ce lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263763.196490:0:8417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805600/0xce1582440fb1e2ce lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263763.196496:0:8417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bb805600 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263763.196500:0:8417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805600/0xce1582440fb1e2ce lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263763.196516:0:8417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805600/0xce1582440fb1e2ce lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263763.196528:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9dd8829ed100) 00010000:00010000:2.0:1789263763.196531:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789263763.196535:0:8417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805600/0xce1582440fb1e2ce lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263763.196541:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805600/0xce1582440fb1e2ce lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263763.196553:0:8417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1e2d5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263763.196558:0:8417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1e2d5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263763.196564:0:8417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1e2d5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263763.196568:0:8417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bb804400 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263763.196571:0:8417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1e2d5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263763.196577:0:8417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1e2d5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263763.196583:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9dd9ba858600) 00010000:00010000:2.0:1789263763.196585:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789263763.196588:0:8417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1e2d5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263763.196602:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1e2d5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263763.196840:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804000/0xce1582440fb1e2c7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e91 expref: 31 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263763.196850:0:8417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1e2dc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e91 expref: 30 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263763.196855:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9dd8829ed700) 00010000:00010000:2.0:1789263763.196856:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789263763.196858:0:8417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bb805800, rc 0) 00000100:00100000:2.0:1789263763.196912:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c09f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+30:12117:x1876178888619136:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 874us (1065us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1789263763.196919:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 147 00000100:00100000:0.0:1789263763.198521:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263763.198563:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263763.198610:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888619264 00000100:00100000:3.0:1789263763.198618:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888619264 00000100:00100000:3.0:1789263763.198666:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 9 00000100:00100000:3.0:1789263763.198687:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88431e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+30:2397:x1876178888619264:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789263763.198701:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789263763.198721:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1e2dc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e91 expref: 30 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263763.198747:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9dd8829ed700) 00010000:00010000:3.0:1789263763.198760:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789263763.198804:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88431e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+29:2397:x1876178888619264:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 130us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263763.198813:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 9 00000100:00100000:2.0:1789263763.198906:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888619392 00000100:00100000:2.0:1789263763.198911:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888619392 00000100:00100000:2.0:1789263763.198939:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 148 00000100:00100000:2.0:1789263763.198947:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88431f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+29:12117:x1876178888619392:12345-192.168.203.20@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789263763.199026:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88431f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+29:12117:x1876178888619392:12345-192.168.203.20@tcp:59:lhsmtool_posix.0 Request processed in 79us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263763.199034:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 148 00000001:00080000:3.0:1789263763.199104:0:6466:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967411 is committed 00000004:00080000:3.0:1789263763.199114:0:6466:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:3.0:1789263763.199148:0:6466:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9dd9c0b04a80 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1789263763.199153:0:6466:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9dd9bb641700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9dd9c0b04c00 00000020:00080000:3.0:1789263763.199157:0:6466:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9dd9bb641200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9dd884334000 00000020:00080000:0.0:1789263763.199173:0:6519:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 1 00000020:00080000:3.0:1789263763.199176:0:6466:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:0.0:1789263763.199236:0:6519:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:2.0:1789263763.199281:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805400/0xce1582440fb1e22d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263763.199290:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805400/0xce1582440fb1e22d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263763.199304:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805400/0xce1582440fb1e22d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263763.199311:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bb805400 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263763.199315:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805400/0xce1582440fb1e22d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263763.199323:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805400/0xce1582440fb1e22d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263763.199332:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9dd8829ed800) 00010000:00010000:2.0:1789263763.199335:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789263763.199338:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805400/0xce1582440fb1e22d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263763.199344:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805400/0xce1582440fb1e22d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263763.199429:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883e31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898091008:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789263763.199475:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263763.199532:0:8392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898091008 00000100:00100000:0.0:1789263763.199538:0:8392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898091008 00000100:00100000:0.0:1789263763.199584:0:8392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789263763.199594:0:8392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c09f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3620:x1876178898091008:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1789263763.199709:0:8392:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1789263763.199720:0:8392:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1789263757 -> 1789263757 00002000:00010000:0.0:1789263763.199723:0:8392:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 1789263757 -> 1789263757 00002000:00010000:0.0:1789263763.199725:0:8392:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1789263757 -> 1789263757 00002000:00010000:0.0:1789263763.199727:0:8392:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1789263763.199779:0:8392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c09f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3620:x1876178898091008:12345-0@lo:2:osp-syn-0-0.0 Request processed in 187us (304us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1789263763.199787:0:8392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:2.0:1789263763.199826:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1789263763.199832:0:3620:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9dd883e31180/2, rc 0, transno 4294967313 00000100:00100000:0.0:1789263763.199839:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883e31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898091008:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789263763.200603:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263763.200689:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888619520 00000100:00100000:2.0:1789263763.200693:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888619520 00000001:00080000:3.0:1789263763.200723:0:8388:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:3.0:1789263763.200732:0:8388:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000100:00080000:0.0:1789263763.200754:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789263763.200759:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 149 00000100:00100000:2.0:1789263763.200769:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88431c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+5:12117:x1876178888619520:12345-192.168.203.20@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789263763.200826:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88431c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+5:12117:x1876178888619520:12345-192.168.203.20@tcp:59:lhsmtool_posix.0 Request processed in 59us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263763.200833:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 149 00000040:00080000:0.0:1789263763.245231:0:13757:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789263763.245241:0:13757:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789263763.245262:0:13757:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1789263763.245275:0:13757:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1789263763.886243:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789263763.928206:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263763.928287:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888619648 00000100:00100000:1.0:1789263763.928296:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888619648 00000100:00100000:1.0:1789263763.928355:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 150 00000100:00100000:1.0:1789263763.928366:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88431d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+13:12159:x1876178888619648:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:1.0:1789263763.928384:0:8417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263763.928403:0:8417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3000/0xce1582440fb1e2ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11e98 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.928464:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2800/0xce1582440fb1e2f1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.928487:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2800/0xce1582440fb1e2f1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.928498:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2800/0xce1582440fb1e2f1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.928512:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3c00/0xce1582440fb1e2f8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.928520:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3c00/0xce1582440fb1e2f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.928526:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3c00/0xce1582440fb1e2f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.928566:0:8417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2800/0xce1582440fb1e2f1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.928573:0:8417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2800/0xce1582440fb1e2f1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.928591:0:8417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2800/0xce1582440fb1e2f1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.928598:0:8417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd8841a2800 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263763.928602:0:8417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2800/0xce1582440fb1e2f1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.928610:0:8417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2800/0xce1582440fb1e2f1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.928622:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd9bb596200) 00010000:00010000:1.0:1789263763.928625:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263763.928630:0:8417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2800/0xce1582440fb1e2f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.928636:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2800/0xce1582440fb1e2f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.928646:0:8417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3c00/0xce1582440fb1e2f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.928653:0:8417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3c00/0xce1582440fb1e2f8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.928658:0:8417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3c00/0xce1582440fb1e2f8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.928663:0:8417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd8841a3c00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263763.928665:0:8417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3c00/0xce1582440fb1e2f8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.928679:0:8417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3c00/0xce1582440fb1e2f8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.928688:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9dd8829ede00) 00010000:00010000:1.0:1789263763.928690:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263763.928693:0:8417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3c00/0xce1582440fb1e2f8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.928699:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3c00/0xce1582440fb1e2f8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.928728:0:8417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3000/0xce1582440fb1e2ea lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e98 expref: 14 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.928750:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd9bb596200) 00010000:00010000:1.0:1789263763.928752:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263763.928756:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3000/0xce1582440fb1e2ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e98 expref: 14 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.928767:0:8417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd8841a3000, rc 0) 00000100:00100000:1.0:1789263763.928828:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88431d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+13:12159:x1876178888619648:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 463us (626us total) trans 0 rc 301/301 00000100:00100000:1.0:1789263763.928835:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 150 00000100:00100000:1.0:1789263763.931285:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263763.931353:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888619904 00000100:00100000:3.0:1789263763.931363:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888619904 00000100:00100000:3.0:1789263763.931416:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 151 00000100:00100000:3.0:1789263763.931428:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+13:12159:x1876178888619904:12345-192.168.203.20@tcp:36:lfs.0 00010000:00010000:3.0:1789263763.931476:0:6489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789263763.931500:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530800/0xce1582440fb1dc5a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11cc3 expref: 13 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263763.931516:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd9bb596200) 00010000:00010000:3.0:1789263763.931521:0:6489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789263763.931584:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e2ff lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263763.931610:0:6489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804a00/0xce1582440fb1e2c0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e8a expref: 5 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263763.931618:0:6489:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e2ff lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263763.931651:0:6489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804a00/0xce1582440fb1e2c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e8a expref: 5 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263763.931666:0:6489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804a00/0xce1582440fb1e2c0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e8a expref: 5 pid: 6488 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263763.931691:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9c09f6680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6489:1876178898091136:192.168.203.20@tcp:104: 00000100:00100000:3.0:1789263763.931796:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd986221900 going to sleep for 11 seconds 00000100:00100000:3.0:1789263763.932632:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9c09f6680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6489:1876178898091136:192.168.203.20@tcp:104: 00010000:00010000:3.0:1789263763.932649:0:6489:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e2ff lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263763.932820:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263763.933032:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888620032 00000100:00100000:3.0:1789263763.933038:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888620032 00010000:00010000:3.0:1789263763.933104:0:6472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804a00/0xce1582440fb1e2c0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e8a expref: 6 pid: 6488 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789263763.933115:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789263763.933137:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 77 00000100:00100000:3.0:1789263763.933147:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:857a0866-badb-47ac-9591-fbf273e4680e+6:2397:x1876178888620032:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789263763.933158:0:6472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789263763.933169:0:6472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804a00/0xce1582440fb1e2c0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e8a expref: 6 pid: 6488 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263763.933179:0:6472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804a00/0xce1582440fb1e2c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e8a expref: 6 pid: 6488 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263763.933194:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804a00/0xce1582440fb1e2c0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e8a expref: 6 pid: 6488 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263763.933212:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd9bb596200) 00010000:00010000:3.0:1789263763.933216:0:6472:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e2ff lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263763.933223:0:6472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e2ff lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263763.933230:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e2ff lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263763.933249:0:6472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789263763.933276:0:6489:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e2ff lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263763.933285:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:857a0866-badb-47ac-9591-fbf273e4680e+5:2397:x1876178888620032:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 140us (465us total) trans 0 rc 0/0 00010000:00010000:1.0:1789263763.933301:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e2ff lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263763.933302:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 77 00010000:00010000:1.0:1789263763.933327:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3000/0xce1582440fb1e306 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.933337:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3000/0xce1582440fb1e306 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.933347:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3000/0xce1582440fb1e306 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.933923:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3c00/0xce1582440fb1e30d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.933934:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3c00/0xce1582440fb1e30d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.933942:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3c00/0xce1582440fb1e30d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789263763.933958:0:6489:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000053afa521 reply state 000000004b9a319e transno 4294967412 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3c00/0xce1582440fb1e30d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.933970:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3c00/0xce1582440fb1e30d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.933978:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dd8829edc00) 00010000:00010000:1.0:1789263763.933981:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789263763.933983:0:6489:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789263763.933989:0:6489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1789263763.934004:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e2ff lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.934011:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e2ff lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.934018:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e2ff lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.934025:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd990433200 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263763.934029:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e2ff lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.934037:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e2ff lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.934046:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd9bb596200) 00010000:00010000:1.0:1789263763.934049:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263763.934053:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e2ff lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.934059:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e2ff lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789263763.934074:0:6489:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000053afa521 reply state 000000004b9a319e transno 4294967412 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3000/0xce1582440fb1e306 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.934105:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3000/0xce1582440fb1e306 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.934111:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9dd8829ede00) 00010000:00010000:1.0:1789263763.934115:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789263763.934124:0:6489:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1789263763.934239:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+14:12159:x1876178888619904:12345-192.168.203.20@tcp:36:lfs.0 Request processed in 2810us (2956us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1789263763.934249:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 151 00000100:00100000:1.0:1789263763.965456:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263763.965508:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888620160 00000100:00100000:2.0:1789263763.965522:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888620160 00000100:00100000:2.0:1789263763.965587:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 152 00000100:00100000:2.0:1789263763.965616:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+14:12167:x1876178888620160:12345-192.168.203.20@tcp:101:lctl.0 00010000:00010000:2.0:1789263763.965645:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263763.965667:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804e00/0xce1582440fb1e314 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11e9f expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263763.965743:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804200/0xce1582440fb1e31b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263763.965757:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804200/0xce1582440fb1e31b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263763.965769:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804200/0xce1582440fb1e31b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789263763.965809:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789263763.965813:0:6488:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789263763.965835:0:6488:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804200/0xce1582440fb1e31b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263763.965857:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804e00/0xce1582440fb1e314 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e9f expref: 16 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263763.965875:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804200/0xce1582440fb1e31b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e9f expref: 15 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263763.965883:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd9ba858600) 00010000:00010000:2.0:1789263763.965885:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789263763.965889:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bb804200, rc 0) 00000100:00100000:2.0:1789263763.965949:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+15:12167:x1876178888620160:12345-192.168.203.20@tcp:101:lctl.0 Request processed in 337us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263763.965966:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 152 00000100:00100000:0.0:1789263763.990379:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263763.990564:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888620288 00000100:00100000:1.0:1789263763.990574:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888620288 00000100:00100000:1.0:1789263763.990637:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 153 00000100:00100000:1.0:1789263763.990650:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+15:12173:x1876178888620288:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:1.0:1789263763.990671:0:8417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263763.990830:0:8417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2800/0xce1582440fb1e322 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11ea6 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.990894:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1e329 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.990910:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1e329 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.990922:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1e329 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.990931:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3800/0xce1582440fb1e330 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.990938:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3800/0xce1582440fb1e330 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.990945:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3800/0xce1582440fb1e330 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.991029:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3a00/0xce1582440fb1e337 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.991035:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3a00/0xce1582440fb1e337 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.991039:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3a00/0xce1582440fb1e337 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789263763.991064:0:8417:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1789263763.991067:0:8417:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789263763.991204:0:8417:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3a00/0xce1582440fb1e337 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.991218:0:8417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1e329 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.991225:0:8417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1e329 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.991232:0:8417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1e329 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.991239:0:8417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd8841a2600 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263763.991244:0:8417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1e329 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.991251:0:8417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1e329 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.991268:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd9ba858600) 00010000:00010000:1.0:1789263763.991277:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263763.991282:0:8417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1e329 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.991288:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1e329 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.991302:0:8417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3800/0xce1582440fb1e330 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.991308:0:8417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3800/0xce1582440fb1e330 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.991314:0:8417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3800/0xce1582440fb1e330 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.991320:0:8417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd8841a3800 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263763.991323:0:8417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3800/0xce1582440fb1e330 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.991329:0:8417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3800/0xce1582440fb1e330 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.991337:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9dd8829ede00) 00010000:00010000:1.0:1789263763.991339:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263763.991342:0:8417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3800/0xce1582440fb1e330 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.991347:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3800/0xce1582440fb1e330 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.991372:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2800/0xce1582440fb1e322 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ea6 expref: 17 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.991398:0:8417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3a00/0xce1582440fb1e337 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ea6 expref: 16 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.991405:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dd8829edc00) 00010000:00010000:1.0:1789263763.991408:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789263763.991410:0:8417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd8841a3a00, rc 0) 00000100:00100000:1.0:1789263763.991473:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+16:12173:x1876178888620288:12345-192.168.203.20@tcp:101:bash.0 Request processed in 826us (1103us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263763.991478:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 153 00000100:00100000:0.0:1789263763.993355:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263763.993401:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888620544 00000100:00100000:1.0:1789263763.993409:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888620544 00000100:00100000:1.0:1789263763.993452:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 154 00000100:00100000:1.0:1789263763.993462:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+16:12173:x1876178888620544:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:1.0:1789263763.993478:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263763.993493:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1e33e lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11ead expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.993566:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e345 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.993576:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e345 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.993582:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e345 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.993631:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3600/0xce1582440fb1e34c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.993645:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3600/0xce1582440fb1e34c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.993649:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3600/0xce1582440fb1e34c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789263763.993975:0:6489:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:1.0:1789263763.994132:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2400/0xce1582440fb1e353 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.994138:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2400/0xce1582440fb1e353 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.994143:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2400/0xce1582440fb1e353 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.994163:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e345 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.994167:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e345 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.994171:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e345 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.994174:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd8841a2a00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263763.994177:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e345 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.994181:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e345 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.994197:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dd8829edc00) 00010000:00010000:1.0:1789263763.994199:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263763.994209:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e345 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.994213:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e345 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789263763.994226:0:6489:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f3ceb9b3 reply state 00000000bfc2228f transno 4294967413 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3600/0xce1582440fb1e34c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.994233:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3600/0xce1582440fb1e34c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.994239:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9dd8829ed900) 00010000:00010000:1.0:1789263763.994241:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789263763.994243:0:6489:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789263763.994262:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1e33e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ead expref: 19 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.994271:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2400/0xce1582440fb1e353 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ead expref: 18 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263763.994276:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd8829ed500) 00010000:00010000:1.0:1789263763.994277:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789263763.994279:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd8841a2400, rc 0) 00000100:00100000:1.0:1789263763.994324:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+19:12173:x1876178888620544:12345-192.168.203.20@tcp:101:bash.0 Request processed in 864us (973us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1789263763.994332:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 154 00000100:00100000:3.0:1789263763.996033:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263763.996137:0:8394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888620672 00000100:00100000:0.0:1789263763.996146:0:8394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888620672 00000100:00080000:1.0:1789263763.996207:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789263763.996231:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 55 00000100:00100000:0.0:1789263763.996242:0:8394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c09f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+5:2397:x1876178888620672:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:0.0:1789263763.996256:0:8394:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263763.996273:0:8394:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e262b0b/0xce1582440fb1e361 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11eb4 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789263763.996298:0:8394:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789263763.996327:0:8394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=206s v=(0 0) 00010000:00010000:0.0:1789263763.996332:0:8394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789263763.996342:0:8394:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e262b0b/0xce1582440fb1e361 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11eb4 expref: 6 pid: 8394 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263763.996359:0:8394:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002e262b0b/0xce1582440fb1e361 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11eb4 expref: 6 pid: 8394 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263763.996367:0:8394:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd883e72c00, rc 0) 00000100:00100000:0.0:1789263763.996416:0:8394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c09f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+6:2397:x1876178888620672:12345-192.168.203.20@tcp:101:bash.0 Request processed in 176us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263763.996423:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 55 00000100:00100000:0.0:1789263763.998426:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263763.998504:0:13766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888620800 00000100:00100000:3.0:1789263763.998514:0:13766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888620800 00000100:00100000:3.0:1789263763.998560:0:13766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 56 00000100:00100000:3.0:1789263763.998567:0:13766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+6:12173:x1876178888620800:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:3.0:1789263763.998582:0:13766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263763.998604:0:13766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b7e9b825/0xce1582440fb1e368 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11ebb expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263763.998628:0:13766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002e262b0b/0xce1582440fb1e361 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11eb4 expref: 7 pid: 8394 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263763.998634:0:13766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789263763.998637:0:13766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789263763.998640:0:13766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7e9b825/0xce1582440fb1e368 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ebb expref: 7 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263763.998663:0:13766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002e262b0b/0xce1582440fb1e361 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11eb4 expref: 7 pid: 8394 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263763.998673:0:13766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002e262b0b/0xce1582440fb1e361 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11eb4 expref: 7 pid: 8394 timeout: 306 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263763.998684:0:13766:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9c09f4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13766:1876178898091264:192.168.203.20@tcp:104: 00000100:00100000:3.0:1789263763.998782:0:13766:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd986221900 going to sleep for 11 seconds 00000100:00100000:0.0:1789263763.999990:0:13766:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9c09f4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13766:1876178898091264:192.168.203.20@tcp:104: 00010000:00010000:0.0:1789263764.000011:0:13766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b7e9b825/0xce1582440fb1e368 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ebb expref: 7 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263764.000023:0:13766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd990432200, rc 0) 00000100:00100000:0.0:1789263764.000071:0:13766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+7:12173:x1876178888620800:12345-192.168.203.20@tcp:101:bash.0 Request processed in 1503us (1650us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263764.000108:0:13766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 56 00000100:00100000:3.0:1789263764.000144:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263764.000330:0:10303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888620928 00000100:00100000:0.0:1789263764.000336:0:10303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888620928 00010000:00010000:0.0:1789263764.000362:0:10303:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002e262b0b/0xce1582440fb1e361 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11eb4 expref: 7 pid: 8394 timeout: 306 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263764.000418:0:10303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 78 00000100:00100000:0.0:1789263764.000427:0:10303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c09f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3ce90ea2-917f-4b54-98b0-25e051f2317f+7:2398:x1876178888620928:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789263764.000438:0:10303:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789263764.000454:0:10303:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002e262b0b/0xce1582440fb1e361 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11eb4 expref: 7 pid: 8394 timeout: 306 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263764.000463:0:10303:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002e262b0b/0xce1582440fb1e361 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11eb4 expref: 7 pid: 8394 timeout: 306 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263764.000480:0:10303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e262b0b/0xce1582440fb1e361 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11eb4 expref: 7 pid: 8394 timeout: 306 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263764.000492:0:10303:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789263764.000496:0:10303:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789263764.000504:0:10303:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b7e9b825/0xce1582440fb1e368 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ebb expref: 6 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263764.000514:0:10303:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7e9b825/0xce1582440fb1e368 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ebb expref: 6 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263764.000540:0:10303:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b7e9b825/0xce1582440fb1e368 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ebb expref: 6 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263764.000549:0:10303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10303:1876178898091392:192.168.203.20@tcp:105: 00000100:00100000:0.0:1789263764.000596:0:10303:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9bf982d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789263764.001434:0:10303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10303:1876178898091392:192.168.203.20@tcp:105: 00010000:00010000:0.0:1789263764.001447:0:10303:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789263764.001475:0:10303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c09f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3ce90ea2-917f-4b54-98b0-25e051f2317f+6:2398:x1876178888620928:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 1050us (1334us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263764.001483:0:10303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 78 00000100:00100000:3.0:1789263764.002156:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263764.002207:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888621184 00000100:00100000:1.0:1789263764.002214:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888621184 00000100:00100000:1.0:1789263764.002252:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 33 00000100:00100000:1.0:1789263764.002260:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8838f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+19:12173:x1876178888621184:12345-192.168.203.20@tcp:35:bash.0 00000100:00100000:1.0:1789263764.002515:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8838f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+20:12173:x1876178888621184:12345-192.168.203.20@tcp:35:bash.0 Request processed in 254us (360us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1789263764.002528:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 33 00000100:00100000:1.0:1789263764.034271:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263764.034339:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888621440 00000100:00100000:2.0:1789263764.034349:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888621440 00000100:00100000:2.0:1789263764.034423:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 155 00000100:00100000:2.0:1789263764.034433:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+20:12183:x1876178888621440:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:2.0:1789263764.034458:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263764.034479:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804e00/0xce1582440fb1e36f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11ec2 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789263764.034579:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1789263764.034672:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804e00/0xce1582440fb1e36f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ec2 expref: 22 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263764.034686:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd9ba858600) 00010000:00010000:2.0:1789263764.034689:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789263764.034694:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804e00/0xce1582440fb1e36f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ec2 expref: 22 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263764.034708:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bb804e00, rc 0) 00000100:00100000:2.0:1789263764.034769:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+21:12183:x1876178888621440:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 338us (507us total) trans 4294967415 rc 301/301 00000100:00100000:2.0:1789263764.034777:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 155 00000100:00100000:3.0:1789263764.036122:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263764.036169:0:14127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888621696 00000100:00100000:0.0:1789263764.036178:0:14127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888621696 00000100:00100000:0.0:1789263764.036219:0:14127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 34 00000100:00100000:0.0:1789263764.036228:0:14127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+21:12183:x1876178888621696:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:0.0:1789263764.036399:0:14127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+22:12183:x1876178888621696:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 172us (280us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1789263764.036406:0:14127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 34 00000100:00100000:3.0:1789263764.065838:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263764.065930:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888621824 00000100:00100000:1.0:1789263764.065944:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888621824 00000100:00100000:1.0:1789263764.066023:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 156 00000100:00100000:1.0:1789263764.066037:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+22:12189:x1876178888621824:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:1.0:1789263764.066069:0:8417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263764.066131:0:8417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e37d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11ec9 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.066215:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3800/0xce1582440fb1e384 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.066234:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3800/0xce1582440fb1e384 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.066247:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3800/0xce1582440fb1e384 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789263764.066302:0:8417:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1789263764.066306:0:8417:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789263764.066333:0:8417:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3800/0xce1582440fb1e384 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.066387:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e37d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ec9 expref: 24 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.066422:0:8417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3800/0xce1582440fb1e384 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ec9 expref: 23 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.066433:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dd8829edc00) 00010000:00010000:1.0:1789263764.066436:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789263764.066440:0:8417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd8841a3800, rc 0) 00000100:00100000:1.0:1789263764.066526:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+23:12189:x1876178888621824:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 482us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263764.066534:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 156 00000100:00100000:1.0:1789263764.068961:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263764.069134:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888622080 00000100:00100000:3.0:1789263764.069150:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888622080 00000100:00100000:3.0:1789263764.069225:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 157 00000100:00100000:3.0:1789263764.069236:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+23:12189:x1876178888622080:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:3.0:1789263764.069268:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263764.069285:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1e38b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11ed0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.069386:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e392 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.069402:0:6489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2400/0xce1582440fb1e353 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ead expref: 24 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.069411:0:6489:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e392 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.069444:0:6489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2400/0xce1582440fb1e353 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ead expref: 24 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.069457:0:6489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2400/0xce1582440fb1e353 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ead expref: 24 pid: 6489 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263764.069470:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88297d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6489:1876178898091520:192.168.203.20@tcp:104: 00000100:00100000:3.0:1789263764.069565:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd986221e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789263764.070826:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88297d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6489:1876178898091520:192.168.203.20@tcp:104: 00010000:00010000:1.0:1789263764.070849:0:6489:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e392 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263764.071294:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263764.071369:0:7428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888622208 00000100:00100000:2.0:1789263764.071374:0:7428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888622208 00010000:00010000:2.0:1789263764.071403:0:7428:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2400/0xce1582440fb1e353 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ead expref: 25 pid: 6489 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263764.071453:0:7428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 79 00000100:00100000:2.0:1789263764.071463:0:7428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+25:2397:x1876178888622208:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789263764.071476:0:7428:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789263764.071483:0:7428:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2400/0xce1582440fb1e353 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ead expref: 25 pid: 6489 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263764.071496:0:7428:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2400/0xce1582440fb1e353 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ead expref: 25 pid: 6489 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263764.071517:0:7428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2400/0xce1582440fb1e353 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ead expref: 25 pid: 6489 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263764.071532:0:7428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd8829ed500) 00010000:00010000:2.0:1789263764.071537:0:7428:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e392 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263764.071545:0:7428:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e392 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263764.071552:0:7428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e392 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263764.071584:0:7428:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789263764.071616:0:6489:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e392 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.071622:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e392 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263764.071629:0:7428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+24:2397:x1876178888622208:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 166us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263764.071636:0:7428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 79 00000004:00200000:1.0:1789263764.071637:0:6489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789263764.071767:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1e38b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ed0 expref: 25 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.071793:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e392 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ed0 expref: 24 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.071800:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd8829ed500) 00010000:00010000:1.0:1789263764.071803:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789263764.071805:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd990433200, rc 0) 00000100:00100000:1.0:1789263764.071835:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+24:12189:x1876178888622080:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 2602us (2900us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1789263764.071842:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 157 00000100:00100000:1.0:1789263764.073922:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263764.073964:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888622464 00000100:00100000:2.0:1789263764.073983:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888622464 00000100:00100000:2.0:1789263764.074020:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 158 00000100:00100000:2.0:1789263764.074029:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+24:12189:x1876178888622464:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:2.0:1789263764.074057:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263764.074059:0:6488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789263764.074091:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e392 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ed0 expref: 24 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263764.074108:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd8829ed500) 00010000:00010000:2.0:1789263764.074116:0:6488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789263764.074129:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804e00/0xce1582440fb1e3a0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11ed7 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263764.074224:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805e00/0xce1582440fb1e3a7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263764.074236:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805e00/0xce1582440fb1e3a7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263764.074247:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805e00/0xce1582440fb1e3a7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789263764.074257:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789263764.074335:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804e00/0xce1582440fb1e3a0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ed7 expref: 26 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263764.074348:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805e00/0xce1582440fb1e3a7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ed7 expref: 25 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263764.074357:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd9ba858f00) 00010000:00010000:2.0:1789263764.074365:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789263764.074369:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bb805e00, rc 0) 00000100:00100000:2.0:1789263764.074429:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+25:12189:x1876178888622464:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 401us (513us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1789263764.074436:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 158 00000100:00100000:3.0:1789263764.077207:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263764.077268:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888622592 00000100:00100000:1.0:1789263764.077282:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888622592 00000100:00100000:1.0:1789263764.077343:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 159 00000100:00100000:1.0:1789263764.077353:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+25:12189:x1876178888622592:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:1.0:1789263764.077374:0:8417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263764.077391:0:8417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e3b5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11ede expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.077436:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e3b5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ede expref: 26 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.077446:0:8417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e3b5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ede expref: 26 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.077459:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd9ba858f00) 00010000:00010000:1.0:1789263764.077470:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789263764.077473:0:8417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd8841a2a00, rc 0) 00000100:00100000:1.0:1789263764.077522:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+26:12189:x1876178888622592:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 172us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263764.077527:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 159 00000100:00100000:0.0:1789263764.080028:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263764.080120:0:8392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888622720 00000100:00100000:2.0:1789263764.080134:0:8392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888622720 00000100:00100000:2.0:1789263764.080204:0:8392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 57 00000100:00100000:2.0:1789263764.080218:0:8392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+6:2399:x1876178888622720:12345-192.168.203.20@tcp:1:lfs.0 00010000:00010000:2.0:1789263764.080286:0:8392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081dcba21/0xce1582440fb1e3bc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263764.080312:0:8392:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b7e9b825/0xce1582440fb1e368 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ebb expref: 6 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263764.080323:0:8392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789263764.080329:0:8392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789263764.080335:0:8392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081dcba21/0xce1582440fb1e3bc lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263764.080384:0:8392:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b7e9b825/0xce1582440fb1e368 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ebb expref: 6 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263764.080545:0:8392:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b7e9b825/0xce1582440fb1e368 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ebb expref: 6 pid: 13766 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263764.080565:0:8392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff78e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8392:1876178898091648:192.168.203.20@tcp:104: 00000100:00100000:2.0:1789263764.080690:0:8392:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9c09d3480 going to sleep for 11 seconds 00000100:00100000:2.0:1789263764.081898:0:8392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff78e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8392:1876178898091648:192.168.203.20@tcp:104: 00010000:00010000:2.0:1789263764.081926:0:8392:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000081dcba21/0xce1582440fb1e3bc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263764.082281:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263764.082333:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888622848 00000100:00100000:2.0:1789263764.082340:0:8398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888622848 00002000:00100000:2.0:1789263764.082391:0:8398:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9dd99f9a7800 x1876178888622848/t0(0) o4->3ce90ea2-917f-4b54-98b0-25e051f2317f@192.168.203.20@tcp:600/0 lens 504/0 e 0 to 0 dl 1789263775 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789263764.082404:0:8398:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dd99f9a7800 with x1876178888622848 ext(0->12) 00010000:00010000:2.0:1789263764.082413:0:8398:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b7e9b825/0xce1582440fb1e368 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ebb expref: 7 pid: 13766 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263764.082428:0:8398:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b7e9b825/0xce1582440fb1e368 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ebb expref: 7 pid: 13766 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789263764.082438:0:8398:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9dd99f9a7800 00000100:00100000:2.0:1789263764.082472:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 2 00000100:00100000:2.0:1789263764.082482:0:8398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+7:2398:x1876178888622848:12345-192.168.203.20@tcp:4:lfs.0 00000100:00100000:2.0:1789263764.085243:0:8398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+9:2398:x1876178888622848:12345-192.168.203.20@tcp:4:lfs.0 Request processed in 2751us (2952us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1789263764.085259:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 2 00002000:00100000:2.0:1789263764.085271:0:8398:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9dd99f9a7800 x1876178888622848/t4294967306(0) o4->3ce90ea2-917f-4b54-98b0-25e051f2317f@192.168.203.20@tcp:600/0 lens 504/448 e 0 to 0 dl 1789263775 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789263764.085283:0:8398:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dd99f9a7800 with x1876178888622848 ext(0->12) 00010000:00010000:2.0:1789263764.085306:0:8398:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b7e9b825/0xce1582440fb1e368 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ebb expref: 9 pid: 13766 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263764.085324:0:8398:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b7e9b825/0xce1582440fb1e368 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ebb expref: 9 pid: 13766 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789263764.085333:0:8398:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9dd99f9a7800 00000100:00100000:3.0:1789263764.086505:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263764.086631:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888622976 00000100:00100000:1.0:1789263764.086639:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888622976 00010000:00010000:1.0:1789263764.086673:0:8409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b7e9b825/0xce1582440fb1e368 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ebb expref: 9 pid: 13766 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263764.086709:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 80 00000100:00100000:1.0:1789263764.086721:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd991532850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+9:2400:x1876178888622976:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789263764.086748:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789263764.086763:0:8409:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1789263764.086766:0:8409:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1789263764 00002000:00010000:1.0:1789263764.086768:0:8409:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1789263764 00002000:00010000:1.0:1789263764.086771:0:8409:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1789263764 00002000:00010000:1.0:1789263764.086773:0:8409:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1789263764.086779:0:8409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b7e9b825/0xce1582440fb1e368 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ebb expref: 9 pid: 13766 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.086792:0:8409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b7e9b825/0xce1582440fb1e368 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ebb expref: 9 pid: 13766 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.086815:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b7e9b825/0xce1582440fb1e368 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ebb expref: 9 pid: 13766 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.086854:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789263764.086859:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789263764.086865:0:8409:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000081dcba21/0xce1582440fb1e3bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.086875:0:8409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081dcba21/0xce1582440fb1e3bc lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.086906:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789263764.086953:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd991532850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+8:2400:x1876178888622976:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 235us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263764.086961:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 80 00010000:00010000:2.0:1789263764.087072:0:8392:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000081dcba21/0xce1582440fb1e3bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263764.087103:0:8392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000081dcba21/0xce1582440fb1e3bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263764.087123:0:8392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081dcba21/0xce1582440fb1e3bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263764.087137:0:8392:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000081dcba21/0xce1582440fb1e3bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263764.087146:0:8392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000081dcba21/0xce1582440fb1e3bc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263764.087154:0:8392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bb805000 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:2.0:1789263764.087159:0:8392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000081dcba21/0xce1582440fb1e3bc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263764.087168:0:8392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000081dcba21/0xce1582440fb1e3bc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263764.087188:0:8392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000081dcba21/0xce1582440fb1e3bc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263764.087196:0:8392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081dcba21/0xce1582440fb1e3bc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263764.087244:0:8392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+7:2399:x1876178888622720:12345-192.168.203.20@tcp:1:lfs.0 Request processed in 7029us (7224us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263764.087252:0:8392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 57 00000100:00100000:0.0:1789263764.088393:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263764.088440:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888623232 00000100:00100000:1.0:1789263764.088448:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888623232 00000100:00100000:1.0:1789263764.088486:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 35 00000100:00100000:1.0:1789263764.088495:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+26:12189:x1876178888623232:12345-192.168.203.20@tcp:35:lfs.0 00000004:00010000:1.0:1789263764.088544:0:6490:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805e00/0xce1582440fb1e3a7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ed7 expref: 26 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789263764.088705:0:6490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967419 00000001:00080000:1.0:1789263764.088754:0:6490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967420 00000001:00080000:1.0:1789263764.089021:0:6490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967421 00010000:00010000:1.0:1789263764.089055:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1e3c3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.089069:0:6490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e3b5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ede expref: 30 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.089104:0:6490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1e3c3 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.089128:0:6490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e3b5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ede expref: 30 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.089138:0:6490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e3b5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ede expref: 30 pid: 8417 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263764.089149:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6490:1876178898091776:192.168.203.20@tcp:104: 00000100:00100000:1.0:1789263764.089223:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9872a5840 going to sleep for 11 seconds 00000100:00100000:1.0:1789263764.090502:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6490:1876178898091776:192.168.203.20@tcp:104: 00010000:00010000:1.0:1789263764.090525:0:6490:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1e3c3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263764.090684:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263764.090728:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888623360 00000100:00100000:1.0:1789263764.090746:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888623360 00010000:00010000:1.0:1789263764.090772:0:6473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e3b5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ede expref: 31 pid: 8417 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263764.090811:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 81 00000100:00100000:1.0:1789263764.090819:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+31:2397:x1876178888623360:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789263764.090828:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789263764.090833:0:6473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e3b5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ede expref: 31 pid: 8417 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.090859:0:6473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e3b5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ede expref: 31 pid: 8417 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.090877:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e3b5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ede expref: 31 pid: 8417 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.090891:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd9ba858f00) 00010000:00010000:1.0:1789263764.090895:0:6473:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1e3c3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.090902:0:6473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1e3c3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.090908:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1e3c3 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.090936:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789263764.090960:0:6490:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1e3c3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.090970:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1e3c3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263764.090986:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+30:2397:x1876178888623360:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 165us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263764.090997:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 81 00000001:00080000:3.0:1789263764.091062:0:6490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967422 00000001:00080000:3.0:1789263764.091195:0:6490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000100:00100000:3.0:1789263764.091329:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88297f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6490:1876178898091904:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789263764.091369:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263764.091403:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd989758f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789263764.091463:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898091904 00000100:00100000:0.0:1789263764.091469:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898091904 00000100:00100000:0.0:1789263764.091521:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00080000:1.0:1789263764.091524:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789263764.091531:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6490:x1876178898091904:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789263764.091638:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6490:x1876178898091904:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 110us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263764.091645:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789263764.091782:0:6490:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:3.0:1789263764.091788:0:6490:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967305 00000004:00080000:3.0:1789263764.091804:0:6490:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9dd9bfa93480, transno 4294967302 00000004:00080000:3.0:1789263764.091817:0:6490:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:3.0:1789263764.091828:0:6490:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9dd9bfa84380, transno 4294967305 00000100:00100000:3.0:1789263764.091834:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88297f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6490:1876178898091904:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789263764.091933:0:6490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000100:00100000:3.0:1789263764.091975:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88297f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6490:1876178898092032:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789263764.092003:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263764.092031:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd986221900 going to sleep for 11 seconds 00000100:00100000:0.0:1789263764.092047:0:8499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898092032 00000100:00100000:0.0:1789263764.092052:0:8499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898092032 00000100:00100000:0.0:1789263764.092109:0:8499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789263764.092118:0:8499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaa5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6490:x1876178898092032:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789263764.092226:0:8499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaa5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6490:x1876178898092032:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 109us (221us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1789263764.092235:0:8499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789263764.092248:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88297f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6490:1876178898092032:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789263764.092280:0:6490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:3.0:1789263764.092306:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1e3c3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.092315:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1e3c3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.092321:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1e3c3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.092328:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd8841a2600 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263764.092339:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1e3c3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.092346:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1e3c3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.092355:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd9ba858f00) 00010000:00010000:3.0:1789263764.092358:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789263764.092362:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1e3c3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.092367:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1e3c3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789263764.092443:0:6490:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789263764.092492:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:3.0:1789263764.092503:0:6490:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 206382425971ns, next at 207382423541ns, rc = 0 00000001:00080000:3.0:1789263764.092509:0:6490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00010000:00010000:3.0:1789263764.092531:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd9ba858f00) 00010000:00010000:3.0:1789263764.092534:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789263764.092540:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805e00/0xce1582440fb1e3a7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ed7 expref: 34 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263764.092627:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+33:12189:x1876178888623232:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 4133us (4236us total) trans 4294967427 rc 0/0 00000100:00100000:3.0:1789263764.092635:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 35 00000020:00080000:3.0:1789263764.092639:0:6490:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789263764.094016:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263764.094059:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888623488 00000100:00100000:1.0:1789263764.094068:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888623488 00000100:00100000:1.0:1789263764.094147:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 160 00000100:00100000:1.0:1789263764.094158:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+33:12189:x1876178888623488:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:1.0:1789263764.094176:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263764.094203:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3200/0xce1582440fb1e3ca lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11ee5 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.094266:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3200/0xce1582440fb1e3ca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ee5 expref: 34 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.094279:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3200/0xce1582440fb1e3ca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ee5 expref: 34 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.094295:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd8829ed500) 00010000:00010000:1.0:1789263764.094298:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789263764.094302:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd8841a3200, rc 0) 00000100:00100000:1.0:1789263764.094346:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+34:12189:x1876178888623488:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 191us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263764.094354:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 160 00000100:00100000:0.0:1789263764.095491:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263764.095535:0:14127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888623744 00000100:00100000:2.0:1789263764.095541:0:14127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888623744 00000100:00100000:2.0:1789263764.095579:0:14127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 36 00000100:00100000:2.0:1789263764.095587:0:14127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+34:12189:x1876178888623744:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:2.0:1789263764.095766:0:14127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+35:12189:x1876178888623744:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 175us (273us total) trans 4294967428 rc 0/0 00000100:00100000:2.0:1789263764.095774:0:14127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 36 00000100:00100000:2.0:1789263764.125687:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263764.125770:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888624000 00000100:00100000:1.0:1789263764.125780:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888624000 00000100:00100000:1.0:1789263764.125838:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 161 00000100:00100000:1.0:1789263764.125848:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+35:12199:x1876178888624000:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:1.0:1789263764.125884:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263764.125904:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e3d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11eec expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.126019:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3e00/0xce1582440fb1e3d8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.126042:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3e00/0xce1582440fb1e3d8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.126059:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3e00/0xce1582440fb1e3d8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789263764.126122:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1789263764.126225:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e3d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11eec expref: 38 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.126244:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3e00/0xce1582440fb1e3d8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11eec expref: 37 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.126252:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dd8829edc00) 00010000:00010000:1.0:1789263764.126255:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789263764.126258:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd8841a3e00, rc 0) 00000100:00100000:1.0:1789263764.126310:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+37:12199:x1876178888624000:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 464us (631us total) trans 4294967429 rc 0/0 00000100:00100000:1.0:1789263764.126316:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 161 00000100:00100000:0.0:1789263764.127745:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263764.127806:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888624128 00000100:00100000:1.0:1789263764.127816:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888624128 00000100:00100000:1.0:1789263764.127851:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 162 00000100:00100000:1.0:1789263764.127857:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+37:12199:x1876178888624128:12345-192.168.203.20@tcp:34:lfs.0 00010000:00010000:1.0:1789263764.127911:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2000/0xce1582440fb1e3e6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.127924:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2000/0xce1582440fb1e3e6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.127934:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2000/0xce1582440fb1e3e6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.127952:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1e3ed lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.127971:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1e3ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.127979:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1e3ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.128036:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2400/0xce1582440fb1e3f4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.128042:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2400/0xce1582440fb1e3f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.128048:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2400/0xce1582440fb1e3f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789263764.128106:0:8417:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2400/0xce1582440fb1e3f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.128116:0:8417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2000/0xce1582440fb1e3e6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.128120:0:8417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2000/0xce1582440fb1e3e6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.128125:0:8417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2000/0xce1582440fb1e3e6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.128128:0:8417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd8841a2000 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263764.128131:0:8417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2000/0xce1582440fb1e3e6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.128136:0:8417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2000/0xce1582440fb1e3e6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.128149:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dd8829edc00) 00010000:00010000:1.0:1789263764.128151:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263764.128154:0:8417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2000/0xce1582440fb1e3e6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.128158:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2000/0xce1582440fb1e3e6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.128165:0:8417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1e3ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.128169:0:8417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1e3ed lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.128175:0:8417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1e3ed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.128180:0:8417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd8841a2600 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263764.128183:0:8417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1e3ed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.128189:0:8417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1e3ed lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.128196:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9dd8829ed900) 00010000:00010000:1.0:1789263764.128199:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263764.128202:0:8417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1e3ed lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.128207:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1e3ed lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.128227:0:8417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2400/0xce1582440fb1e3f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.128232:0:8417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2400/0xce1582440fb1e3f4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.128237:0:8417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2400/0xce1582440fb1e3f4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.128242:0:8417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd8841a2400 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263764.128245:0:8417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2400/0xce1582440fb1e3f4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.128250:0:8417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2400/0xce1582440fb1e3f4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.128258:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd8829ed500) 00010000:00010000:1.0:1789263764.128260:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263764.128263:0:8417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2400/0xce1582440fb1e3f4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.128269:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2400/0xce1582440fb1e3f4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263764.128325:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+37:12199:x1876178888624128:12345-192.168.203.20@tcp:34:lfs.0 Request processed in 467us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263764.128334:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 162 00000040:00080000:2.0:1789263764.141652:0:13759:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789263764.144229:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263764.144296:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888624384 00000100:00100000:1.0:1789263764.144306:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888624384 00000100:00100000:1.0:1789263764.144361:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 163 00000100:00100000:1.0:1789263764.144385:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883969180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+37:12202:x1876178888624384:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:1.0:1789263764.144405:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263764.144424:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2400/0xce1582440fb1e3fb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11ef3 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.144488:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1e402 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.144501:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1e402 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.144512:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1e402 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.144523:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2000/0xce1582440fb1e409 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.144531:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2000/0xce1582440fb1e409 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.144538:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2000/0xce1582440fb1e409 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.144654:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e410 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.144663:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e410 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.144669:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e410 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789263764.144692:0:6489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789263764.144776:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1e402 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.144784:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1e402 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.144797:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1e402 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.144803:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd8841a2600 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263764.144807:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1e402 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.144814:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1e402 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.144824:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dd8829edc00) 00010000:00010000:1.0:1789263764.144827:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263764.144831:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1e402 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.144836:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1e402 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.144848:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2000/0xce1582440fb1e409 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.144854:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2000/0xce1582440fb1e409 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.144869:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2000/0xce1582440fb1e409 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.144875:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd8841a2000 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263764.144878:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2000/0xce1582440fb1e409 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.144884:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2000/0xce1582440fb1e409 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.144892:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9dd8829ed900) 00010000:00010000:1.0:1789263764.144895:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263764.144898:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2000/0xce1582440fb1e409 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.144904:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2000/0xce1582440fb1e409 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.144934:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2400/0xce1582440fb1e3fb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ef3 expref: 40 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.144947:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e410 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ef3 expref: 39 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.144955:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd8829ed500) 00010000:00010000:1.0:1789263764.144957:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789263764.144959:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd8841a2a00, rc 0) 00000100:00100000:1.0:1789263764.145012:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883969180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+39:12202:x1876178888624384:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 628us (792us total) trans 4294967430 rc 0/0 00000100:00100000:1.0:1789263764.145027:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 163 00000100:00100000:2.0:1789263764.146328:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263764.146373:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888624512 00000100:00100000:1.0:1789263764.146380:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888624512 00000100:00100000:1.0:1789263764.146419:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 164 00000100:00100000:1.0:1789263764.146428:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+39:12202:x1876178888624512:12345-192.168.203.20@tcp:54:lfs.0 00010000:00010000:1.0:1789263764.146474:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1e41e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.146486:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1e41e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.146495:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1e41e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.146517:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1e41e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.146523:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1e41e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.146530:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1e41e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.146536:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd8841a2e00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263764.146538:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1e41e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.146542:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1e41e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.146548:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd8829ed500) 00010000:00010000:1.0:1789263764.146557:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789263764.146561:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1e41e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.146565:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1e41e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263764.146603:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+39:12202:x1876178888624512:12345-192.168.203.20@tcp:54:lfs.0 Request processed in 177us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263764.146611:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 164 00000100:00100000:0.0:1789263764.147377:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263764.147427:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888624768 00000100:00100000:3.0:1789263764.147433:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888624768 00000100:00100000:3.0:1789263764.147467:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 37 00000100:00100000:3.0:1789263764.147475:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd987345c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+39:12202:x1876178888624768:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:3.0:1789263764.147636:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd987345c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+40:12202:x1876178888624768:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 161us (259us total) trans 4294967431 rc 0/0 00000100:00100000:3.0:1789263764.147643:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 37 00000100:00100000:0.0:1789263764.249309:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263764.249368:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888625024 00000100:00100000:1.0:1789263764.249379:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888625024 00000100:00100000:1.0:1789263764.249438:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 165 00000100:00100000:1.0:1789263764.249449:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883969c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+40:12233:x1876178888625024:12345-192.168.203.20@tcp:101:cat.0 00010000:00010000:1.0:1789263764.249472:0:8417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263764.249491:0:8417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1e425 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11efa expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.249589:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2400/0xce1582440fb1e42c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.249604:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2400/0xce1582440fb1e42c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.249616:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2400/0xce1582440fb1e42c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789263764.249626:0:8417:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789263764.249737:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1e425 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11efa expref: 43 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.249776:0:8417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2400/0xce1582440fb1e42c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11efa expref: 42 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.249785:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd8829ed500) 00010000:00010000:1.0:1789263764.249788:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789263764.249791:0:8417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd8841a2400, rc 0) 00000100:00100000:1.0:1789263764.249845:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883969c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+42:12233:x1876178888625024:12345-192.168.203.20@tcp:101:cat.0 Request processed in 398us (547us total) trans 4294967432 rc 0/0 00000100:00100000:1.0:1789263764.249853:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 165 00000100:00100000:2.0:1789263764.251138:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263764.251187:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888625152 00000100:00100000:3.0:1789263764.251195:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888625152 00000100:00100000:3.0:1789263764.251311:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 10 00000100:00100000:3.0:1789263764.251321:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+42:2397:x1876178888625152:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789263764.251337:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789263764.251360:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2400/0xce1582440fb1e42c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11efa expref: 42 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.251378:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd8829ed500) 00010000:00010000:3.0:1789263764.251382:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789263764.251420:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263764.251430:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+41:2397:x1876178888625152:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 110us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263764.251439:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 10 00000100:00100000:1.0:1789263764.251478:0:14127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888625408 00000100:00100000:1.0:1789263764.251483:0:14127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888625408 00000100:00100000:1.0:1789263764.251526:0:14127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 38 00000100:00100000:1.0:1789263764.251536:0:14127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88396bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+41:12233:x1876178888625408:12345-192.168.203.20@tcp:35:cat.0 00000100:00100000:1.0:1789263764.251702:0:14127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88396bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+42:12233:x1876178888625408:12345-192.168.203.20@tcp:35:cat.0 Request processed in 167us (284us total) trans 4294967433 rc 0/0 00000100:00100000:1.0:1789263764.251709:0:14127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 38 00000100:00100000:3.0:1789263764.278522:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263764.278579:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888625664 00000100:00100000:1.0:1789263764.278589:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888625664 00000100:00100000:1.0:1789263764.278645:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 166 00000100:00100000:1.0:1789263764.278656:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaa4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+42:12239:x1876178888625664:12345-192.168.203.20@tcp:101:dd.0 00010000:00010000:1.0:1789263764.278680:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263764.278684:0:6489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789263764.278863:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3800/0xce1582440fb1e384 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ec9 expref: 42 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.278894:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dd8829edc00) 00010000:00010000:1.0:1789263764.278898:0:6489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789263764.278912:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1e43a lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11f01 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.279005:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2000/0xce1582440fb1e441 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.279019:0:6489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e410 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ef3 expref: 42 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.279027:0:6489:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2000/0xce1582440fb1e441 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.279056:0:6489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e410 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ef3 expref: 42 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.279067:0:6489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e410 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ef3 expref: 42 pid: 6489 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263764.279118:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6489:1876178898092160:192.168.203.20@tcp:104: 00000100:00100000:1.0:1789263764.279209:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9872a5480 going to sleep for 11 seconds 00000100:00100000:1.0:1789263764.280639:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6489:1876178898092160:192.168.203.20@tcp:104: 00010000:00010000:1.0:1789263764.280661:0:6489:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2000/0xce1582440fb1e441 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263764.281509:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263764.281561:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888625792 00000100:00100000:1.0:1789263764.281580:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888625792 00010000:00010000:1.0:1789263764.281610:0:6472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e410 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ef3 expref: 43 pid: 6489 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263764.281645:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 82 00000100:00100000:1.0:1789263764.281654:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaa6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+43:2398:x1876178888625792:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789263764.281667:0:6472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789263764.281674:0:6472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e410 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ef3 expref: 43 pid: 6489 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.281687:0:6472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e410 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ef3 expref: 43 pid: 6489 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.281708:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e410 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ef3 expref: 43 pid: 6489 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.281724:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd8829ed500) 00010000:00010000:1.0:1789263764.281741:0:6472:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2000/0xce1582440fb1e441 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.281750:0:6472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2000/0xce1582440fb1e441 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.281757:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2000/0xce1582440fb1e441 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.281785:0:6472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789263764.281819:0:6489:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2000/0xce1582440fb1e441 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.281830:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2000/0xce1582440fb1e441 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263764.281833:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaa6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+42:2398:x1876178888625792:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 178us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263764.281856:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 82 00000004:00200000:3.0:1789263764.281863:0:6489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789263764.282026:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1e43a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f01 expref: 43 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.282053:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2000/0xce1582440fb1e441 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f01 expref: 42 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.282059:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd8829ed500) 00010000:00010000:3.0:1789263764.282062:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789263764.282064:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd8841a2000, rc 0) 00000100:00100000:3.0:1789263764.282121:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaa4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+42:12239:x1876178888625664:12345-192.168.203.20@tcp:101:dd.0 Request processed in 3468us (3609us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1789263764.282126:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 166 00000100:00100000:3.0:1789263764.283493:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263764.283559:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888625920 00000100:00100000:1.0:1789263764.283567:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888625920 00000100:00100000:1.0:1789263764.283623:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 167 00000100:00100000:1.0:1789263764.283637:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaa4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+42:12239:x1876178888625920:12345-192.168.203.20@tcp:101:dd.0 00010000:00010000:1.0:1789263764.283659:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263764.283676:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1e44f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11f08 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.283708:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2800/0xce1582440fb1e456 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.283721:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2800/0xce1582440fb1e456 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.283741:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2800/0xce1582440fb1e456 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.283858:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1e44f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f08 expref: 44 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.283883:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2800/0xce1582440fb1e456 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f08 expref: 43 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.283891:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd8829ed500) 00010000:00010000:1.0:1789263764.283894:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789263764.283897:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd8841a2800, rc 0) 00000100:00100000:1.0:1789263764.283957:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaa4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+43:12239:x1876178888625920:12345-192.168.203.20@tcp:101:dd.0 Request processed in 326us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263764.283970:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 167 00000100:00100000:2.0:1789263764.285307:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263764.285363:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888626176 00000100:00100000:1.0:1789263764.285371:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888626176 00000100:00100000:1.0:1789263764.285427:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 168 00000100:00100000:1.0:1789263764.285437:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+43:12239:x1876178888626176:12345-192.168.203.20@tcp:36:dd.0 00010000:00010000:1.0:1789263764.285640:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3800/0xce1582440fb1e45d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.285654:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3800/0xce1582440fb1e45d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.285664:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3800/0xce1582440fb1e45d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789263764.285725:0:8417:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967435 00000004:00010000:1.0:1789263764.285760:0:8417:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001bb4c847 reply state 00000000cdfc701b transno 4294967436 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3800/0xce1582440fb1e45d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.285773:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3800/0xce1582440fb1e45d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.285779:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd8829ed500) 00010000:00010000:1.0:1789263764.285781:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789263764.285784:0:8417:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789263764.285858:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+46:12239:x1876178888626176:12345-192.168.203.20@tcp:36:dd.0 Request processed in 422us (555us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1789263764.285864:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 168 00000020:00080000:1.0:1789263764.285867:0:8417:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789263764.388905:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263764.388958:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888626304 00000100:00100000:3.0:1789263764.388969:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888626304 00000100:00100000:3.0:1789263764.389026:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 169 00000100:00100000:3.0:1789263764.389038:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88396aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+46:12253:x1876178888626304:12345-192.168.203.20@tcp:101:stat.0 00010000:00010000:3.0:1789263764.389062:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263764.389113:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433800/0xce1582440fb1e464 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11f0f expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.389167:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432200/0xce1582440fb1e46b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.389178:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432200/0xce1582440fb1e46b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.389187:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432200/0xce1582440fb1e46b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.389209:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1e472 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.389214:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1e472 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.389218:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1e472 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.389274:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e479 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.389284:0:6489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2000/0xce1582440fb1e441 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f01 expref: 47 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.389292:0:6489:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e479 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.389325:0:6489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2000/0xce1582440fb1e441 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f01 expref: 47 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.389338:0:6489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2000/0xce1582440fb1e441 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f01 expref: 47 pid: 6489 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263764.389350:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa7800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6489:1876178898092288:192.168.203.20@tcp:104: 00000100:00100000:3.0:1789263764.389458:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd983a4f240 going to sleep for 11 seconds 00000100:00100000:1.0:1789263764.390312:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa7800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6489:1876178898092288:192.168.203.20@tcp:104: 00010000:00010000:1.0:1789263764.390341:0:6489:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e479 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263764.390784:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263764.390831:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888626560 00000100:00100000:3.0:1789263764.390895:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888626560 00000100:00100000:3.0:1789263764.390930:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 39 00000100:00100000:3.0:1789263764.390947:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883969f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+48:6621:x1876178888626560:12345-192.168.203.20@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789263764.391197:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883969f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+49:6621:x1876178888626560:12345-192.168.203.20@tcp:35:ldlm_bl.0 Request processed in 251us (413us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1789263764.391206:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 39 00000100:00100000:3.0:1789263764.392930:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263764.392990:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888626688 00000100:00100000:1.0:1789263764.392997:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888626688 00010000:00010000:1.0:1789263764.393029:0:6473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2000/0xce1582440fb1e441 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f01 expref: 49 pid: 6489 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263764.393141:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 83 00000100:00100000:1.0:1789263764.393148:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaa4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+49:2397:x1876178888626688:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789263764.393158:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789263764.393164:0:6473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2000/0xce1582440fb1e441 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f01 expref: 49 pid: 6489 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.393175:0:6473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2000/0xce1582440fb1e441 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f01 expref: 49 pid: 6489 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.393193:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2000/0xce1582440fb1e441 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f01 expref: 49 pid: 6489 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.393209:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd8829ed500) 00010000:00010000:1.0:1789263764.393214:0:6473:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e479 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.393223:0:6473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e479 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.393230:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e479 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.393268:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789263764.393292:0:6489:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e479 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.393302:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e479 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263764.393309:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaa4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+48:2397:x1876178888626688:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 160us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263764.393316:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 83 00000004:00200000:3.0:1789263764.393344:0:6489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789263764.393349:0:6489:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789263764.393369:0:6489:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e479 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.393382:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e479 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.393390:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432200/0xce1582440fb1e46b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.393395:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432200/0xce1582440fb1e46b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.393400:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432200/0xce1582440fb1e46b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.393404:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd990432200 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263764.393407:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432200/0xce1582440fb1e46b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.393421:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432200/0xce1582440fb1e46b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.393428:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dd8829edc00) 00010000:00010000:3.0:1789263764.393430:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789263764.393433:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432200/0xce1582440fb1e46b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.393436:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432200/0xce1582440fb1e46b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.393443:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1e472 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.393447:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1e472 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.393451:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1e472 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.393454:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd990433600 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263764.393455:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1e472 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.393458:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1e472 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.393462:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9dd8829ed900) 00010000:00010000:3.0:1789263764.393464:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789263764.393465:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1e472 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.393474:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1e472 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.393531:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433800/0xce1582440fb1e464 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f0f expref: 48 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.393540:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e479 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f0f expref: 47 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.393545:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd8829ed500) 00010000:00010000:3.0:1789263764.393546:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789263764.393548:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd990433200, rc 0) 00000100:00100000:3.0:1789263764.393576:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88396aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+47:12253:x1876178888626304:12345-192.168.203.20@tcp:101:stat.0 Request processed in 4543us (4682us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263764.393587:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 169 00000100:00100000:3.0:1789263764.418061:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263764.418147:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888626944 00000100:00100000:1.0:1789263764.418161:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888626944 00000100:00100000:1.0:1789263764.418232:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 170 00000100:00100000:1.0:1789263764.418246:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaa5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+47:12259:x1876178888626944:12345-192.168.203.20@tcp:36:truncate.0 00010000:00010000:1.0:1789263764.418346:0:6488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789263764.418379:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e479 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f0f expref: 47 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.418404:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd8829ed500) 00010000:00010000:1.0:1789263764.418409:0:6488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789263764.418619:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2000/0xce1582440fb1e480 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.418636:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2000/0xce1582440fb1e480 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.418652:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2000/0xce1582440fb1e480 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789263764.418699:0:6488:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967438 00000004:00010000:1.0:1789263764.418721:0:6488:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d01ce049 reply state 00000000f705c73f transno 4294967439 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2000/0xce1582440fb1e480 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.418747:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2000/0xce1582440fb1e480 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.418763:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd8829ed500) 00010000:00010000:1.0:1789263764.418766:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789263764.418769:0:6488:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789263764.418882:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaa5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+49:12259:x1876178888626944:12345-192.168.203.20@tcp:36:truncate.0 Request processed in 638us (832us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1789263764.418889:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 170 00000020:00080000:1.0:1789263764.418895:0:6488:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789263764.477746:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263764.477813:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888627072 00000100:00100000:1.0:1789263764.477823:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888627072 00000100:00100000:1.0:1789263764.477885:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 171 00000100:00100000:1.0:1789263764.477895:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+49:12273:x1876178888627072:12345-192.168.203.20@tcp:101:stat.0 00010000:00010000:1.0:1789263764.477919:0:8417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263764.477938:0:8417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1e487 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11f16 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.477992:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e48e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.478005:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e48e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.478017:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e48e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.478025:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2c00/0xce1582440fb1e495 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.478030:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2c00/0xce1582440fb1e495 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.478052:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2c00/0xce1582440fb1e495 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.478130:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2200/0xce1582440fb1e49c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.478136:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2200/0xce1582440fb1e49c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.478140:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2200/0xce1582440fb1e49c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789263764.478170:0:8417:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:1.0:1789263764.478173:0:8417:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789263764.478198:0:8417:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2200/0xce1582440fb1e49c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.478209:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2200/0xce1582440fb1e49c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.478217:0:8417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e48e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.478229:0:8417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e48e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.478236:0:8417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e48e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.478242:0:8417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd8841a2a00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263764.478246:0:8417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e48e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.478257:0:8417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e48e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.478266:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dd8829edc00) 00010000:00010000:1.0:1789263764.478268:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263764.478271:0:8417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e48e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.478275:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e48e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.478284:0:8417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2c00/0xce1582440fb1e495 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.478288:0:8417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2c00/0xce1582440fb1e495 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.478291:0:8417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2c00/0xce1582440fb1e495 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.478296:0:8417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd8841a2c00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263764.478299:0:8417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2c00/0xce1582440fb1e495 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.478305:0:8417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2c00/0xce1582440fb1e495 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.478312:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9dd8829ed900) 00010000:00010000:1.0:1789263764.478314:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263764.478317:0:8417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2c00/0xce1582440fb1e495 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.478332:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2c00/0xce1582440fb1e495 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.478361:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1e487 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f16 expref: 51 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.478374:0:8417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2200/0xce1582440fb1e49c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f16 expref: 50 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.478381:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd8829ed500) 00010000:00010000:1.0:1789263764.478383:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789263764.478385:0:8417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd8841a2200, rc 0) 00000100:00100000:1.0:1789263764.478448:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+50:12273:x1876178888627072:12345-192.168.203.20@tcp:101:stat.0 Request processed in 553us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263764.478455:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 171 00000100:00100000:2.0:1789263764.533717:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263764.533778:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888627328 00000100:00100000:3.0:1789263764.533789:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888627328 00000100:00100000:3.0:1789263764.533848:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 172 00000100:00100000:3.0:1789263764.533859:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+50:12289:x1876178888627328:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:3.0:1789263764.533879:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263764.533898:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433800/0xce1582440fb1e4a3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11f1d expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.533996:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1e4aa lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.534026:0:6489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2200/0xce1582440fb1e49c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f16 expref: 51 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.534035:0:6489:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1e4aa lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.534069:0:6489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2200/0xce1582440fb1e49c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f16 expref: 51 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.534111:0:6489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2200/0xce1582440fb1e49c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f16 expref: 51 pid: 8417 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263764.534123:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6489:1876178898092416:192.168.203.20@tcp:104: 00000100:00100000:3.0:1789263764.534224:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd983a4f240 going to sleep for 11 seconds 00000100:00100000:1.0:1789263764.536866:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6489:1876178898092416:192.168.203.20@tcp:104: 00010000:00010000:1.0:1789263764.536891:0:6489:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1e4aa lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263764.537364:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263764.537475:0:7428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888627456 00000100:00100000:1.0:1789263764.537482:0:7428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888627456 00010000:00010000:1.0:1789263764.537513:0:7428:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2200/0xce1582440fb1e49c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f16 expref: 52 pid: 8417 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263764.537548:0:7428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 84 00000100:00100000:1.0:1789263764.537566:0:7428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+52:2398:x1876178888627456:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789263764.537594:0:7428:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789263764.537601:0:7428:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2200/0xce1582440fb1e49c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f16 expref: 52 pid: 8417 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.537614:0:7428:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2200/0xce1582440fb1e49c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f16 expref: 52 pid: 8417 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.537635:0:7428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2200/0xce1582440fb1e49c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f16 expref: 52 pid: 8417 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.537651:0:7428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd8829ed500) 00010000:00010000:1.0:1789263764.537655:0:7428:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1e4aa lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.537664:0:7428:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1e4aa lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.537671:0:7428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1e4aa lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.537694:0:7428:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789263764.537762:0:7428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+51:2398:x1876178888627456:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 205us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263764.537771:0:7428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 84 00010000:00010000:3.0:1789263764.537789:0:6489:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1e4aa lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.537800:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1e4aa lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789263764.537822:0:6489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:3.0:1789263764.537983:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433800/0xce1582440fb1e4a3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f1d expref: 52 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.537998:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1e4aa lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f1d expref: 51 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.538003:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd8829ed500) 00010000:00010000:3.0:1789263764.538010:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789263764.538013:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd990433600, rc 0) 00000100:00100000:3.0:1789263764.538046:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+51:12289:x1876178888627328:12345-192.168.203.20@tcp:101:bash.0 Request processed in 4190us (4337us total) trans 4294967440 rc 0/0 00000100:00100000:3.0:1789263764.538054:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 172 00000100:00100000:2.0:1789263764.539105:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263764.539140:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888627712 00000100:00100000:1.0:1789263764.539146:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888627712 00000100:00100000:1.0:1789263764.539189:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 173 00000100:00100000:1.0:1789263764.539198:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+51:12289:x1876178888627712:12345-192.168.203.20@tcp:36:bash.0 00010000:00010000:1.0:1789263764.539364:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1e4b8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.539374:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1e4b8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.539380:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1e4b8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789263764.539416:0:6488:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967441 00000004:00010000:1.0:1789263764.539435:0:6488:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005f858b6d reply state 00000000eba18686 transno 4294967442 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1e4b8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.539446:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1e4b8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.539453:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd8829ed500) 00010000:00010000:1.0:1789263764.539455:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789263764.539458:0:6488:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789263764.539514:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+54:12289:x1876178888627712:12345-192.168.203.20@tcp:36:bash.0 Request processed in 317us (437us total) trans 4294967442 rc 0/0 00000100:00100000:1.0:1789263764.539521:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 173 00000020:00080000:1.0:1789263764.539524:0:6488:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789263764.542151:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263764.542207:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888627840 00000100:00100000:1.0:1789263764.542214:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888627840 00000100:00100000:1.0:1789263764.542250:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 174 00000100:00100000:1.0:1789263764.542258:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8840b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+54:12289:x1876178888627840:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:1.0:1789263764.542284:0:8417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263764.542299:0:8417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2c00/0xce1582440fb1e4bf lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11f24 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.542392:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e4c6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.542406:0:8417:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1e4aa lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f1d expref: 55 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.542415:0:8417:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e4c6 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.542445:0:8417:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1e4aa lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f1d expref: 55 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.542458:0:8417:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1e4aa lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f1d expref: 55 pid: 6489 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263764.542472:0:8417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7e300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8417:1876178898092544:192.168.203.20@tcp:104: 00000100:00100000:1.0:1789263764.542542:0:8417:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9872a5840 going to sleep for 11 seconds 00000100:00100000:1.0:1789263764.543489:0:8417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7e300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8417:1876178898092544:192.168.203.20@tcp:104: 00010000:00010000:1.0:1789263764.543507:0:8417:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e4c6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263764.543671:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263764.543718:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888627968 00000100:00100000:2.0:1789263764.543724:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888627968 00010000:00010000:2.0:1789263764.543761:0:8409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1e4aa lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f1d expref: 56 pid: 6489 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263764.543798:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 85 00000100:00100000:2.0:1789263764.543808:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8840b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+56:2397:x1876178888627968:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789263764.543819:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789263764.543826:0:8409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1e4aa lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f1d expref: 56 pid: 6489 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263764.543838:0:8409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1e4aa lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f1d expref: 56 pid: 6489 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263764.543856:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1e4aa lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f1d expref: 56 pid: 6489 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263764.543877:0:8409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd8829ed500) 00010000:00010000:2.0:1789263764.543882:0:8409:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e4c6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263764.543890:0:8409:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e4c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263764.543898:0:8409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e4c6 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263764.543916:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789263764.543934:0:8417:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e4c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.543941:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e4c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263764.543953:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8840b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+55:2397:x1876178888627968:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 146us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263764.543971:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 85 00000004:00200000:1.0:1789263764.543982:0:8417:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789263764.543994:0:8417:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789263764.544014:0:8417:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e4c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.544044:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2c00/0xce1582440fb1e4bf lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f24 expref: 55 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.544060:0:8417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e4c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f24 expref: 54 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.544068:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd8829ed500) 00010000:00010000:1.0:1789263764.544071:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789263764.544073:0:8417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd8841a2a00, rc 0) 00000100:00100000:1.0:1789263764.544123:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8840b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+54:12289:x1876178888627840:12345-192.168.203.20@tcp:101:bash.0 Request processed in 1866us (1978us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263764.544131:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 174 00000100:00100000:0.0:1789263764.545215:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263764.545254:0:14127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888628224 00000100:00100000:1.0:1789263764.545259:0:14127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888628224 00000100:00100000:1.0:1789263764.545298:0:14127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 40 00000100:00100000:1.0:1789263764.545307:0:14127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8840b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+54:12289:x1876178888628224:12345-192.168.203.20@tcp:35:bash.0 00000100:00100000:1.0:1789263764.545463:0:14127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8840b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+55:12289:x1876178888628224:12345-192.168.203.20@tcp:35:bash.0 Request processed in 157us (249us total) trans 4294967443 rc 0/0 00000100:00100000:1.0:1789263764.545468:0:14127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 40 00000100:00100000:2.0:1789263764.576160:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263764.576217:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888628352 00000100:00100000:3.0:1789263764.576227:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888628352 00000100:00100000:3.0:1789263764.576284:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 175 00000100:00100000:3.0:1789263764.576296:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+55:12299:x1876178888628352:12345-192.168.203.20@tcp:34:lfs.0 00010000:00010000:3.0:1789263764.576369:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433800/0xce1582440fb1e4cd lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.576386:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433800/0xce1582440fb1e4cd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.576397:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433800/0xce1582440fb1e4cd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.576409:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432200/0xce1582440fb1e4d4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.576417:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432200/0xce1582440fb1e4d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.576424:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432200/0xce1582440fb1e4d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.576497:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1e4db lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.576506:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1e4db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.576528:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1e4db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789263764.576574:0:6489:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1e4db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.576588:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433800/0xce1582440fb1e4cd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.576595:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433800/0xce1582440fb1e4cd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.576601:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433800/0xce1582440fb1e4cd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.576607:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd990433800 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263764.576610:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433800/0xce1582440fb1e4cd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.576618:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433800/0xce1582440fb1e4cd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.576630:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dd8829edc00) 00010000:00010000:3.0:1789263764.576634:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789263764.576638:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433800/0xce1582440fb1e4cd lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.576645:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433800/0xce1582440fb1e4cd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.576658:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432200/0xce1582440fb1e4d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.576670:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432200/0xce1582440fb1e4d4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.576676:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432200/0xce1582440fb1e4d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.576682:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd990432200 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263764.576685:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432200/0xce1582440fb1e4d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.576691:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432200/0xce1582440fb1e4d4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.576699:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9dd8829ed900) 00010000:00010000:3.0:1789263764.576702:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789263764.576705:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432200/0xce1582440fb1e4d4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.576710:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432200/0xce1582440fb1e4d4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.576721:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1e4db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.576741:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1e4db lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.576748:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1e4db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.576753:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd990433600 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263764.576763:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1e4db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.576770:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1e4db lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.576778:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd8829ed500) 00010000:00010000:3.0:1789263764.576780:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789263764.576783:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1e4db lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.576788:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1e4db lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263764.576858:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+55:12299:x1876178888628352:12345-192.168.203.20@tcp:34:lfs.0 Request processed in 564us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263764.576866:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 175 00000100:00100000:0.0:1789263764.595480:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263764.595579:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888628608 00000100:00100000:1.0:1789263764.595589:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888628608 00000100:00100000:1.0:1789263764.595663:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 176 00000100:00100000:1.0:1789263764.595672:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+55:12302:x1876178888628608:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:1.0:1789263764.595689:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263764.595718:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2c00/0xce1582440fb1e4e2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11f2b expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.595796:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2200/0xce1582440fb1e4e9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.595808:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2200/0xce1582440fb1e4e9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.595819:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2200/0xce1582440fb1e4e9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.595829:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1e4f0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.595836:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1e4f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.595843:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1e4f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.595947:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2400/0xce1582440fb1e4f7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.595956:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2400/0xce1582440fb1e4f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.595964:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2400/0xce1582440fb1e4f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789263764.595973:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1789263764.596049:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2200/0xce1582440fb1e4e9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.596068:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2200/0xce1582440fb1e4e9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.596105:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2200/0xce1582440fb1e4e9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.596113:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd8841a2200 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263764.596117:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2200/0xce1582440fb1e4e9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.596125:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2200/0xce1582440fb1e4e9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.596137:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dd8829edc00) 00010000:00010000:1.0:1789263764.596141:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263764.596145:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2200/0xce1582440fb1e4e9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.596151:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2200/0xce1582440fb1e4e9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.596173:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1e4f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.596180:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1e4f0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.596184:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1e4f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.596188:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd8841a2e00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263764.596198:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1e4f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.596204:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1e4f0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.596212:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9dd8829ed900) 00010000:00010000:1.0:1789263764.596215:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263764.596217:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1e4f0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.596222:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1e4f0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.596257:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2c00/0xce1582440fb1e4e2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f2b expref: 58 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.596270:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2400/0xce1582440fb1e4f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f2b expref: 57 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.596277:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd8829ed500) 00010000:00010000:1.0:1789263764.596279:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789263764.596282:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd8841a2400, rc 0) 00000100:00100000:1.0:1789263764.596341:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+57:12302:x1876178888628608:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 669us (869us total) trans 4294967444 rc 0/0 00000100:00100000:1.0:1789263764.596347:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 176 00000100:00100000:0.0:1789263764.597837:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263764.597914:0:10303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888628736 00000100:00100000:2.0:1789263764.597924:0:10303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888628736 00000100:00100000:0.0:1789263764.597925:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263764.597983:0:10303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 11 00000100:00100000:1.0:1789263764.597994:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888628864 00000100:00100000:2.0:1789263764.597996:0:10303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd991530050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3ce90ea2-917f-4b54-98b0-25e051f2317f+57:2398:x1876178888628736:12345-192.168.203.20@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1789263764.598002:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888628864 00010000:00010000:2.0:1789263764.598012:0:10303:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789263764.598032:0:10303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2400/0xce1582440fb1e4f7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f2b expref: 58 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263764.598050:0:10303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd8829ed500) 00010000:00010000:2.0:1789263764.598054:0:10303:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789263764.598060:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 177 00000100:00100000:1.0:1789263764.598070:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882610e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+57:12302:x1876178888628864:12345-192.168.203.20@tcp:54:lfs.0 00000100:00100000:2.0:1789263764.598130:0:10303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd991530050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3ce90ea2-917f-4b54-98b0-25e051f2317f+57:2398:x1876178888628736:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 135us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263764.598139:0:10303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 11 00010000:00010000:1.0:1789263764.598154:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59e00/0xce1582440fb1e505 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.598168:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59e00/0xce1582440fb1e505 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.598178:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59e00/0xce1582440fb1e505 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.598205:0:8417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59e00/0xce1582440fb1e505 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.598212:0:8417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59e00/0xce1582440fb1e505 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.598216:0:8417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59e00/0xce1582440fb1e505 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.598220:0:8417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883f59e00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263764.598223:0:8417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59e00/0xce1582440fb1e505 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.598227:0:8417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59e00/0xce1582440fb1e505 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.598234:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd8829ed500) 00010000:00010000:1.0:1789263764.598237:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789263764.598239:0:8417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59e00/0xce1582440fb1e505 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.598243:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59e00/0xce1582440fb1e505 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263764.598287:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882610e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+56:12302:x1876178888628864:12345-192.168.203.20@tcp:54:lfs.0 Request processed in 219us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263764.598294:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 177 00000100:00100000:0.0:1789263764.599153:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263764.599282:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888629120 00000100:00100000:3.0:1789263764.599288:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888629120 00000100:00100000:3.0:1789263764.599332:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 41 00000100:00100000:3.0:1789263764.599340:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882613b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+56:12302:x1876178888629120:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:3.0:1789263764.599490:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882613b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+57:12302:x1876178888629120:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 150us (338us total) trans 4294967445 rc 0/0 00000100:00100000:3.0:1789263764.599498:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 41 00000100:00100000:2.0:1789263764.656422:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263764.656480:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888629376 00000100:00100000:3.0:1789263764.656491:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888629376 00000100:00100000:3.0:1789263764.656547:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 178 00000100:00100000:3.0:1789263764.656556:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+57:12320:x1876178888629376:12345-192.168.203.20@tcp:101:cat.0 00010000:00010000:3.0:1789263764.656576:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263764.656609:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1e50c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11f32 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.656707:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432200/0xce1582440fb1e513 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.656721:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432200/0xce1582440fb1e513 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.656744:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432200/0xce1582440fb1e513 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789263764.656754:0:6489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789263764.656856:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1e50c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f32 expref: 60 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.656876:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432200/0xce1582440fb1e513 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f32 expref: 59 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.656885:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd8829ed500) 00010000:00010000:3.0:1789263764.656888:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789263764.656892:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd990432200, rc 0) 00000100:00100000:3.0:1789263764.656948:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+59:12320:x1876178888629376:12345-192.168.203.20@tcp:101:cat.0 Request processed in 392us (535us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1789263764.656956:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 178 00000100:00100000:0.0:1789263764.668636:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263764.668746:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888629504 00000100:00100000:1.0:1789263764.668760:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888629504 00000100:00100000:1.0:1789263764.668828:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 179 00000100:00100000:1.0:1789263764.668838:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882610000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+59:12321:x1876178888629504:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:1.0:1789263764.668863:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263764.668881:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59e00/0xce1582440fb1e521 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11f39 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.668940:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58400/0xce1582440fb1e528 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.668953:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58400/0xce1582440fb1e528 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.668965:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58400/0xce1582440fb1e528 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789263764.669005:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1789263764.669009:0:6488:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789263764.669027:0:6488:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58400/0xce1582440fb1e528 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.669046:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59e00/0xce1582440fb1e521 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f39 expref: 61 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.669059:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58400/0xce1582440fb1e528 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f39 expref: 60 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.669121:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dd8829edc00) 00010000:00010000:1.0:1789263764.669124:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789263764.669128:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd883f58400, rc 0) 00000100:00100000:1.0:1789263764.669189:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882610000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+60:12321:x1876178888629504:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 351us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263764.669196:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 179 00000100:00100000:0.0:1789263764.672736:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263764.672829:0:14127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888629888 00000100:00100000:1.0:1789263764.672838:0:14127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888629888 00000100:00100000:1.0:1789263764.672892:0:14127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 42 00000100:00100000:1.0:1789263764.672902:0:14127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882610700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+60:12321:x1876178888629888:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:1.0:1789263764.673194:0:14127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882610700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+61:12321:x1876178888629888:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 291us (473us total) trans 4294967447 rc 0/0 00000100:00100000:1.0:1789263764.673201:0:14127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 42 00000100:00100000:2.0:1789263764.674829:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263764.674986:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888630016 00000100:00100000:3.0:1789263764.675003:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888630016 00000100:00100000:3.0:1789263764.675119:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 12 00000100:00100000:3.0:1789263764.675132:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e34380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+61:12321:x1876178888630016:12345-192.168.203.20@tcp:103:lfs.0 00010000:00010000:3.0:1789263764.675173:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789263764.675203:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1e4c6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f24 expref: 61 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.675228:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432200/0xce1582440fb1e513 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f32 expref: 60 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.675241:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3200/0xce1582440fb1e3ca lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ee5 expref: 59 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.675252:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd8829ed500) 00010000:00010000:3.0:1789263764.675258:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789263764.675325:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e34380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+58:12321:x1876178888630016:12345-192.168.203.20@tcp:103:lfs.0 Request processed in 197us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263764.675331:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 12 00000100:00100000:0.0:1789263764.676599:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263764.676662:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888630144 00000100:00100000:1.0:1789263764.676670:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888630144 00000100:00100000:1.0:1789263764.676742:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 180 00000100:00100000:1.0:1789263764.676751:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882610a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+58:12321:x1876178888630144:12345-192.168.203.20@tcp:58:lfs.0 00010000:00010000:1.0:1789263764.676853:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59e00/0xce1582440fb1e52f lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.676871:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59e00/0xce1582440fb1e52f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263764.676882:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59e00/0xce1582440fb1e52f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789263764.676980:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:1.0:1789263764.677050:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882610a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+58:12321:x1876178888630144:12345-192.168.203.20@tcp:58:lfs.0 Request processed in 299us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263764.677059:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 180 00000100:00100000:0.0:1789263764.686766:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263764.686857:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888630272 00000100:00100000:3.0:1789263764.686868:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888630272 00000100:00100000:3.0:1789263764.686919:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 181 00000100:00100000:3.0:1789263764.686928:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882611500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+58:12323:x1876178888630272:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:3.0:1789263764.686949:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263764.686969:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432200/0xce1582440fb1e536 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11f40 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.687027:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1e53d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.687041:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1e53d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.687063:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1e53d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.687071:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433800/0xce1582440fb1e544 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.687095:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433800/0xce1582440fb1e544 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.687100:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433800/0xce1582440fb1e544 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.687183:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e54b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.687197:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e54b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.687204:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e54b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789263764.687246:0:6489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789263764.687250:0:6489:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789263764.687267:0:6489:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e54b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.687276:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e54b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.687281:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1e53d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.687293:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1e53d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.687297:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1e53d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.687301:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd990433600 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263764.687305:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1e53d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.687311:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1e53d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.687324:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dd8829edc00) 00010000:00010000:3.0:1789263764.687327:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789263764.687332:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1e53d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.687336:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1e53d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.687348:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433800/0xce1582440fb1e544 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.687351:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433800/0xce1582440fb1e544 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.687355:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433800/0xce1582440fb1e544 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.687358:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd990433800 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263764.687364:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433800/0xce1582440fb1e544 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.687369:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433800/0xce1582440fb1e544 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.687374:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9dd8829ed900) 00010000:00010000:3.0:1789263764.687375:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789263764.687377:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433800/0xce1582440fb1e544 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.687380:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433800/0xce1582440fb1e544 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.687398:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432200/0xce1582440fb1e536 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f40 expref: 60 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.687408:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e54b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f40 expref: 59 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263764.687413:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd8829ed500) 00010000:00010000:3.0:1789263764.687414:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789263764.687416:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd990433200, rc 0) 00000100:00100000:3.0:1789263764.687460:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882611500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+59:12323:x1876178888630272:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 535us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263764.687465:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 181 00010000:00010000:1.0:1789263764.909337:0:13689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789263765.007483:0:14661:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789263765.007492:0:14661:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789263765.007529:0:14661:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1789263765.007536:0:14661:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1789263765.293286:0:13757:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789263765.293295:0:13757:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789263765.293340:0:13757:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1789263765.293348:0:13757:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789263765.293484:0:13757:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa9c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13757:1876178898092672:192.168.203.20@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789263765.293601:0:13757:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9bf982780 going to sleep for 11 seconds 00000100:00100000:1.0:1789263765.295142:0:13757:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa9c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13757:1876178898092672:192.168.203.20@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789263765.295913:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263765.295974:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888630400 00000100:00100000:1.0:1789263765.295982:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888630400 00000100:00080000:0.0:1789263765.296044:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789263765.296053:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 182 00000100:00100000:1.0:1789263765.296066:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+59:12335:x1876178888630400:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789263765.296130:0:6488:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789263765.296232:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+59:12335:x1876178888630400:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 Request processed in 168us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263765.296240:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 182 00000100:00100000:0.0:1789263765.298660:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263765.298717:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888630528 00000100:00100000:1.0:1789263765.298734:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888630528 00000100:00100000:1.0:1789263765.298784:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 183 00000100:00100000:1.0:1789263765.298794:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+59:12335:x1876178888630528:12345-192.168.203.20@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789263765.298854:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1e552 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.298870:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1e552 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.298879:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1e552 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.298946:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1e559 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.298954:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1e559 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.298961:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1e559 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.298993:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1e560 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.299002:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1e560 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.299009:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1e560 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789263765.299061:0:8417:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789263765.299065:0:8417:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789263765.299103:0:8417:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1e560 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.299115:0:8417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1e552 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.299121:0:8417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1e552 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.299128:0:8417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1e552 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.299143:0:8417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883f59000 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263765.299148:0:8417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1e552 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.299155:0:8417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1e552 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.299166:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9dd8829ed700) 00010000:00010000:1.0:1789263765.299169:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263765.299173:0:8417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1e552 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.299187:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1e552 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.299201:0:8417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1e559 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.299207:0:8417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1e559 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.299213:0:8417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1e559 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.299218:0:8417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883f58800 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263765.299221:0:8417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1e559 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.299226:0:8417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1e559 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.299244:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff9dd8829ed000) 00010000:00010000:1.0:1789263765.299246:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263765.299249:0:8417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1e559 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.299255:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1e559 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.299269:0:8417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1e560 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.299275:0:8417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1e560 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.299281:0:8417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1e560 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.299298:0:8417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883f59800 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263765.299301:0:8417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1e560 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.299306:0:8417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1e560 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.299313:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd8829ed500) 00010000:00010000:1.0:1789263765.299316:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263765.299319:0:8417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1e560 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.299324:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1e560 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263765.299403:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+59:12335:x1876178888630528:12345-192.168.203.20@tcp:34:lhsmtool_posix.0 Request processed in 610us (750us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263765.299410:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 183 00000100:00100000:2.0:1789263765.300875:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263765.300932:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888630784 00000100:00100000:3.0:1789263765.300941:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888630784 00000100:00100000:3.0:1789263765.300988:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 184 00000100:00100000:3.0:1789263765.300996:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+59:12335:x1876178888630784:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789263765.301030:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263765.301048:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432200/0xce1582440fb1e567 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11f47 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263765.301157:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433800/0xce1582440fb1e56e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263765.301169:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433800/0xce1582440fb1e56e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263765.301176:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433800/0xce1582440fb1e56e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789263765.301184:0:6489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789263765.301252:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433800/0xce1582440fb1e56e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263765.301260:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433800/0xce1582440fb1e56e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263765.301266:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433800/0xce1582440fb1e56e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263765.301272:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd990433800 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263765.301276:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433800/0xce1582440fb1e56e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263765.301282:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433800/0xce1582440fb1e56e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263765.301293:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd8829ed500) 00010000:00010000:3.0:1789263765.301301:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789263765.301306:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433800/0xce1582440fb1e56e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263765.301310:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433800/0xce1582440fb1e56e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263765.301341:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432200/0xce1582440fb1e567 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f47 expref: 61 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263765.301347:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9dd8829ed700) 00010000:00010000:3.0:1789263765.301349:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789263765.301351:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432200/0xce1582440fb1e567 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f47 expref: 61 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263765.301358:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd990432200, rc 0) 00000100:00100000:3.0:1789263765.301424:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+60:12335:x1876178888630784:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 427us (553us total) trans 4294967448 rc 301/301 00000100:00100000:3.0:1789263765.301432:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 184 00000100:00100000:0.0:1789263765.302807:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263765.302851:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888630912 00000100:00100000:1.0:1789263765.302859:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888630912 00000100:00100000:1.0:1789263765.302902:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 185 00000100:00100000:1.0:1789263765.302909:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+60:12335:x1876178888630912:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789263765.302931:0:6488:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789263765.303014:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+60:12335:x1876178888630912:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 Request processed in 104us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263765.303020:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 185 00000100:00100000:0.0:1789263765.304578:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263765.304648:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888631168 00000100:00100000:1.0:1789263765.304656:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888631168 00000100:00100000:1.0:1789263765.304716:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 186 00000100:00100000:1.0:1789263765.304738:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+60:12335:x1876178888631168:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789263765.304755:0:8417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263765.304759:0:8417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789263765.304784:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58400/0xce1582440fb1e528 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f39 expref: 60 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.304803:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dd8829edc00) 00010000:00010000:1.0:1789263765.304807:0:8417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789263765.304820:0:8417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58000/0xce1582440fb1e57c lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11f4e expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789263765.305295:0:8417:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:1.0:1789263765.305436:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1e583 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.305449:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1e583 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.305458:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1e583 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.305505:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58000/0xce1582440fb1e57c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f4e expref: 62 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.305514:0:8417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1e583 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f4e expref: 61 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.305519:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9dd8829ed000) 00010000:00010000:1.0:1789263765.305521:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789263765.305523:0:8417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd883f59800, rc 0) 00000100:00100000:1.0:1789263765.305621:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+61:12335:x1876178888631168:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 896us (1048us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1789263765.305628:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 186 00000100:00100000:2.0:1789263765.307501:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263765.307546:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888631424 00000100:00100000:3.0:1789263765.307555:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888631424 00000100:00100000:3.0:1789263765.307597:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 187 00000100:00100000:3.0:1789263765.307604:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+61:12335:x1876178888631424:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789263765.307650:0:6489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789263765.307671:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1e583 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f4e expref: 61 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263765.307688:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9dd8829ed000) 00010000:00010000:3.0:1789263765.307709:0:6489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789263765.307735:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1e591 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263765.307748:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1e591 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263765.307758:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1e591 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263765.307771:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530800/0xce1582440fb1e598 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xc80572e6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263765.307778:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530800/0xce1582440fb1e598 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xc80572e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263765.307785:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530800/0xce1582440fb1e598 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xc80572e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263765.307819:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1e591 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263765.307824:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1e591 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263765.307831:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1e591 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263765.307837:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd990433600 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263765.307841:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1e591 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263765.307848:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1e591 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263765.307863:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dd8829edc00) 00010000:00010000:3.0:1789263765.307866:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789263765.307870:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1e591 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263765.307877:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433600/0xce1582440fb1e591 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263765.307887:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530800/0xce1582440fb1e598 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xc80572e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263765.307894:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530800/0xce1582440fb1e598 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xc80572e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263765.307899:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530800/0xce1582440fb1e598 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xc80572e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263765.307903:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981530800 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263765.307904:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530800/0xce1582440fb1e598 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xc80572e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263765.307908:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530800/0xce1582440fb1e598 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xc80572e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263765.307913:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xc80572e6 (ffff9dd9bb596900) 00010000:00010000:3.0:1789263765.307915:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789263765.307916:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530800/0xce1582440fb1e598 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xc80572e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263765.307920:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530800/0xce1582440fb1e598 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xc80572e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263765.307993:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+60:12335:x1876178888631424:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 Request processed in 388us (495us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789263765.308000:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 187 00000100:00100000:0.0:1789263765.309567:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263765.309628:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888631552 00000100:00100000:1.0:1789263765.309636:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888631552 00000100:00100000:1.0:1789263765.309678:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 188 00000100:00100000:1.0:1789263765.309687:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+60:12335:x1876178888631552:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789263765.309703:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263765.309742:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1e59f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11f55 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.309771:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1e5a6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.309780:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1e5a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.309787:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1e5a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.309871:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1e59f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f55 expref: 62 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.309882:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1e5a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f55 expref: 61 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.309890:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9dd8829ed800) 00010000:00010000:1.0:1789263765.309893:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789263765.309895:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd883f59000, rc 0) 00000100:00100000:1.0:1789263765.309947:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+61:12335:x1876178888631552:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 262us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263765.309952:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 188 00000100:00100000:0.0:1789263765.312826:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263765.312882:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888631808 00000100:00100000:1.0:1789263765.312892:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888631808 00000100:00100000:1.0:1789263765.312946:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 189 00000100:00100000:1.0:1789263765.312958:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+61:12335:x1876178888631808:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789263765.313034:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1e5ad lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.313060:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1e5ad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.313072:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1e5ad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789263765.313281:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:1.0:1789263765.313291:0:8417:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 207603213361ns, next at 208603211229ns, rc = 0 00000004:00010000:1.0:1789263765.313336:0:8417:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f6b52d12 reply state 0000000079e59e1a transno 4294967450 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1e5ad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.313349:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1e5ad lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.313360:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9dd8829ed800) 00010000:00010000:1.0:1789263765.313363:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1789263765.313366:0:8417:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789263765.313457:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+63:12335:x1876178888631808:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 Request processed in 501us (638us total) trans 4294967450 rc 0/0 00000100:00100000:1.0:1789263765.313465:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 189 00000100:00100000:2.0:1789263765.314734:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263765.314787:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888631936 00000100:00100000:3.0:1789263765.314798:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888631936 00000100:00100000:3.0:1789263765.314849:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 190 00000100:00100000:3.0:1789263765.314857:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+63:12335:x1876178888631936:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789263765.314876:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263765.314891:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1e5b4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11f5c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263765.314936:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1e5b4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f5c expref: 64 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263765.314950:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1e5b4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f5c expref: 64 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263765.314967:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9dd8829ed800) 00010000:00010000:3.0:1789263765.314970:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789263765.314974:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981530200, rc 0) 00000100:00100000:3.0:1789263765.315016:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+64:12335:x1876178888631936:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 160us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263765.315020:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 190 00000100:00100000:0.0:1789263765.316050:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263765.316121:0:8394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888632064 00000100:00100000:3.0:1789263765.316127:0:8394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888632064 00000100:00100000:3.0:1789263765.316211:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 58 00000100:00080000:0.0:1789263765.316218:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789263765.316235:0:8394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9907a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+6:2399:x1876178888632064:12345-192.168.203.20@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1789263765.316415:0:8394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9907a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+7:2399:x1876178888632064:12345-192.168.203.20@tcp:2:lhsmtool_posix.0 Request processed in 183us (368us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1789263765.316423:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 58 00000100:00100000:0.0:1789263765.318177:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263765.318272:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888632320 00000100:00100000:3.0:1789263765.318280:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888632320 00000100:00100000:3.0:1789263765.318321:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 43 00000100:00100000:3.0:1789263765.318329:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd987344c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+64:12335:x1876178888632320:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789263765.318511:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd987344c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+65:12335:x1876178888632320:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 Request processed in 181us (339us total) trans 4294967451 rc 0/0 00000100:00100000:3.0:1789263765.318519:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 43 00000100:00100000:2.0:1789263765.319673:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263765.319736:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888632576 00000100:00100000:1.0:1789263765.319742:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888632576 00000100:00100000:1.0:1789263765.319781:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 191 00000100:00100000:1.0:1789263765.319787:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+65:12335:x1876178888632576:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789263765.319902:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+65:12335:x1876178888632576:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 Request processed in 114us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263765.319910:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 191 00000100:00100000:0.0:1789263765.321352:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263765.321397:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888632704 00000100:00100000:1.0:1789263765.321416:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888632704 00000100:00100000:1.0:1789263765.321456:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 192 00000100:00100000:1.0:1789263765.321466:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9907a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+65:12335:x1876178888632704:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789263765.321480:0:8417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263765.321498:0:8417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1e5bb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11f63 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.321573:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58000/0xce1582440fb1e5c2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.321586:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58000/0xce1582440fb1e5c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.321598:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58000/0xce1582440fb1e5c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789263765.321635:0:8417:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789263765.321654:0:8417:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58000/0xce1582440fb1e5c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.321679:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1e5bb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f63 expref: 67 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.321693:0:8417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58000/0xce1582440fb1e5c2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f63 expref: 66 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.321701:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9dd8829ed800) 00010000:00010000:1.0:1789263765.321704:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789263765.321707:0:8417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd883f58000, rc 0) 00000100:00100000:1.0:1789263765.321764:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9907a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+66:12335:x1876178888632704:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 300us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263765.321777:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 192 00000100:00100000:0.0:1789263765.322899:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263765.322946:0:13766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888632832 00000100:00100000:3.0:1789263765.322953:0:13766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888632832 00000100:00100000:3.0:1789263765.322993:0:13766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 59 00000100:00100000:3.0:1789263765.323002:0:13766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9907a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+7:2398:x1876178888632832:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789263765.323014:0:13766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263765.323028:0:13766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aea88dc7/0xce1582440fb1e5c9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11f6a expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789263765.323055:0:13766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa5ff95, blocks: 0x0 00010000:00010000:3.0:1789263765.323071:0:13766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=207s v=(0 0) 00010000:00010000:3.0:1789263765.323101:0:13766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789263765.323111:0:13766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aea88dc7/0xce1582440fb1e5c9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f6a expref: 8 pid: 13766 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263765.323141:0:13766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000aea88dc7/0xce1582440fb1e5c9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f6a expref: 8 pid: 13766 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263765.323152:0:13766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981530800, rc 0) 00000100:00100000:3.0:1789263765.323200:0:13766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9907a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+8:2398:x1876178888632832:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 198us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263765.323207:0:13766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 59 00000100:00100000:2.0:1789263765.325172:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263765.325241:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888633088 00000100:00100000:3.0:1789263765.325250:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888633088 00000100:00100000:3.0:1789263765.325300:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 193 00000100:00100000:3.0:1789263765.325310:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+66:12335:x1876178888633088:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789263765.325408:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+66:12335:x1876178888633088:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 Request processed in 99us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263765.325416:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 193 00000100:00100000:0.0:1789263765.326436:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263765.326492:0:8392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888633216 00000100:00100000:2.0:1789263765.326498:0:8392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888633216 00000100:00100000:2.0:1789263765.326544:0:8392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 60 00000100:00100000:2.0:1789263765.326553:0:8392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9907a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+8:12335:x1876178888633216:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789263765.326565:0:8392:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263765.326580:0:8392:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b87d9fdc/0xce1582440fb1e5d0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11f71 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263765.326607:0:8392:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000aea88dc7/0xce1582440fb1e5c9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f6a expref: 9 pid: 13766 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263765.326613:0:8392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789263765.326617:0:8392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789263765.326626:0:8392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b87d9fdc/0xce1582440fb1e5d0 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f71 expref: 9 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263765.326658:0:8392:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000aea88dc7/0xce1582440fb1e5c9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f6a expref: 9 pid: 13766 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263765.326672:0:8392:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000aea88dc7/0xce1582440fb1e5c9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f6a expref: 9 pid: 13766 timeout: 307 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263765.326696:0:8392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883e35c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8392:1876178898092800:192.168.203.20@tcp:104: 00000100:00100000:2.0:1789263765.326772:0:8392:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd8840c9a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789263765.327733:0:8392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883e35c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8392:1876178898092800:192.168.203.20@tcp:104: 00010000:00010000:2.0:1789263765.327757:0:8392:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b87d9fdc/0xce1582440fb1e5d0 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f71 expref: 9 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263765.327778:0:8392:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bb805800, rc 0) 00000100:00100000:2.0:1789263765.327812:0:8392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9907a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+9:12335:x1876178888633216:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 1261us (1379us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263765.327817:0:8392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 60 00000100:00100000:0.0:1789263765.327824:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263765.327875:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888633344 00000100:00100000:1.0:1789263765.327881:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888633344 00010000:00010000:1.0:1789263765.327904:0:6472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000aea88dc7/0xce1582440fb1e5c9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f6a expref: 9 pid: 13766 timeout: 307 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263765.327933:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 86 00000100:00100000:1.0:1789263765.327943:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9907a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+9:2398:x1876178888633344:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789263765.327954:0:6472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789263765.327974:0:6472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000aea88dc7/0xce1582440fb1e5c9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f6a expref: 9 pid: 13766 timeout: 307 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.327988:0:6472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000aea88dc7/0xce1582440fb1e5c9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f6a expref: 9 pid: 13766 timeout: 307 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.328008:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aea88dc7/0xce1582440fb1e5c9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f6a expref: 9 pid: 13766 timeout: 307 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.328019:0:6472:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789263765.328023:0:6472:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789263765.328030:0:6472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b87d9fdc/0xce1582440fb1e5d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f71 expref: 8 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.328041:0:6472:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b87d9fdc/0xce1582440fb1e5d0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f71 expref: 8 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.328112:0:6472:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b87d9fdc/0xce1582440fb1e5d0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f71 expref: 8 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263765.328125:0:6472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6472:1876178898092928:192.168.203.20@tcp:105: 00000100:00100000:1.0:1789263765.328168:0:6472:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9872a5840 going to sleep for 11 seconds 00000100:00100000:1.0:1789263765.330037:0:6472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6472:1876178898092928:192.168.203.20@tcp:105: 00010000:00010000:1.0:1789263765.330062:0:6472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789263765.330146:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9907a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+8:2398:x1876178888633344:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 2205us (2324us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263765.330155:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 86 00000100:00100000:0.0:1789263765.331323:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263765.331386:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888633472 00000100:00100000:3.0:1789263765.331406:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888633472 00002000:00100000:3.0:1789263765.331475:0:8400:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9dd9907a7800 x1876178888633472/t0(0) o4->3ce90ea2-917f-4b54-98b0-25e051f2317f@192.168.203.20@tcp:601/0 lens 504/0 e 0 to 0 dl 1789263776 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789263765.331487:0:8400:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dd9907a7800 with x1876178888633472 ext(0->8) 00002000:00010000:3.0:1789263765.331497:0:8400:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dd9907a7800 00000100:00100000:3.0:1789263765.331532:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 4 00000100:00100000:3.0:1789263765.331543:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9907a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+8:2397:x1876178888633472:12345-192.168.203.20@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789263765.332998:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9907a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+10:2397:x1876178888633472:12345-192.168.203.20@tcp:4:lhsmtool_posix.0 Request processed in 1447us (1669us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1789263765.333025:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 4 00002000:00100000:3.0:1789263765.333039:0:8400:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9dd9907a7800 x1876178888633472/t4294967315(0) o4->3ce90ea2-917f-4b54-98b0-25e051f2317f@192.168.203.20@tcp:601/0 lens 504/448 e 0 to 0 dl 1789263776 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789263765.333050:0:8400:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dd9907a7800 with x1876178888633472 ext(0->8) 00002000:00010000:3.0:1789263765.333057:0:8400:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dd9907a7800 00000100:00100000:0.0:1789263765.334252:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263765.334310:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888633600 00000100:00100000:1.0:1789263765.334325:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888633600 00000100:00100000:1.0:1789263765.334396:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 194 00000100:00100000:1.0:1789263765.334410:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c08aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+66:12335:x1876178888633600:12345-192.168.203.20@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789263765.335847:0:6466:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967451 is committed 00000004:00080000:3.0:1789263765.335867:0:6466:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00010000:00010000:1.0:1789263765.335886:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3000/0xce1582440fb1e306 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.335905:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3000/0xce1582440fb1e306 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.335915:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3000/0xce1582440fb1e306 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.335923:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd8841a3000 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263765.335928:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3000/0xce1582440fb1e306 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.335946:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3000/0xce1582440fb1e306 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789263765.335948:0:6466:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00010000:00010000:1.0:1789263765.335972:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9dd8829ede00) 00010000:00010000:1.0:1789263765.335977:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263765.335984:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3000/0xce1582440fb1e306 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1789263765.335986:0:6466:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9dd989758f00 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1789263765.335994:0:6466:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9dd882ad6100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9dd989758780 00010000:00010000:1.0:1789263765.335996:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3000/0xce1582440fb1e306 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1789263765.335999:0:6466:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9dd882ad6700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9dd884117200 00010000:00010000:1.0:1789263765.336031:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3c00/0xce1582440fb1e30d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1789263765.336048:0:6466:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00010000:00010000:1.0:1789263765.336056:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3c00/0xce1582440fb1e30d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.336065:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3c00/0xce1582440fb1e30d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.336108:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd8841a3c00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263765.336113:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3c00/0xce1582440fb1e30d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.336121:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3c00/0xce1582440fb1e30d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.336135:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dd8829edc00) 00010000:00010000:1.0:1789263765.336139:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263765.336142:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3c00/0xce1582440fb1e30d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.336161:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3c00/0xce1582440fb1e30d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263765.336176:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9c08a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898093056:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1789263765.336179:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3600/0xce1582440fb1e34c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263765.336186:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1789263765.336190:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3600/0xce1582440fb1e34c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.336199:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3600/0xce1582440fb1e34c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.336206:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd8841a3600 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263765.336211:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3600/0xce1582440fb1e34c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263765.336212:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883e35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876178898093184:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1789263765.336229:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3600/0xce1582440fb1e34c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.336241:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9dd8829ed900) 00010000:00010000:1.0:1789263765.336245:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263765.336255:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3600/0xce1582440fb1e34c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.336262:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3600/0xce1582440fb1e34c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263765.336279:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789263765.336281:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3800/0xce1582440fb1e45d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.336289:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3800/0xce1582440fb1e45d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.336306:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3800/0xce1582440fb1e45d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.336312:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd8841a3800 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263765.336316:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3800/0xce1582440fb1e45d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.336323:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3800/0xce1582440fb1e45d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.336333:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd8829ed500) 00010000:00010000:1.0:1789263765.336337:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263765.336340:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3800/0xce1582440fb1e45d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.336346:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3800/0xce1582440fb1e45d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1789263765.336350:0:6519:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00010000:00010000:1.0:1789263765.336362:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2000/0xce1582440fb1e480 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.336370:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2000/0xce1582440fb1e480 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263765.336387:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789263765.336387:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2000/0xce1582440fb1e480 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.336399:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd8841a2000 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263765.336403:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2000/0xce1582440fb1e480 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.336420:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2000/0xce1582440fb1e480 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.336430:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd8829ed500) 00010000:00010000:1.0:1789263765.336432:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263765.336436:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2000/0xce1582440fb1e480 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1789263765.336437:0:6519:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:1.0:1789263765.336446:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2000/0xce1582440fb1e480 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.336459:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1e4b8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.336476:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1e4b8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.336488:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1e4b8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.336494:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd8841a2600 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263765.336498:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1e4b8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.336505:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1e4b8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.336514:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd8829ed500) 00010000:00010000:1.0:1789263765.336517:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263765.336521:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1e4b8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.336537:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2600/0xce1582440fb1e4b8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.336552:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1e5ad lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.336559:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1e5ad lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.336565:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1e5ad lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.336571:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883f58a00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263765.336574:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1e5ad lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.336580:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1e5ad lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.336588:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9dd8829ed800) 00010000:00010000:1.0:1789263765.336590:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789263765.336593:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1e5ad lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263765.336599:0:8394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898093056 00010000:00010000:1.0:1789263765.336600:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1e5ad lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263765.336608:0:8394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898093056 00000100:00100000:0.0:1789263765.336635:0:8395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898093184 00000100:00100000:0.0:1789263765.336650:0:8395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898093184 00000100:00080000:3.0:1789263765.336704:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789263765.336751:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789263765.336763:0:8395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789263765.336768:0:8394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaa6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3621:x1876178898093056:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789263765.336784:0:8395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1876178898093184:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1789263765.336788:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c08aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+20:12335:x1876178888633600:12345-192.168.203.20@tcp:44:lhsmtool_posix.0 Request processed in 2371us (2526us total) trans 0 rc 0/0 00002000:00080000:2.0:1789263765.336798:0:8394:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:4 count 1 00000100:00100000:1.0:1789263765.336803:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 194 00002000:00010000:2.0:1789263765.336847:0:8394:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6aa5ff94, atime: 0x6aa5ff94, ctime: 0x6aa5ff94, blocks: 0x8 00010000:00010000:2.0:1789263765.336861:0:8394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c5e1146/0xce1582440fb1e5d7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263765.336881:0:8394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=207s v=(0 0) 00010000:00010000:2.0:1789263765.336888:0:8394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789263765.336896:0:8394:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c5e1146/0xce1582440fb1e5d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263765.336916:0:8394:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004c5e1146/0xce1582440fb1e5d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789263765.336920:0:8395:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789263765.336934:0:8395:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1789263765 00010000:00010000:2.0:1789263765.336938:0:8394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c5e1146/0xce1582440fb1e5d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789263765.336940:0:8395:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789263765.336952:0:8395:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1789263765 -> 1789263765 00002000:00010000:0.0:1789263765.336979:0:8395:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1789263765.336983:0:8394:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004c5e1146/0xce1582440fb1e5d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263765.337010:0:8394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789263765.337036:0:13146:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263765.337045:0:13146:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004c5e1146/0xce1582440fb1e5d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263765.337056:0:8395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3619:x1876178898093184:12345-0@lo:2:osp-syn-0-0.0 Request processed in 273us (673us total) trans 4294967316 rc 0/0 00010000:00010000:1.0:1789263765.337072:0:13146:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bb804000 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263765.337111:0:13146:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004c5e1146/0xce1582440fb1e5d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263765.337126:0:8395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00010000:1.0:1789263765.337128:0:13146:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004c5e1146/0xce1582440fb1e5d7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.337153:0:13146:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004c5e1146/0xce1582440fb1e5d7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.337162:0:13146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004c5e1146/0xce1582440fb1e5d7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.337185:0:13146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263765.337188:0:13146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263765.337190:0:13146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789263765.337196:0:3619:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:3.0:1789263765.337203:0:3619:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9dd989afed80, transno 4294967310 00000004:00080000:3.0:1789263765.337219:0:3619:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967313 00000100:00100000:2.0:1789263765.337219:0:8394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaa6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3621:x1876178898093056:12345-0@lo:6:osp-syn-1-0.0 Request processed in 455us (941us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1789263765.337231:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000004:00080000:3.0:1789263765.337261:0:3619:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9dd883e31180, transno 4294967313 00000100:00100000:3.0:1789263765.337278:0:3619:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9dd883e35c00 x1876178898093184/t4294967316(4294967316) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1789263781 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1789263765.337281:0:3621:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9dd9c08a9f80/2, rc 0, transno 4294967308 00000100:00100000:0.0:1789263765.337300:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9c08a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898093056:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1789263765.337304:0:3619:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9dd883e35c00/2, rc 0, transno 4294967316 00000100:00100000:3.0:1789263765.337322:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883e35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876178898093184:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789263765.338139:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263765.338276:0:8392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888633728 00000100:00100000:0.0:1789263765.338285:0:8392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888633728 00000100:00100000:0.0:1789263765.338335:0:8392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 63 00000100:00100000:0.0:1789263765.338345:0:8392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+10:2398:x1876178888633728:12345-192.168.203.20@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1789263765.339455:0:8388:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:3.0:1789263765.339467:0:8388:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:0.0:1789263765.339611:0:8392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+7:2398:x1876178888633728:12345-192.168.203.20@tcp:16:lhsmtool_posix.0 Request processed in 1263us (1469us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263765.339622:0:8392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 63 00000100:00100000:1.0:1789263765.341140:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263765.341179:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888633984 00000100:00100000:3.0:1789263765.341190:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888633984 00000100:00100000:3.0:1789263765.341261:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 195 00000100:00100000:3.0:1789263765.341271:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+20:12335:x1876178888633984:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789263765.341359:0:8417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789263765.341391:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58000/0xce1582440fb1e5c2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f63 expref: 20 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263765.341413:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9dd8829ed800) 00010000:00010000:3.0:1789263765.341419:0:8417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789263765.341456:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1e5de lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263765.341471:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1e5de lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263765.341479:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1e5de lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789263765.341619:0:8417:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000088214c30 reply state 00000000989550fb transno 4294967452 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1e5de lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263765.341630:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1e5de lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263765.341635:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9dd8829ed800) 00010000:00010000:3.0:1789263765.341637:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789263765.341644:0:8417:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789263765.341755:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+21:12335:x1876178888633984:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 Request processed in 485us (623us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1789263765.341763:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 195 00000100:00100000:3.0:1789263765.343016:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263765.343123:0:8395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888634112 00000100:00100000:0.0:1789263765.343133:0:8395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888634112 00000100:00100000:0.0:1789263765.343190:0:8395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 64 00000100:00100000:0.0:1789263765.343202:0:8395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaa4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+7:2397:x1876178888634112:12345-192.168.203.20@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789263765.343354:0:8395:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1789263765.343356:0:8395:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1789263765 -> 1789263764 00002000:00010000:0.0:1789263765.343358:0:8395:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1789263764 00002000:00010000:0.0:1789263765.343360:0:8395:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1789263765 -> 1789263764 00002000:00010000:0.0:1789263765.343361:0:8395:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1789263765.343417:0:8395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaa4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+8:2397:x1876178888634112:12345-192.168.203.20@tcp:2:lhsmtool_posix.0 Request processed in 217us (406us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1789263765.343424:0:8395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 64 00000100:00100000:0.0:1789263765.344468:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263765.344514:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888634368 00000100:00100000:3.0:1789263765.344523:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888634368 00000100:00100000:3.0:1789263765.344579:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 196 00000100:00100000:3.0:1789263765.344591:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c08ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+21:12335:x1876178888634368:12345-192.168.203.20@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789263765.344666:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1e5e5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263765.344686:0:6489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1e5a6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f55 expref: 21 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263765.344695:0:6489:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1e5e5 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263765.344751:0:6489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1e5a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f55 expref: 21 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263765.344766:0:6489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1e5a6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f55 expref: 21 pid: 6488 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263765.344782:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6489:1876178898093312:192.168.203.20@tcp:104: 00000100:00100000:3.0:1789263765.344888:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd98a326e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789263765.345911:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6489:1876178898093312:192.168.203.20@tcp:104: 00010000:00010000:3.0:1789263765.345937:0:6489:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1e5e5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263765.346162:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263765.346195:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888634496 00000100:00100000:3.0:1789263765.346203:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888634496 00010000:00010000:3.0:1789263765.346279:0:6473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1e5a6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f55 expref: 22 pid: 6488 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263765.346319:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 87 00000100:00100000:3.0:1789263765.346329:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c08a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+22:2398:x1876178888634496:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789263765.346343:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789263765.346352:0:6473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1e5a6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f55 expref: 22 pid: 6488 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263765.346366:0:6473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1e5a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f55 expref: 22 pid: 6488 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263765.346391:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1e5a6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f55 expref: 22 pid: 6488 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263765.346410:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9dd8829ed800) 00010000:00010000:3.0:1789263765.346416:0:6473:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1e5e5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263765.346426:0:6473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1e5e5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263765.346434:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1e5e5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263765.346470:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789263765.346534:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c08a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+21:2398:x1876178888634496:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 207us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263765.346543:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 87 00010000:00010000:1.0:1789263765.346587:0:6489:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1e5e5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.346603:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1e5e5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.346648:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1e5e5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.346684:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1e5e5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.346695:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1e5e5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.346702:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981530600 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263765.346706:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1e5e5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.346714:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1e5e5 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.346741:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9dd8829ed800) 00010000:00010000:1.0:1789263765.346744:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1789263765.346748:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1e5e5 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.346754:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1e5e5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263765.346867:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c08ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+20:12335:x1876178888634368:12345-192.168.203.20@tcp:55:lhsmtool_posix.0 Request processed in 2275us (2399us total) trans 0 rc -22/-22 00000100:00100000:1.0:1789263765.346875:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 196 00000100:00100000:0.0:1789263765.347923:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263765.347982:0:8394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888634624 00000100:00100000:2.0:1789263765.347989:0:8394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888634624 00000100:00100000:2.0:1789263765.348030:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 65 00000100:00100000:2.0:1789263765.348038:0:8394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c08a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+8:2398:x1876178888634624:12345-192.168.203.20@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789263765.348111:0:8394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000669addda/0xce1582440fb1e5ec lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263765.348135:0:8394:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b87d9fdc/0xce1582440fb1e5d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f71 expref: 8 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263765.348143:0:8394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789263765.348148:0:8394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789263765.348152:0:8394:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000669addda/0xce1582440fb1e5ec lrc: 4/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263765.348194:0:8394:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b87d9fdc/0xce1582440fb1e5d0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f71 expref: 8 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263765.348240:0:8394:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b87d9fdc/0xce1582440fb1e5d0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f71 expref: 8 pid: 8392 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263765.348254:0:8394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883e37b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8394:1876178898093440:192.168.203.20@tcp:104: 00000100:00100000:2.0:1789263765.348330:0:8394:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd8840c9a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789263765.349427:0:8394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883e37b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8394:1876178898093440:192.168.203.20@tcp:104: 00010000:00010000:2.0:1789263765.349454:0:8394:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000669addda/0xce1582440fb1e5ec lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263765.349632:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263765.349672:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888634752 00000100:00100000:3.0:1789263765.349688:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888634752 00010000:00010000:3.0:1789263765.349781:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b87d9fdc/0xce1582440fb1e5d0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f71 expref: 9 pid: 8392 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263765.349821:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 88 00000100:00100000:3.0:1789263765.349831:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c08a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+9:2398:x1876178888634752:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789263765.349847:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789263765.349875:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b87d9fdc/0xce1582440fb1e5d0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f71 expref: 9 pid: 8392 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263765.349888:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b87d9fdc/0xce1582440fb1e5d0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f71 expref: 9 pid: 8392 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263765.349911:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b87d9fdc/0xce1582440fb1e5d0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f71 expref: 9 pid: 8392 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263765.349925:0:6474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789263765.349928:0:6474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789263765.349932:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000669addda/0xce1582440fb1e5ec lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263765.349938:0:6474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000669addda/0xce1582440fb1e5ec lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263765.349974:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789263765.350000:0:8394:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000669addda/0xce1582440fb1e5ec lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263765.350008:0:8394:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000669addda/0xce1582440fb1e5ec lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263765.350018:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c08a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+8:2398:x1876178888634752:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 188us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263765.350024:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 88 00010000:00010000:2.0:1789263765.350028:0:8394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000669addda/0xce1582440fb1e5ec lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263765.350036:0:8394:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000669addda/0xce1582440fb1e5ec lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263765.350044:0:8394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000669addda/0xce1582440fb1e5ec lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263765.350064:0:8394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bb804400 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:2.0:1789263765.350069:0:8394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000669addda/0xce1582440fb1e5ec lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263765.350150:0:8394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000669addda/0xce1582440fb1e5ec lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263765.350165:0:8394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000669addda/0xce1582440fb1e5ec lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263765.350173:0:8394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000669addda/0xce1582440fb1e5ec lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263765.350230:0:8394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c08a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+7:2398:x1876178888634624:12345-192.168.203.20@tcp:1:lhsmtool_posix.0 Request processed in 2193us (2311us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263765.350239:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 65 00000100:00100000:0.0:1789263765.351257:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263765.351297:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888635008 00000100:00100000:1.0:1789263765.351304:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888635008 00000100:00100000:1.0:1789263765.351339:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 197 00000100:00100000:1.0:1789263765.351345:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c08a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+20:12335:x1876178888635008:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789263765.351408:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1e5f3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.351442:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2800/0xce1582440fb1e456 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f08 expref: 20 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.351448:0:6488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1e5f3 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.351476:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2800/0xce1582440fb1e456 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f08 expref: 20 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.351486:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2800/0xce1582440fb1e456 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f08 expref: 20 pid: 6488 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263765.351496:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6488:1876178898093568:192.168.203.20@tcp:104: 00000100:00100000:1.0:1789263765.351550:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9872a5840 going to sleep for 11 seconds 00000100:00100000:1.0:1789263765.352623:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6488:1876178898093568:192.168.203.20@tcp:104: 00010000:00010000:1.0:1789263765.352647:0:6488:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1e5f3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263765.352938:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263765.353016:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888635136 00000100:00100000:2.0:1789263765.353026:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888635136 00010000:00010000:2.0:1789263765.353053:0:8409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2800/0xce1582440fb1e456 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f08 expref: 21 pid: 6488 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263765.353108:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 89 00000100:00100000:2.0:1789263765.353118:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c08abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+21:2398:x1876178888635136:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789263765.353131:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789263765.353147:0:8409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2800/0xce1582440fb1e456 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f08 expref: 21 pid: 6488 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263765.353158:0:8409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2800/0xce1582440fb1e456 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f08 expref: 21 pid: 6488 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263765.353177:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2800/0xce1582440fb1e456 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f08 expref: 21 pid: 6488 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263765.353191:0:8409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd8829ed500) 00010000:00010000:2.0:1789263765.353196:0:8409:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1e5f3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263765.353204:0:8409:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1e5f3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263765.353211:0:8409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1e5f3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263765.353239:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789263765.353278:0:6488:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1e5f3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263765.353278:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c08abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+20:2398:x1876178888635136:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 161us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263765.353294:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 89 00010000:00010000:3.0:1789263765.353296:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1e5f3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263765.353444:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1e5fa lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263765.353454:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1e5b4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f5c expref: 20 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263765.353460:0:6488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1e5fa lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263765.353479:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1e5b4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f5c expref: 20 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263765.353487:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1e5b4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f5c expref: 20 pid: 6489 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263765.353494:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa5180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6488:1876178898093696:192.168.203.20@tcp:104: 00000100:00100000:3.0:1789263765.353565:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd985565a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789263765.354519:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa5180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6488:1876178898093696:192.168.203.20@tcp:104: 00010000:00010000:3.0:1789263765.354601:0:6488:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1e5fa lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263765.354651:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263765.354708:0:10303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888635264 00000100:00100000:2.0:1789263765.354714:0:10303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888635264 00010000:00010000:2.0:1789263765.354748:0:10303:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1e5b4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f5c expref: 21 pid: 6489 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263765.354775:0:10303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 90 00000100:00100000:2.0:1789263765.354786:0:10303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c08aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3ce90ea2-917f-4b54-98b0-25e051f2317f+21:2398:x1876178888635264:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789263765.354804:0:10303:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789263765.354810:0:10303:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1e5b4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f5c expref: 21 pid: 6489 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263765.354822:0:10303:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1e5b4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f5c expref: 21 pid: 6489 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263765.354839:0:10303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1e5b4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f5c expref: 21 pid: 6489 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263765.354851:0:10303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9dd8829ed800) 00010000:00010000:2.0:1789263765.354855:0:10303:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1e5fa lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263765.354863:0:10303:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1e5fa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263765.354869:0:10303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1e5fa lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263765.354887:0:10303:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789263765.354899:0:6488:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1e5fa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263765.354908:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1e5fa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263765.354916:0:10303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c08aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3ce90ea2-917f-4b54-98b0-25e051f2317f+20:2398:x1876178888635264:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 135us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263765.354922:0:10303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 90 00000001:00080000:3.0:1789263765.354983:0:6488:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967453 00000001:00080000:3.0:1789263765.355187:0:6488:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967454 00000001:00080000:3.0:1789263765.355225:0:6488:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967455 00000100:00100000:3.0:1789263765.355286:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa5180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6488:1876178898093824:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789263765.355322:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263765.355352:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd882616d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789263765.355406:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898093824 00000100:00100000:0.0:1789263765.355411:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898093824 00000100:00100000:0.0:1789263765.355451:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789263765.355458:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaa7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6488:x1876178898093824:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789263765.355528:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaa7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6488:x1876178898093824:12345-0@lo:1000:mdt00_001.0 Request processed in 71us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263765.355535:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789263765.355611:0:6488:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:3.0:1789263765.355617:0:6488:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9dd883e35c00, transno 4294967316 00000100:00100000:3.0:1789263765.355629:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa5180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6488:1876178898093824:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1789263765.355749:0:6488:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967456 00000100:00100000:3.0:1789263765.355787:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa5180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6488:1876178898093952:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789263765.355815:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263765.355876:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd882616f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789263765.355911:0:8499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898093952 00000100:00100000:0.0:1789263765.355915:0:8499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898093952 00000100:00100000:0.0:1789263765.355972:0:8499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789263765.355979:0:8499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88396bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6488:x1876178898093952:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789263765.356070:0:8499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88396bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6488:x1876178898093952:12345-0@lo:1000:mdt00_001.0 Request processed in 91us (253us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1789263765.356160:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa5180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6488:1876178898093952:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1789263765.356185:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1e5fa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.356193:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1e5fa lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.356200:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1e5fa lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.356219:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981530a00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263765.356223:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1e5fa lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.356230:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1e5fa lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.356242:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9dd8829ed800) 00010000:00010000:1.0:1789263765.356244:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789263765.356248:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1e5fa lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.356255:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1e5fa lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.356273:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59e00/0xce1582440fb1e52f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.356279:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59e00/0xce1582440fb1e52f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.356285:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59e00/0xce1582440fb1e52f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.356290:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883f59e00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263765.356293:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59e00/0xce1582440fb1e52f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.356298:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59e00/0xce1582440fb1e52f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.356315:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd8829ed500) 00010000:00010000:1.0:1789263765.356317:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789263765.356320:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59e00/0xce1582440fb1e52f lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.356326:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59e00/0xce1582440fb1e52f lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.356344:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1e601 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.356356:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e54b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f40 expref: 23 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.356363:0:6488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1e601 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.356386:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e54b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f40 expref: 23 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.356399:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e54b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f40 expref: 23 pid: 6489 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263765.356409:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6488:1876178898094080:192.168.203.20@tcp:104: 00000100:00100000:1.0:1789263765.356472:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9872a5840 going to sleep for 11 seconds 00000100:00100000:0.0:1789263765.356518:0:8499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789263765.357626:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6488:1876178898094080:192.168.203.20@tcp:104: 00010000:00010000:1.0:1789263765.357644:0:6488:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1e601 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263765.357996:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263765.358144:0:7428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888635392 00000100:00100000:1.0:1789263765.358151:0:7428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888635392 00010000:00010000:1.0:1789263765.358179:0:7428:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e54b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f40 expref: 24 pid: 6489 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263765.358208:0:7428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 91 00000100:00100000:1.0:1789263765.358217:0:7428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd991530450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+24:2397:x1876178888635392:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789263765.358228:0:7428:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789263765.358234:0:7428:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e54b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f40 expref: 24 pid: 6489 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.358245:0:7428:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e54b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f40 expref: 24 pid: 6489 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.358262:0:7428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433200/0xce1582440fb1e54b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f40 expref: 24 pid: 6489 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.358274:0:7428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd8829ed500) 00010000:00010000:1.0:1789263765.358278:0:7428:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1e601 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.358286:0:7428:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1e601 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.358292:0:7428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1e601 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.358316:0:7428:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789263765.358349:0:6488:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1e601 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263765.358359:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1e601 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263765.358365:0:7428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd991530450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+23:2397:x1876178888635392:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 146us (366us total) trans 0 rc 0/0 00010000:00010000:3.0:1789263765.358374:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1e601 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263765.358377:0:7428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 91 00010000:00010000:3.0:1789263765.358391:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1e601 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263765.358399:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1e601 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263765.358406:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883f59000 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263765.358411:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1e601 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263765.358418:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1e601 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263765.358429:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd8829ed500) 00010000:00010000:3.0:1789263765.358432:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789263765.358437:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1e601 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263765.358443:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1e601 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263765.358457:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1e5f3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263765.358462:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1e5f3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263765.358466:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1e5f3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263765.358471:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883f58a00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263765.358480:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1e5f3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263765.358487:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1e5f3 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263765.358534:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd8829ed500) 00010000:00010000:3.0:1789263765.358537:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789263765.358540:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1e5f3 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263765.358544:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1e5f3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263765.358673:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c08a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+22:12335:x1876178888635008:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 Request processed in 7326us (7418us total) trans 4294967457 rc 0/0 00000100:00100000:3.0:1789263765.358682:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 197 00000020:00080000:3.0:1789263765.358686:0:6488:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1789263765.358715:0:13757:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789263765.358733:0:13757:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789263765.359243:0:13757:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 5 00000040:00080000:1.0:1789263765.359252:0:13757:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789263765.359958:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263765.360046:0:14127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888635648 00000100:00100000:1.0:1789263765.360053:0:14127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888635648 00000100:00100000:2.0:1789263765.360163:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 44 00000100:00100000:2.0:1789263765.360174:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c08ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+22:12335:x1876178888635648:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789263765.360413:0:6491:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789263765.360445:0:6491:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967458 00010000:00010000:2.0:1789263765.360486:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1e608 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263765.360511:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1e608 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263765.360524:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1e608 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263765.360533:0:6491:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1e608 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263765.360539:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1e608 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263765.360545:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1e608 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263765.360563:0:6491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789263765.360582:0:7427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263765.360589:0:7427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1e608 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.360595:0:7427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bb804400 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263765.360598:0:7427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1e608 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.360604:0:7427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1e608 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.360613:0:7427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9dd8829ed800) 00010000:00010000:1.0:1789263765.360615:0:7427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789263765.360618:0:7427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1e608 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263765.360622:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1e608 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263765.360630:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c08ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+24:12335:x1876178888635648:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 Request processed in 459us (675us total) trans 4294967459 rc 0/0 00010000:00010000:1.0:1789263765.360634:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789263765.360637:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 44 00010000:00010000:1.0:1789263765.360642:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1789263765.360645:0:6491:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789263765.360646:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789263765.434886:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263765.434927:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263765.434943:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888635904 00000100:00100000:3.0:1789263765.434954:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888635904 00000100:00100000:0.0:1789263765.434961:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00080000:3.0:1789263765.434991:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789263765.434996:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888635776 00000100:00100000:0.0:1789263765.434996:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263765.435014:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888635776 00000100:00100000:2.0:1789263765.435021:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888636160 00000100:00100000:2.0:1789263765.435028:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888636160 00000100:00100000:0.0:1789263765.435033:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263765.435044:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 150 00000100:00100000:3.0:1789263765.435058:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c08a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+5:2397:x1876178888635904:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1789263765.435069:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 334 00000100:00100000:0.0:1789263765.435074:0:8392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888636032 00000100:00100000:2.0:1789263765.435110:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888636288 00000100:00100000:2.0:1789263765.435114:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888636288 00000100:00100000:1.0:1789263765.435131:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a05050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+13:2398:x1876178888635776:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789263765.435131:0:8392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888636032 00000100:00100000:2.0:1789263765.435141:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 151 00000100:00100000:2.0:1789263765.435151:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c08a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:857a0866-badb-47ac-9591-fbf273e4680e+5:2397:x1876178888636160:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789263765.435174:0:8392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 78 00000100:00100000:0.0:1789263765.435184:0:8392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c08abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+7:2398:x1876178888636032:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1789263765.435201:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a05050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+13:2398:x1876178888635776:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 119us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263765.435202:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c08a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+5:2397:x1876178888635904:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 145us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263765.435203:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c08a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:857a0866-badb-47ac-9591-fbf273e4680e+5:2397:x1876178888636160:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 52us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263765.435219:0:8392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c08abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+7:2398:x1876178888636032:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 36us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263765.435221:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 334 00000100:00100000:3.0:1789263765.435225:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 150 00000100:00100000:0.0:1789263765.435243:0:8392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 78 00000100:00100000:2.0:1789263765.435248:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 151 00000100:00100000:3.0:1789263765.435257:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 152 00000100:00100000:3.0:1789263765.435269:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c08aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:857a0866-badb-47ac-9591-fbf273e4680e+5:2397:x1876178888636288:12345-192.168.203.20@tcp:400:kworker.0 00000100:00080000:2.0:1789263765.435283:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789263765.435289:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789263765.435292:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789263765.435296:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c08aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:857a0866-badb-47ac-9591-fbf273e4680e+5:2397:x1876178888636288:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 31us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263765.435310:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 152 00000100:00100000:2.0:1789263765.549260:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789263765.549269:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989afed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898094208:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789263765.549281:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882613b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876178898094592:0@lo:400:kworker.0 00000100:00100000:2.0:1789263765.549357:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263765.549357:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263765.549361:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882610700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898094720:0@lo:400:kworker.0 00000100:00100000:3.0:1789263765.549406:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263765.549435:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883e37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898094336:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789263765.549439:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883969f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:66a76ccf-c64c-4b18-8369-a2861ec3956c:3621:1876178898094464:0@lo:400:kworker.0 00000100:00100000:3.0:1789263765.549440:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898095232:0@lo:400:kworker.0 00000100:00100000:0.0:1789263765.549445:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8838f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1876178898094848:0@lo:400:kworker.0 00000100:00100000:2.0:1789263765.549469:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263765.549513:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263765.549523:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263765.549524:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1876178898095104:0@lo:400:kworker.0 00000100:00100000:0.0:1789263765.549524:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263765.549542:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898095744:0@lo:400:kworker.0 00000100:00100000:1.0:1789263765.549561:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88297c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3621:1876178898094976:0@lo:400:kworker.0 00000100:00100000:0.0:1789263765.549574:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898095360:0@lo:400:kworker.0 00000100:00100000:2.0:1789263765.549609:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263765.549623:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263765.549625:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263765.549638:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1876178898095616:0@lo:400:kworker.0 00000100:00100000:2.0:1789263765.549677:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263765.549679:0:8396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898094208 00000100:00100000:3.0:1789263765.549686:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898094464 00000100:00100000:3.0:1789263765.549693:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898094464 00000100:00100000:1.0:1789263765.549695:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898094592 00000100:00100000:0.0:1789263765.549695:0:8396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898094208 00000100:00100000:1.0:1789263765.549702:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898094592 00000100:00100000:2.0:1789263765.549716:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898094336 00000100:00100000:2.0:1789263765.549733:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898094336 00000100:00100000:1.0:1789263765.549756:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898094848 00000100:00100000:1.0:1789263765.549761:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898094848 00000100:00100000:0.0:1789263765.549768:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789263765.549776:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789263765.549783:0:8396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989afd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898094208:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789263765.549789:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898095104 00000100:00100000:2.0:1789263765.549791:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3618:x1876178898094336:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789263765.549792:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898095104 00000100:00100000:3.0:1789263765.549805:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00002000:00000024:0.0:1789263765.549805:0:8396:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00002000:00000024:2.0:1789263765.549808:0:8397:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789263765.549818:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898095616 00000100:00100000:3.0:1789263765.549819:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a06050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+24:3621:x1876178898094464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789263765.549824:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898095616 00000100:00100000:1.0:1789263765.549846:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789263765.549854:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876178898094592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263765.549870:0:8396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989afd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898094208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 91us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263765.549872:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3618:x1876178898094336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263765.549882:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a06050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66a76ccf-c64c-4b18-8369-a2861ec3956c+24:3621:x1876178898094464:12345-0@lo:400:kworker.0 Request processed in 66us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263765.549888:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789263765.549892:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876178898094592:12345-0@lo:400:kworker.0 Request processed in 38us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263765.549893:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1789263765.549899:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789263765.549904:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789263765.549921:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789263765.549927:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989afc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1876178898094848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263765.549938:0:8511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898095232 00000100:00100000:2.0:1789263765.549940:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898094720 00000100:00100000:3.0:1789263765.549945:0:8511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898095232 00000100:00100000:2.0:1789263765.549946:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898094720 00000100:00100000:1.0:1789263765.549952:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989afc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1876178898094848:12345-0@lo:400:kworker.0 Request processed in 26us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263765.549958:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789263765.549963:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989afed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898094208:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789263765.549979:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898095360 00000100:00100000:2.0:1789263765.549984:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898095360 00000100:00100000:1.0:1789263765.549989:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789263765.549990:0:8511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898095744 00000100:00100000:3.0:1789263765.549996:0:8511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898095744 00000100:00100000:1.0:1789263765.549999:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876178898095104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263765.550007:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8838f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1876178898094848:0@lo:400:kworker.0 00000100:00100000:2.0:1789263765.550012:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789263765.550031:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876178898095104:12345-0@lo:400:kworker.0 Request processed in 35us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263765.550033:0:8511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789263765.550034:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1876178898094720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789263765.550041:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789263765.550055:0:8511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1876178898095232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263765.550055:0:8499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789263765.550063:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789263765.550067:0:8499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989afe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1876178898095360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789263765.550107:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1876178898095616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789263765.550114:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1876178898094720:12345-0@lo:400:kworker.0 Request processed in 86us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263765.550124:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789263765.550136:0:8511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1876178898095232:12345-0@lo:400:kworker.0 Request processed in 87us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263765.550146:0:8511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789263765.550147:0:8499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989afe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1876178898095360:12345-0@lo:400:kworker.0 Request processed in 82us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263765.550152:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1876178898095616:12345-0@lo:400:kworker.0 Request processed in 79us (475us total) trans 0 rc 0/0 00000100:00080000:2.0:1789263765.550153:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789263765.550160:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789263765.550161:0:8499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789263765.550165:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789263765.550166:0:8511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00080000:2.0:1789263765.550168:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789263765.550178:0:8511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1876178898095744:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1789263765.550197:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd99f9a7480 x1876178898095104/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263781 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789263765.550207:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1876178898095104:0@lo:400:kworker.0 00000100:00100000:0.0:1789263765.550211:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898095360:0@lo:400:kworker.0 00000100:00100000:3.0:1789263765.550228:0:8511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1876178898095744:12345-0@lo:400:kworker.0 Request processed in 49us (605us total) trans 0 rc 0/0 00010000:00080000:2.0:1789263765.550228:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd9bfa67100 x1876178898095616/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263781 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789263765.550245:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1876178898095616:0@lo:400:kworker.0 00000100:00100000:3.0:1789263765.550249:0:8511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789263765.550260:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882613b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876178898094592:0@lo:400:kworker.0 00000100:00100000:0.0:1789263765.550272:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263765.550277:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883e37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898094336:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789263765.550294:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882610700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898094720:0@lo:400:kworker.0 00000100:00100000:0.0:1789263765.550303:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3621:1876178898095488:0@lo:400:kworker.0 00000100:00100000:3.0:1789263765.550311:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898095232:0@lo:400:kworker.0 00000100:00100000:2.0:1789263765.550321:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898094976 00000100:00100000:3.0:1789263765.550324:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898095744:0@lo:400:kworker.0 00000100:00100000:2.0:1789263765.550326:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898094976 00000100:00100000:0.0:1789263765.550331:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263765.550365:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898095488 00000100:00100000:0.0:1789263765.550368:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883969f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:66a76ccf-c64c-4b18-8369-a2861ec3956c:3621:1876178898094464:0@lo:400:kworker.0 00000100:00100000:2.0:1789263765.550369:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898095488 00000100:00080000:3.0:1789263765.550372:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789263765.550384:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789263765.550396:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989afed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1876178898094976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789263765.550406:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789263765.550417:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1876178898095488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789263765.550450:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989afed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1876178898094976:12345-0@lo:400:kworker.0 Request processed in 57us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263765.550459:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789263765.550463:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1876178898095488:12345-0@lo:400:kworker.0 Request processed in 48us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263765.550473:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789263765.550498:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88297c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3621:1876178898094976:0@lo:400:kworker.0 00000100:00100000:0.0:1789263765.550512:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3621:1876178898095488:0@lo:400:kworker.0 00010000:00010000:0.0:1789263765.933360:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789263766.061261:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898095872:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789263766.061280:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898096128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789263766.061286:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898096000:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789263766.061351:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263766.061358:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263766.061362:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263766.061461:0:8396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898096000 00000100:00100000:1.0:1789263766.061463:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898096128 00000100:00100000:3.0:1789263766.061464:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898095872 00000100:00100000:0.0:1789263766.061467:0:8396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898096000 00000100:00100000:1.0:1789263766.061469:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898096128 00000100:00100000:3.0:1789263766.061470:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898095872 00000100:00100000:3.0:1789263766.061516:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789263766.061520:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789263766.061528:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789263766.061530:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1876178898095872:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789263766.061533:0:8396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1876178898096000:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789263766.061543:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bbbbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3618:x1876178898096128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789263766.061557:0:8396:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3691974656 00002000:00000024:1.0:1789263766.061559:0:8397:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3691974656 00000004:00000024:3.0:1789263766.061567:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789263766.061615:0:8396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1876178898096000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263766.061621:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789263766.061633:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1876178898095872:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263766.061637:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bbbbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3618:x1876178898096128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263766.061646:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789263766.061651:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789263766.061664:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898096000:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789263766.061706:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898095872:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789263766.061742:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898096128:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1789263766.337429:0:14712:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789263766.337437:0:14712:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789263766.337472:0:14712:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1789263766.337648:0:14712:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789263766.377690:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263766.377749:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888636416 00000100:00100000:1.0:1789263766.377759:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888636416 00000100:00100000:1.0:1789263766.377827:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 198 00000100:00100000:1.0:1789263766.377839:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+24:12354:x1876178888636416:12345-192.168.203.20@tcp:34:lfs.0 00010000:00010000:1.0:1789263766.377907:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1e60f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.377924:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1e60f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.377937:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1e60f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.377954:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58400/0xce1582440fb1e616 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.377962:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58400/0xce1582440fb1e616 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.377970:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58400/0xce1582440fb1e616 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.378040:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58000/0xce1582440fb1e61d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.378049:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58000/0xce1582440fb1e61d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.378057:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58000/0xce1582440fb1e61d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789263766.378128:0:6488:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58000/0xce1582440fb1e61d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.378148:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1e60f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.378154:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1e60f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.378161:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1e60f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.378167:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883f58800 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263766.378172:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1e60f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.378180:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1e60f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.378191:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dd8829edc00) 00010000:00010000:1.0:1789263766.378194:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263766.378199:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1e60f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.378206:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1e60f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.378216:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58400/0xce1582440fb1e616 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.378223:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58400/0xce1582440fb1e616 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.378229:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58400/0xce1582440fb1e616 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.378241:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883f58400 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263766.378244:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58400/0xce1582440fb1e616 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.378250:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58400/0xce1582440fb1e616 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.378259:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9dd8829ed900) 00010000:00010000:1.0:1789263766.378261:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263766.378264:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58400/0xce1582440fb1e616 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.378270:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58400/0xce1582440fb1e616 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.378284:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58000/0xce1582440fb1e61d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.378291:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58000/0xce1582440fb1e61d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.378297:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58000/0xce1582440fb1e61d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.378302:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883f58000 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263766.378305:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58000/0xce1582440fb1e61d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.378312:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58000/0xce1582440fb1e61d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.378331:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd8829ede00) 00010000:00010000:1.0:1789263766.378334:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263766.378337:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58000/0xce1582440fb1e61d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.378344:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58000/0xce1582440fb1e61d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263766.378421:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+24:12354:x1876178888636416:12345-192.168.203.20@tcp:34:lfs.0 Request processed in 584us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263766.378429:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 198 00000100:00100000:3.0:1789263766.397195:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263766.397235:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888636672 00000100:00100000:3.0:1789263766.397243:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888636672 00000100:00100000:3.0:1789263766.397317:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 199 00000100:00100000:3.0:1789263766.397329:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+24:12357:x1876178888636672:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:3.0:1789263766.397348:0:8417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263766.397387:0:8417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1e624 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11f78 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.397471:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1e62b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.397486:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1e62b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.397498:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1e62b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.397515:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1e632 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.397523:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1e632 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.397538:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1e632 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.397652:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1e639 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.397662:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1e639 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.397670:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1e639 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789263766.397679:0:8417:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1789263766.397772:0:8417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1e62b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.397791:0:8417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1e62b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.397798:0:8417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1e62b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.397805:0:8417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981530e00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263766.397810:0:8417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1e62b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.397818:0:8417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1e62b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.397831:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dd8829edc00) 00010000:00010000:3.0:1789263766.397834:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789263766.397840:0:8417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1e62b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.397846:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1e62b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.397858:0:8417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1e632 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.397864:0:8417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1e632 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.397884:0:8417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1e632 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.397889:0:8417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981531600 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263766.397899:0:8417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1e632 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.397907:0:8417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1e632 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.397916:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9dd9bb595700) 00010000:00010000:3.0:1789263766.397919:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789263766.397922:0:8417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1e632 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.397938:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1e632 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.397988:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1e624 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f78 expref: 27 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.398004:0:8417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1e639 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f78 expref: 26 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.398012:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd9bb595600) 00010000:00010000:3.0:1789263766.398015:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789263766.398018:0:8417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981530a00, rc 0) 00000100:00100000:3.0:1789263766.398102:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+26:12357:x1876178888636672:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 749us (892us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1789263766.398112:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 199 00000100:00100000:0.0:1789263766.399842:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263766.399890:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888636800 00000100:00100000:0.0:1789263766.399900:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888636800 00000100:00100000:0.0:1789263766.399952:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 200 00000100:00100000:0.0:1789263766.399961:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+26:12357:x1876178888636800:12345-192.168.203.20@tcp:54:lfs.0 00010000:00010000:0.0:1789263766.400026:0:7434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73800/0xce1582440fb1e647 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263766.400042:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73800/0xce1582440fb1e647 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263766.400055:0:7434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73800/0xce1582440fb1e647 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263766.400131:0:7434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73800/0xce1582440fb1e647 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263766.400140:0:7434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73800/0xce1582440fb1e647 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263766.400148:0:7434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73800/0xce1582440fb1e647 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263766.400157:0:7434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883e73800 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:0.0:1789263766.400163:0:7434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73800/0xce1582440fb1e647 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263766.400182:0:7434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73800/0xce1582440fb1e647 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263766.400200:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd9bb595600) 00010000:00010000:0.0:1789263766.400204:0:7434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789263766.400209:0:7434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73800/0xce1582440fb1e647 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263766.400216:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73800/0xce1582440fb1e647 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263766.400295:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+26:12357:x1876178888636800:12345-192.168.203.20@tcp:54:lfs.0 Request processed in 334us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263766.400306:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 200 00000100:00100000:3.0:1789263766.401485:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263766.401561:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888637056 00000100:00100000:1.0:1789263766.401580:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888637056 00000100:00100000:1.0:1789263766.401665:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 45 00000100:00100000:1.0:1789263766.401675:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+26:12357:x1876178888637056:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:1.0:1789263766.401888:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+27:12357:x1876178888637056:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 213us (408us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1789263766.401896:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 45 00000100:00100000:0.0:1789263766.414647:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263766.414724:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888637312 00000100:00100000:1.0:1789263766.414740:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888637312 00000100:00100000:1.0:1789263766.414829:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 201 00000100:00100000:1.0:1789263766.414845:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+27:11881:x1876178888637312:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:1.0:1789263766.414877:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263766.414903:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58000/0xce1582440fb1e64e lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11f7f expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.415034:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58400/0xce1582440fb1e655 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.415067:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1e639 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f78 expref: 28 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.415106:0:6488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58400/0xce1582440fb1e655 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.415148:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1e639 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f78 expref: 28 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.415164:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1e639 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f78 expref: 28 pid: 8417 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263766.415180:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6488:1876178898096256:192.168.203.20@tcp:104: 00000100:00100000:1.0:1789263766.415319:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9872a5600 going to sleep for 11 seconds 00000100:00100000:1.0:1789263766.416401:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6488:1876178898096256:192.168.203.20@tcp:104: 00000100:00100000:0.0:1789263766.416426:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00010000:00010000:1.0:1789263766.416433:0:6488:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58400/0xce1582440fb1e655 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263766.416469:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888637440 00000100:00100000:2.0:1789263766.416491:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888637440 00010000:00010000:2.0:1789263766.416527:0:8409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1e639 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f78 expref: 29 pid: 8417 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263766.416564:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 92 00000100:00100000:2.0:1789263766.416572:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88396b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+29:2397:x1876178888637440:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789263766.416584:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789263766.416590:0:8409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1e639 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f78 expref: 29 pid: 8417 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.416600:0:8409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1e639 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f78 expref: 29 pid: 8417 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.416616:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1e639 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f78 expref: 29 pid: 8417 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.416628:0:8409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd9bb595600) 00010000:00010000:2.0:1789263766.416631:0:8409:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58400/0xce1582440fb1e655 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.416638:0:8409:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58400/0xce1582440fb1e655 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.416642:0:8409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58400/0xce1582440fb1e655 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.416660:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789263766.416705:0:6488:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58400/0xce1582440fb1e655 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263766.416706:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88396b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+28:2397:x1876178888637440:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 127us (280us total) trans 0 rc 0/0 00010000:00010000:1.0:1789263766.416745:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58400/0xce1582440fb1e655 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263766.416751:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 92 00000004:00200000:1.0:1789263766.416774:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:1.0:1789263766.416917:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58000/0xce1582440fb1e64e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f7f expref: 29 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.416952:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58400/0xce1582440fb1e655 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f7f expref: 28 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.416961:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd9bb595600) 00010000:00010000:1.0:1789263766.416964:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789263766.416967:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd883f58400, rc 0) 00000100:00100000:1.0:1789263766.417023:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+28:11881:x1876178888637312:12345-192.168.203.20@tcp:101:bash.0 Request processed in 2184us (2385us total) trans 4294967462 rc 0/0 00000100:00100000:1.0:1789263766.417032:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 201 00000100:00100000:0.0:1789263766.418028:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263766.418111:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888637568 00000100:00100000:3.0:1789263766.418119:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888637568 00000100:00100000:3.0:1789263766.418163:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 202 00000100:00100000:3.0:1789263766.418183:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88396a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+28:11881:x1876178888637568:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:3.0:1789263766.418204:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263766.418218:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1e663 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11f86 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.418249:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1e66a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.418260:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1e66a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.418270:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1e66a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.418369:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1e663 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f86 expref: 30 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.418384:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1e66a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f86 expref: 29 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.418393:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd9bb595600) 00010000:00010000:3.0:1789263766.418396:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789263766.418399:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981531600, rc 0) 00000100:00100000:3.0:1789263766.418444:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88396a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+29:11881:x1876178888637568:12345-192.168.203.20@tcp:101:bash.0 Request processed in 263us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263766.418450:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 202 00000100:00100000:3.0:1789263766.419273:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263766.419326:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888637824 00000100:00100000:0.0:1789263766.419332:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888637824 00000100:00100000:0.0:1789263766.419375:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 203 00000100:00100000:0.0:1789263766.419387:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+29:11881:x1876178888637824:12345-192.168.203.20@tcp:36:bash.0 00010000:00010000:0.0:1789263766.419575:0:7434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72800/0xce1582440fb1e671 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263766.419586:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72800/0xce1582440fb1e671 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263766.419595:0:7434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72800/0xce1582440fb1e671 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789263766.419648:0:7434:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000004:00010000:0.0:1789263766.419672:0:7434:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f34331d8 reply state 0000000032679fe7 transno 4294967464 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72800/0xce1582440fb1e671 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263766.419684:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72800/0xce1582440fb1e671 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263766.419692:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd9bb595600) 00010000:00010000:0.0:1789263766.419695:0:7434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789263766.419697:0:7434:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1789263766.419749:0:7434:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:0.0:1789263766.419823:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+33:11881:x1876178888637824:12345-192.168.203.20@tcp:36:bash.0 Request processed in 439us (554us total) trans 4294967465 rc 0/0 00000100:00100000:0.0:1789263766.419831:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 203 00000020:00080000:0.0:1789263766.419835:0:7434:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1789263766.420532:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263766.420581:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888637952 00000100:00100000:1.0:1789263766.420587:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888637952 00000100:00100000:1.0:1789263766.420624:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 204 00000100:00100000:1.0:1789263766.420632:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+33:11881:x1876178888637952:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:1.0:1789263766.420644:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263766.420655:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1e678 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11f8d expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.420686:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1e678 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f8d expref: 34 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.420699:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1e678 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f8d expref: 34 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.420727:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd9bb595600) 00010000:00010000:1.0:1789263766.420730:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789263766.420740:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd883f58800, rc 0) 00000100:00100000:1.0:1789263766.420772:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+34:11881:x1876178888637952:12345-192.168.203.20@tcp:101:bash.0 Request processed in 140us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263766.420779:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 204 00000100:00100000:2.0:1789263766.422383:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263766.422431:0:13766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888638080 00000100:00100000:1.0:1789263766.422438:0:13766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888638080 00000100:00100000:1.0:1789263766.422483:0:13766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 66 00000100:00100000:1.0:1789263766.422492:0:13766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+7:11881:x1876178888638080:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:1.0:1789263766.422505:0:13766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263766.422521:0:13766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000014c39277/0xce1582440fb1e67f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11f94 expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789263766.422543:0:13766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6aa5ff94, atime: 0x6aa5ff94, ctime: 0x6aa5ff94, blocks: 0x8 00010000:00010000:1.0:1789263766.422560:0:13766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=208s v=(0 0) 00010000:00010000:1.0:1789263766.422565:0:13766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789263766.422571:0:13766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014c39277/0xce1582440fb1e67f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f94 expref: 8 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.422585:0:13766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000014c39277/0xce1582440fb1e67f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f94 expref: 8 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.422594:0:13766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd883f59e00, rc 0) 00000100:00100000:1.0:1789263766.422632:0:13766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+8:11881:x1876178888638080:12345-192.168.203.20@tcp:101:bash.0 Request processed in 141us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263766.422639:0:13766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 66 00000100:00100000:3.0:1789263766.423728:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263766.423773:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888638208 00000100:00100000:2.0:1789263766.423777:0:8398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888638208 00002000:00010000:2.0:1789263766.423798:0:8398:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:2.0:1789263766.423801:0:8398:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dd9bfa67b80 with x1876178888638208 ext(0->18446744073709551615) 00002000:00010000:2.0:1789263766.423808:0:8398:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dd9bfa67b80. 00000100:00100000:2.0:1789263766.423829:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 5 00000100:00100000:2.0:1789263766.423836:0:8398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+8:2400:x1876178888638208:12345-192.168.203.20@tcp:10:bash.0 00002000:00010000:2.0:1789263766.424027:0:8398:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1789263766.424031:0:8398:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1789263764 -> 1789263766 00002000:00010000:2.0:1789263766.424033:0:8398:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 1789263764 -> 1789263764 00002000:00010000:2.0:1789263766.424036:0:8398:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1789263764 -> 1789263766 00002000:00010000:2.0:1789263766.424038:0:8398:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1789263766.424096:0:8398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+9:2400:x1876178888638208:12345-192.168.203.20@tcp:10:bash.0 Request processed in 260us (381us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1789263766.424102:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 5 00002000:00010000:2.0:1789263766.424104:0:8398:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:2.0:1789263766.424107:0:8398:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dd9bfa67b80 with x1876178888638208 ext(0->18446744073709551615) 00002000:00010000:2.0:1789263766.424110:0:8398:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dd9bfa67b80. 00000100:00100000:3.0:1789263766.453633:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263766.453735:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888638336 00000100:00100000:1.0:1789263766.453764:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888638336 00000100:00100000:1.0:1789263766.453842:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 205 00000100:00100000:1.0:1789263766.453854:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+34:12371:x1876178888638336:12345-192.168.203.20@tcp:34:lfs.0 00010000:00010000:1.0:1789263766.453948:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58000/0xce1582440fb1e686 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.453969:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58000/0xce1582440fb1e686 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.453980:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58000/0xce1582440fb1e686 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.453997:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1e68d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.454005:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1e68d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.454012:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1e68d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.454130:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1e694 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.454137:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1e694 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.454142:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1e694 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789263766.454197:0:6487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1e694 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.454221:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58000/0xce1582440fb1e686 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.454228:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58000/0xce1582440fb1e686 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.454236:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58000/0xce1582440fb1e686 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.454243:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883f58000 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263766.454249:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58000/0xce1582440fb1e686 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.454257:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58000/0xce1582440fb1e686 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.454270:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dd8829edc00) 00010000:00010000:1.0:1789263766.454273:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263766.454278:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58000/0xce1582440fb1e686 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.454284:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58000/0xce1582440fb1e686 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.454299:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1e68d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.454306:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1e68d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.454312:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1e68d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.454323:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883f58a00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263766.454326:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1e68d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.454332:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1e68d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.454341:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9dd8829edb00) 00010000:00010000:1.0:1789263766.454344:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263766.454346:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1e68d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.454353:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1e68d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.454369:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1e694 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.454376:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1e694 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.454382:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1e694 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.454387:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883f59000 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263766.454390:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1e694 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.454396:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1e694 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.454416:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd9bb595600) 00010000:00010000:1.0:1789263766.454418:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263766.454422:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1e694 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.454428:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1e694 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263766.454521:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+34:12371:x1876178888638336:12345-192.168.203.20@tcp:34:lfs.0 Request processed in 668us (899us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263766.454530:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 205 00000100:00100000:0.0:1789263766.473981:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263766.474125:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888638592 00000100:00100000:2.0:1789263766.474140:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888638592 00000100:00100000:2.0:1789263766.474209:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 206 00000100:00100000:2.0:1789263766.474220:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883969f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+34:12374:x1876178888638592:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:2.0:1789263766.474239:0:7434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263766.474271:0:7434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805000/0xce1582440fb1e69b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11f9b expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.474339:0:7434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805e00/0xce1582440fb1e6a2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.474354:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805e00/0xce1582440fb1e6a2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.474365:0:7434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805e00/0xce1582440fb1e6a2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.474380:0:7434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804e00/0xce1582440fb1e6a9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.474388:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804e00/0xce1582440fb1e6a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.474394:0:7434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804e00/0xce1582440fb1e6a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.474501:0:7434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805c00/0xce1582440fb1e6b0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.474512:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805c00/0xce1582440fb1e6b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.474519:0:7434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805c00/0xce1582440fb1e6b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789263766.474536:0:7434:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789263766.474629:0:7434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805e00/0xce1582440fb1e6a2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.474647:0:7434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805e00/0xce1582440fb1e6a2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.474654:0:7434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805e00/0xce1582440fb1e6a2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.474660:0:7434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bb805e00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263766.474664:0:7434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805e00/0xce1582440fb1e6a2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.474671:0:7434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805e00/0xce1582440fb1e6a2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.474684:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dd8829edc00) 00010000:00010000:2.0:1789263766.474687:0:7434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789263766.474691:0:7434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805e00/0xce1582440fb1e6a2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.474697:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805e00/0xce1582440fb1e6a2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.474710:0:7434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804e00/0xce1582440fb1e6a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.474727:0:7434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804e00/0xce1582440fb1e6a9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.474734:0:7434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804e00/0xce1582440fb1e6a9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.474740:0:7434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bb804e00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263766.474750:0:7434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804e00/0xce1582440fb1e6a9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.474758:0:7434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804e00/0xce1582440fb1e6a9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.474766:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9dd9ba858a00) 00010000:00010000:2.0:1789263766.474769:0:7434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789263766.474772:0:7434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804e00/0xce1582440fb1e6a9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.474777:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804e00/0xce1582440fb1e6a9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.474816:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805000/0xce1582440fb1e69b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f9b expref: 37 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.474829:0:7434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805c00/0xce1582440fb1e6b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f9b expref: 36 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.474837:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd9bb595600) 00010000:00010000:2.0:1789263766.474840:0:7434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789263766.474842:0:7434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bb805c00, rc 0) 00000100:00100000:2.0:1789263766.474905:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883969f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+36:12374:x1876178888638592:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 686us (937us total) trans 4294967466 rc 0/0 00000100:00100000:2.0:1789263766.474912:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 206 00000100:00100000:0.0:1789263766.477064:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263766.477160:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888638720 00000100:00100000:1.0:1789263766.477176:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888638720 00000100:00100000:1.0:1789263766.477249:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 207 00000100:00100000:1.0:1789263766.477261:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8838f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+36:12374:x1876178888638720:12345-192.168.203.20@tcp:54:lfs.0 00010000:00010000:1.0:1789263766.477341:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1e6be lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.477362:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58400/0xce1582440fb1e655 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f7f expref: 36 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.477374:0:6488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1e6be lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.477421:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58400/0xce1582440fb1e655 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f7f expref: 36 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.477433:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58400/0xce1582440fb1e655 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f7f expref: 36 pid: 6488 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263766.477458:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6488:1876178898096384:192.168.203.20@tcp:104: 00000100:00100000:1.0:1789263766.477568:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9872a5600 going to sleep for 11 seconds 00000100:00100000:3.0:1789263766.478947:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263766.478981:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6488:1876178898096384:192.168.203.20@tcp:104: 00010000:00010000:1.0:1789263766.479010:0:6488:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1e6be lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263766.479107:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888638976 00000100:00100000:2.0:1789263766.479117:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888638976 00000100:00100000:2.0:1789263766.479189:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 46 00000100:00100000:2.0:1789263766.479199:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaa6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+37:6152:x1876178888638976:12345-192.168.203.20@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789263766.479522:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaa6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+38:6152:x1876178888638976:12345-192.168.203.20@tcp:35:ldlm_bl.0 Request processed in 323us (581us total) trans 4294967467 rc 0/0 00000100:00100000:2.0:1789263766.479530:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 46 00000100:00100000:0.0:1789263766.481339:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263766.481429:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888639104 00000100:00100000:3.0:1789263766.481437:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888639104 00010000:00010000:3.0:1789263766.481473:0:6473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58400/0xce1582440fb1e655 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f7f expref: 38 pid: 6488 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263766.481503:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 93 00000100:00100000:3.0:1789263766.481522:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8838f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+38:2398:x1876178888639104:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789263766.481537:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789263766.481545:0:6473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58400/0xce1582440fb1e655 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f7f expref: 38 pid: 6488 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.481558:0:6473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58400/0xce1582440fb1e655 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f7f expref: 38 pid: 6488 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.481581:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58400/0xce1582440fb1e655 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f7f expref: 38 pid: 6488 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.481597:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd9bb595600) 00010000:00010000:3.0:1789263766.481607:0:6473:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1e6be lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.481617:0:6473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1e6be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.481624:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1e6be lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.481664:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789263766.481705:0:6488:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1e6be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263766.481711:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8838f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+37:2398:x1876178888639104:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 199us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263766.481730:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 93 00010000:00010000:1.0:1789263766.481731:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1e6be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.481773:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1e6be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.481790:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1e6be lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.481798:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1e6be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.481804:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883f59000 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263766.481808:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1e6be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.481816:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1e6be lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.481826:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd9bb595600) 00010000:00010000:1.0:1789263766.481837:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789263766.481842:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1e6be lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.481849:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1e6be lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263766.481901:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8838f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+36:12374:x1876178888638720:12345-192.168.203.20@tcp:54:lfs.0 Request processed in 4642us (4841us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263766.481909:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 207 00000100:00100000:0.0:1789263766.483351:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263766.483395:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888639360 00000100:00100000:1.0:1789263766.483401:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888639360 00000100:00100000:1.0:1789263766.483440:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 47 00000100:00100000:1.0:1789263766.483449:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8838f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+36:12374:x1876178888639360:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:1.0:1789263766.483614:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8838f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+37:12374:x1876178888639360:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 165us (264us total) trans 4294967468 rc 0/0 00000100:00100000:1.0:1789263766.483621:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 47 00000100:00100000:0.0:1789263766.516900:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263766.516952:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888639616 00000100:00100000:3.0:1789263766.516962:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888639616 00000100:00100000:3.0:1789263766.517030:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 208 00000100:00100000:3.0:1789263766.517041:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8838f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+37:12385:x1876178888639616:12345-192.168.203.20@tcp:101:cat.0 00010000:00010000:3.0:1789263766.517063:0:8417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263766.517115:0:8417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1e6c5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11fa2 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.517179:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1e6cc lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.517193:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1e6cc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.517204:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1e6cc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.517216:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1e6d3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.517223:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1e6d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.517230:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1e6d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.517350:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1e6da lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.517374:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1e6da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.517383:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1e6da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789263766.517392:0:8417:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:3.0:1789263766.517480:0:8417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1e6cc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.517494:0:8417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1e6cc lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.517505:0:8417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1e6cc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.517511:0:8417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981530e00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263766.517515:0:8417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1e6cc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.517523:0:8417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1e6cc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.517542:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dd8829edc00) 00010000:00010000:3.0:1789263766.517544:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789263766.517548:0:8417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1e6cc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.517565:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1e6cc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.517578:0:8417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1e6d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.517584:0:8417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1e6d3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.517590:0:8417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1e6d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.517595:0:8417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981530200 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263766.517598:0:8417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1e6d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.517602:0:8417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1e6d3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.517607:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9dd9bb595700) 00010000:00010000:3.0:1789263766.517609:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789263766.517610:0:8417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1e6d3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.517614:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1e6d3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.517647:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1e6c5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fa2 expref: 40 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.517656:0:8417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1e6da lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fa2 expref: 39 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.517666:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd9bb595600) 00010000:00010000:3.0:1789263766.517667:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789263766.517669:0:8417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981530600, rc 0) 00000100:00100000:3.0:1789263766.517734:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8838f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+39:12385:x1876178888639616:12345-192.168.203.20@tcp:101:cat.0 Request processed in 696us (844us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1789263766.517739:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 208 00000100:00100000:0.0:1789263766.520250:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263766.520293:0:14127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888639872 00000100:00100000:3.0:1789263766.520303:0:14127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888639872 00000100:00100000:3.0:1789263766.520343:0:14127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 48 00000100:00100000:3.0:1789263766.520349:0:14127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883f5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+39:12385:x1876178888639872:12345-192.168.203.20@tcp:35:cat.0 00000100:00100000:3.0:1789263766.520621:0:14127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883f5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+40:12385:x1876178888639872:12345-192.168.203.20@tcp:35:cat.0 Request processed in 271us (380us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1789263766.520627:0:14127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 48 00000100:00100000:0.0:1789263766.530176:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263766.530243:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888640128 00000100:00100000:2.0:1789263766.530260:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888640128 00000100:00100000:2.0:1789263766.530312:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 209 00000100:00100000:2.0:1789263766.530320:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883f5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+40:12386:x1876178888640128:12345-192.168.203.20@tcp:36:rm.0 00010000:00010000:2.0:1789263766.530368:0:7434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1789263766.530391:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1e678 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f8d expref: 40 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.530414:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1e6da lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fa2 expref: 39 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.530427:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805c00/0xce1582440fb1e6b0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f9b expref: 38 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.530451:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1e66a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f86 expref: 37 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.530463:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd9bb595600) 00010000:00010000:2.0:1789263766.530468:0:7434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789263766.530494:0:7434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805000/0xce1582440fb1e6e8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.530506:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805000/0xce1582440fb1e6e8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.530534:0:7434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805000/0xce1582440fb1e6e8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.530552:0:7434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804e00/0xce1582440fb1e6ef lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.530557:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804e00/0xce1582440fb1e6ef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.530561:0:7434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804e00/0xce1582440fb1e6ef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.530635:0:7434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805e00/0xce1582440fb1e6f6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.530643:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805e00/0xce1582440fb1e6f6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.530650:0:7434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805e00/0xce1582440fb1e6f6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789263766.530857:0:7434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:2.0:1789263766.530869:0:7434:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 208820791436ns, next at 209820788649ns, rc = 0 00010000:00010000:2.0:1789263766.530912:0:7434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804a00/0xce1582440fb1e6fd lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.530919:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804a00/0xce1582440fb1e6fd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.530924:0:7434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804a00/0xce1582440fb1e6fd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.530938:0:7434:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804a00/0xce1582440fb1e6fd lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.530945:0:7434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804a00/0xce1582440fb1e6fd lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.530950:0:7434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804a00/0xce1582440fb1e6fd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.530969:0:7434:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789263766.530985:0:7434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805e00/0xce1582440fb1e6f6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.530992:0:7434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805e00/0xce1582440fb1e6f6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.530998:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789263766.530999:0:7434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805e00/0xce1582440fb1e6f6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.531008:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804a00/0xce1582440fb1e6fd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.531009:0:7434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bb805e00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263766.531016:0:7434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805e00/0xce1582440fb1e6f6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.531019:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bb804a00 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:3.0:1789263766.531025:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804a00/0xce1582440fb1e6fd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.531030:0:7434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805e00/0xce1582440fb1e6f6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.531034:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804a00/0xce1582440fb1e6fd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40018480000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.531042:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd9bb595600) 00010000:00010000:2.0:1789263766.531047:0:7434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789263766.531051:0:7434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805e00/0xce1582440fb1e6f6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.531056:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd9bb595600) 00010000:00010000:3.0:1789263766.531060:0:6476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789263766.531069:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805e00/0xce1582440fb1e6f6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.531073:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804a00/0xce1582440fb1e6fd lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.531102:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804a00/0xce1582440fb1e6fd lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.531112:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263766.531114:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263766.531115:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789263766.531133:0:7434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805000/0xce1582440fb1e6e8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.531141:0:7434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805000/0xce1582440fb1e6e8 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.531147:0:7434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805000/0xce1582440fb1e6e8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.531152:0:7434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bb805000 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263766.531156:0:7434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805000/0xce1582440fb1e6e8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.531161:0:7434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805000/0xce1582440fb1e6e8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.531169:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dd8829edc00) 00010000:00010000:2.0:1789263766.531172:0:7434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789263766.531175:0:7434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805000/0xce1582440fb1e6e8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.531181:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805000/0xce1582440fb1e6e8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789263766.531190:0:7434:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c3733598 reply state 000000008d3d726b transno 4294967471 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804e00/0xce1582440fb1e6ef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.531198:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804e00/0xce1582440fb1e6ef lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.531208:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9dd9ba858a00) 00010000:00010000:2.0:1789263766.531209:0:7434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789263766.531211:0:7434:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789263766.531268:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883f5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+38:12386:x1876178888640128:12345-192.168.203.20@tcp:36:rm.0 Request processed in 948us (1102us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1789263766.531275:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 209 00000100:00100000:0.0:1789263766.550247:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263766.550323:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888640384 00000100:00100000:1.0:1789263766.550333:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888640384 00000100:00100000:1.0:1789263766.550392:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 210 00000100:00100000:1.0:1789263766.550402:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883f5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+38:12392:x1876178888640384:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:1.0:1789263766.550437:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263766.550462:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1e704 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11fa9 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.550577:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1e70b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.550594:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1e70b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.550620:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1e70b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.550633:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58000/0xce1582440fb1e712 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.550643:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58000/0xce1582440fb1e712 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.550650:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58000/0xce1582440fb1e712 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789263766.550966:0:6488:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:1.0:1789263766.551124:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1e719 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.551133:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1e719 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.551141:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1e719 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.551173:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1e70b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.551180:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1e70b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.551186:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1e70b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.551192:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883f58a00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263766.551204:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1e70b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.551212:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1e70b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.551225:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dd8829edc00) 00010000:00010000:1.0:1789263766.551229:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263766.551234:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1e70b lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.551240:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1e70b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789263766.551252:0:6488:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a4c94746 reply state 0000000066294648 transno 4294967472 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58000/0xce1582440fb1e712 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.551263:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58000/0xce1582440fb1e712 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.551269:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9dd9ba858a00) 00010000:00010000:1.0:1789263766.551271:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789263766.551274:0:6488:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789263766.551302:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1e704 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fa9 expref: 41 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.551316:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1e719 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fa9 expref: 40 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.551324:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd8829edb00) 00010000:00010000:1.0:1789263766.551326:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789263766.551335:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd883f58800, rc 0) 00000100:00100000:1.0:1789263766.551402:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883f5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+41:12392:x1876178888640384:12345-192.168.203.20@tcp:101:bash.0 Request processed in 1002us (1165us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1789263766.551410:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 210 00000100:00100000:0.0:1789263766.554155:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263766.554208:0:8392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888640512 00000100:00100000:1.0:1789263766.554216:0:8392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888640512 00000100:00100000:1.0:1789263766.554270:0:8392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 67 00000100:00100000:1.0:1789263766.554280:0:8392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883f5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+7:2397:x1876178888640512:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:1.0:1789263766.554296:0:8392:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263766.554312:0:8392:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb55233c/0xce1582440fb1e727 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11fb0 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789263766.554331:0:8392:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789263766.554347:0:8392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=208s v=(0 0) 00010000:00010000:1.0:1789263766.554350:0:8392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789263766.554357:0:8392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb55233c/0xce1582440fb1e727 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fb0 expref: 8 pid: 8392 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.554371:0:8392:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cb55233c/0xce1582440fb1e727 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fb0 expref: 8 pid: 8392 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.554381:0:8392:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd883f58400, rc 0) 00000100:00100000:1.0:1789263766.554434:0:8392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883f5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+8:2397:x1876178888640512:12345-192.168.203.20@tcp:101:bash.0 Request processed in 155us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263766.554442:0:8392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 67 00000100:00100000:0.0:1789263766.555537:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263766.555579:0:8511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888640640 00000100:00100000:3.0:1789263766.555585:0:8511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888640640 00000100:00100000:3.0:1789263766.555637:0:8511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 68 00000100:00100000:3.0:1789263766.555644:0:8511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883f5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+8:12392:x1876178888640640:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:3.0:1789263766.555654:0:8511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263766.555664:0:8511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b24c9ac/0xce1582440fb1e72e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11fb7 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.555685:0:8511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cb55233c/0xce1582440fb1e727 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fb0 expref: 9 pid: 8392 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.555692:0:8511:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789263766.555695:0:8511:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789263766.555699:0:8511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b24c9ac/0xce1582440fb1e72e lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fb7 expref: 9 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.555741:0:8511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cb55233c/0xce1582440fb1e727 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fb0 expref: 9 pid: 8392 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.555754:0:8511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cb55233c/0xce1582440fb1e727 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fb0 expref: 9 pid: 8392 timeout: 308 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263766.555780:0:8511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8511:1876178898096512:192.168.203.20@tcp:104: 00000100:00100000:3.0:1789263766.555857:0:8511:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd882b9a300 going to sleep for 11 seconds 00000100:00100000:0.0:1789263766.556583:0:8511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8511:1876178898096512:192.168.203.20@tcp:104: 00010000:00010000:0.0:1789263766.556608:0:8511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009b24c9ac/0xce1582440fb1e72e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fb7 expref: 9 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263766.556633:0:8511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981530c00, rc 0) 00000100:00100000:0.0:1789263766.556673:0:8511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883f5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+9:12392:x1876178888640640:12345-192.168.203.20@tcp:101:bash.0 Request processed in 1028us (1137us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263766.556688:0:8511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 68 00000100:00100000:3.0:1789263766.556776:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263766.556814:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888640768 00000100:00100000:1.0:1789263766.556821:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888640768 00010000:00010000:1.0:1789263766.556851:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cb55233c/0xce1582440fb1e727 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fb0 expref: 9 pid: 8392 timeout: 308 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263766.556892:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 94 00000100:00100000:1.0:1789263766.556901:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaa6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+9:2398:x1876178888640768:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789263766.556913:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789263766.556927:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cb55233c/0xce1582440fb1e727 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fb0 expref: 9 pid: 8392 timeout: 308 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.556936:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cb55233c/0xce1582440fb1e727 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fb0 expref: 9 pid: 8392 timeout: 308 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.556951:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb55233c/0xce1582440fb1e727 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fb0 expref: 9 pid: 8392 timeout: 308 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.556968:0:6474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789263766.556973:0:6474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789263766.556980:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009b24c9ac/0xce1582440fb1e72e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fb7 expref: 8 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.556989:0:6474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b24c9ac/0xce1582440fb1e72e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fb7 expref: 8 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.557014:0:6474:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009b24c9ac/0xce1582440fb1e72e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fb7 expref: 8 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263766.557039:0:6474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6474:1876178898096640:192.168.203.20@tcp:105: 00000100:00100000:1.0:1789263766.557136:0:6474:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd882684f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789263766.558102:0:6474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6474:1876178898096640:192.168.203.20@tcp:105: 00010000:00010000:1.0:1789263766.558115:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789263766.558149:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaa6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+8:2398:x1876178888640768:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 1248us (1373us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263766.558157:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 94 00000100:00100000:3.0:1789263766.558446:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263766.558566:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888641024 00000100:00100000:2.0:1789263766.558572:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888641024 00000100:00100000:2.0:1789263766.558611:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 49 00000100:00100000:2.0:1789263766.558620:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd987345050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+41:12392:x1876178888641024:12345-192.168.203.20@tcp:35:bash.0 00000100:00100000:2.0:1789263766.558875:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd987345050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+42:12392:x1876178888641024:12345-192.168.203.20@tcp:35:bash.0 Request processed in 255us (428us total) trans 4294967473 rc 0/0 00000100:00100000:2.0:1789263766.558882:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 49 00000100:00100000:2.0:1789263766.617388:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263766.617459:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888641152 00000100:00100000:3.0:1789263766.617469:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888641152 00000100:00100000:3.0:1789263766.617531:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 211 00000100:00100000:3.0:1789263766.617541:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+42:12408:x1876178888641152:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:3.0:1789263766.617570:0:8417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263766.617591:0:8417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1e735 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11fbe expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.617652:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1e73c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.617665:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1e73c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.617676:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1e73c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789263766.617728:0:8417:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1789263766.617732:0:8417:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789263766.617750:0:8417:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1e73c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.617773:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1e735 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fbe expref: 44 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.617805:0:8417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1e73c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fbe expref: 43 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.617812:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dd8829edc00) 00010000:00010000:3.0:1789263766.617815:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789263766.617819:0:8417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981530e00, rc 0) 00000100:00100000:3.0:1789263766.617879:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+43:12408:x1876178888641152:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 339us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263766.617885:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 211 00000100:00100000:3.0:1789263766.619647:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263766.619709:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888641408 00000100:00100000:2.0:1789263766.619728:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888641408 00000100:00100000:2.0:1789263766.619778:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 212 00000100:00100000:2.0:1789263766.619789:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaa5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+43:12408:x1876178888641408:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:2.0:1789263766.619804:0:7434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263766.619816:0:7434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805c00/0xce1582440fb1e743 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11fc5 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.619900:0:7434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805a00/0xce1582440fb1e74a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.619915:0:7434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1e719 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fa9 expref: 44 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.619933:0:7434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805a00/0xce1582440fb1e74a lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.619966:0:7434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1e719 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fa9 expref: 44 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.619979:0:7434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1e719 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fa9 expref: 44 pid: 6488 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263766.619992:0:7434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883e36300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7434:1876178898096768:192.168.203.20@tcp:104: 00000100:00100000:2.0:1789263766.620107:0:7434:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd8840c9a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789263766.620969:0:7434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883e36300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7434:1876178898096768:192.168.203.20@tcp:104: 00010000:00010000:2.0:1789263766.620988:0:7434:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805a00/0xce1582440fb1e74a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263766.621095:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263766.621147:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888641536 00000100:00100000:1.0:1789263766.621154:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888641536 00010000:00010000:1.0:1789263766.621178:0:6472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1e719 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fa9 expref: 45 pid: 6488 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263766.621207:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 95 00000100:00100000:1.0:1789263766.621215:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaa4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+45:2397:x1876178888641536:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789263766.621224:0:6472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789263766.621230:0:6472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1e719 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fa9 expref: 45 pid: 6488 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.621243:0:6472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1e719 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fa9 expref: 45 pid: 6488 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.621261:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1e719 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fa9 expref: 45 pid: 6488 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.621278:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd8829edb00) 00010000:00010000:1.0:1789263766.621290:0:6472:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805a00/0xce1582440fb1e74a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.621309:0:6472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805a00/0xce1582440fb1e74a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.621316:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805a00/0xce1582440fb1e74a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.621335:0:6472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789263766.621369:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaa4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+44:2397:x1876178888641536:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 154us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263766.621378:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 95 00010000:00010000:2.0:1789263766.621381:0:7434:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805a00/0xce1582440fb1e74a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.621391:0:7434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805a00/0xce1582440fb1e74a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789263766.621406:0:7434:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789263766.621512:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805c00/0xce1582440fb1e743 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fc5 expref: 45 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.621525:0:7434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805a00/0xce1582440fb1e74a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fc5 expref: 44 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.621545:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd8829edb00) 00010000:00010000:2.0:1789263766.621548:0:7434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789263766.621550:0:7434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bb805a00, rc 0) 00000100:00100000:2.0:1789263766.621584:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaa5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+44:12408:x1876178888641408:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 1797us (1943us total) trans 4294967474 rc 0/0 00000100:00100000:2.0:1789263766.621592:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 212 00000100:00100000:3.0:1789263766.623323:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263766.623381:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888641792 00000100:00100000:1.0:1789263766.623390:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888641792 00000100:00100000:1.0:1789263766.623437:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 213 00000100:00100000:1.0:1789263766.623447:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaa6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+44:12408:x1876178888641792:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:1.0:1789263766.623467:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263766.623470:0:6488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789263766.623490:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805a00/0xce1582440fb1e74a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fc5 expref: 44 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.623505:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd8829edb00) 00010000:00010000:1.0:1789263766.623513:0:6488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789263766.623526:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58400/0xce1582440fb1e758 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11fcc expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.623617:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1e75f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.623643:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1e75f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.623652:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1e75f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789263766.623663:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1789263766.623758:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58400/0xce1582440fb1e758 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fcc expref: 46 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.623772:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1e75f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fcc expref: 45 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.623779:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd8829ed300) 00010000:00010000:1.0:1789263766.623782:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789263766.623784:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd883f59000, rc 0) 00000100:00100000:1.0:1789263766.623831:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaa6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+45:12408:x1876178888641792:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 386us (514us total) trans 4294967475 rc 0/0 00000100:00100000:1.0:1789263766.623839:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 213 00000100:00100000:0.0:1789263766.626009:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263766.626054:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888641920 00000100:00100000:3.0:1789263766.626062:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888641920 00000100:00100000:3.0:1789263766.626122:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 214 00000100:00100000:3.0:1789263766.626132:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883f5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+45:12408:x1876178888641920:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:3.0:1789263766.626150:0:8417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263766.626164:0:8417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1e76d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11fd3 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.626208:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1e76d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fd3 expref: 46 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.626218:0:8417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1e76d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fd3 expref: 46 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.626246:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd8829ed300) 00010000:00010000:3.0:1789263766.626248:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789263766.626251:0:8417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981530200, rc 0) 00000100:00100000:3.0:1789263766.626293:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883f5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+46:12408:x1876178888641920:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 164us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263766.626297:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 214 00000100:00100000:0.0:1789263766.628174:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263766.628219:0:13766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888642048 00000100:00100000:1.0:1789263766.628227:0:13766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888642048 00000100:00100000:1.0:1789263766.628279:0:13766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 69 00000100:00100000:1.0:1789263766.628289:0:13766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bb95dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+8:2397:x1876178888642048:12345-192.168.203.20@tcp:1:lfs.0 00010000:00010000:1.0:1789263766.628325:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007eda2cca/0xce1582440fb1e774 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.628343:0:13766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009b24c9ac/0xce1582440fb1e72e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fb7 expref: 8 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.628361:0:13766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789263766.628366:0:13766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789263766.628372:0:13766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007eda2cca/0xce1582440fb1e774 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.628405:0:13766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009b24c9ac/0xce1582440fb1e72e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fb7 expref: 8 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.628421:0:13766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009b24c9ac/0xce1582440fb1e72e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fb7 expref: 8 pid: 8511 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263766.628446:0:13766:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13766:1876178898096896:192.168.203.20@tcp:104: 00000100:00100000:1.0:1789263766.628526:0:13766:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd882616a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789263766.629459:0:13766:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13766:1876178898096896:192.168.203.20@tcp:104: 00010000:00010000:1.0:1789263766.629479:0:13766:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007eda2cca/0xce1582440fb1e774 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263766.629663:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263766.629708:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888642176 00000100:00100000:3.0:1789263766.629768:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888642176 00002000:00100000:3.0:1789263766.629803:0:8400:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9dd883f5ca80 x1876178888642176/t0(0) o4->3ce90ea2-917f-4b54-98b0-25e051f2317f@192.168.203.20@tcp:602/0 lens 504/0 e 0 to 0 dl 1789263777 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789263766.629813:0:8400:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dd883f5ca80 with x1876178888642176 ext(0->8) 00010000:00010000:3.0:1789263766.629820:0:8400:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009b24c9ac/0xce1582440fb1e72e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fb7 expref: 9 pid: 8511 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.629834:0:8400:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009b24c9ac/0xce1582440fb1e72e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fb7 expref: 9 pid: 8511 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789263766.629842:0:8400:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9dd883f5ca80 00000100:00100000:3.0:1789263766.629866:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 3 00000100:00100000:3.0:1789263766.629874:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883f5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+9:2398:x1876178888642176:12345-192.168.203.20@tcp:4:lfs.0 00000100:00100000:3.0:1789263766.630578:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883f5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+11:2398:x1876178888642176:12345-192.168.203.20@tcp:4:lfs.0 Request processed in 702us (912us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1789263766.630587:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 3 00002000:00100000:3.0:1789263766.630595:0:8400:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9dd883f5ca80 x1876178888642176/t4294967309(0) o4->3ce90ea2-917f-4b54-98b0-25e051f2317f@192.168.203.20@tcp:602/0 lens 504/448 e 0 to 0 dl 1789263777 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789263766.630611:0:8400:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dd883f5ca80 with x1876178888642176 ext(0->8) 00010000:00010000:3.0:1789263766.630618:0:8400:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009b24c9ac/0xce1582440fb1e72e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fb7 expref: 11 pid: 8511 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.630638:0:8400:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009b24c9ac/0xce1582440fb1e72e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fb7 expref: 11 pid: 8511 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789263766.630646:0:8400:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9dd883f5ca80 00000100:00100000:0.0:1789263766.631543:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263766.631608:0:10303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888642304 00000100:00100000:2.0:1789263766.631615:0:10303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888642304 00010000:00010000:2.0:1789263766.631645:0:10303:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009b24c9ac/0xce1582440fb1e72e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fb7 expref: 11 pid: 8511 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263766.631677:0:10303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 96 00000100:00100000:2.0:1789263766.631686:0:10303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883f5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3ce90ea2-917f-4b54-98b0-25e051f2317f+11:2399:x1876178888642304:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789263766.631696:0:10303:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789263766.631711:0:10303:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789263766.631723:0:10303:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1789263766 00002000:00010000:2.0:1789263766.631726:0:10303:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1789263766 00002000:00010000:2.0:1789263766.631728:0:10303:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1789263766 00002000:00010000:2.0:1789263766.631731:0:10303:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1789263766.631738:0:10303:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009b24c9ac/0xce1582440fb1e72e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fb7 expref: 11 pid: 8511 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.631750:0:10303:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009b24c9ac/0xce1582440fb1e72e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fb7 expref: 11 pid: 8511 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.631789:0:10303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b24c9ac/0xce1582440fb1e72e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fb7 expref: 11 pid: 8511 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.631805:0:10303:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789263766.631809:0:10303:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789263766.631814:0:10303:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007eda2cca/0xce1582440fb1e774 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.631821:0:10303:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007eda2cca/0xce1582440fb1e774 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.631842:0:10303:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789263766.631866:0:13766:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007eda2cca/0xce1582440fb1e774 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.631876:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007eda2cca/0xce1582440fb1e774 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263766.631887:0:10303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883f5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3ce90ea2-917f-4b54-98b0-25e051f2317f+10:2399:x1876178888642304:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 201us (346us total) trans 0 rc 0/0 00010000:00010000:1.0:1789263766.631892:0:13766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007eda2cca/0xce1582440fb1e774 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263766.631896:0:10303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 96 00010000:00010000:1.0:1789263766.631905:0:13766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007eda2cca/0xce1582440fb1e774 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.631911:0:13766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007eda2cca/0xce1582440fb1e774 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.631916:0:13766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883f58800 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263766.631919:0:13766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007eda2cca/0xce1582440fb1e774 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.631925:0:13766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007eda2cca/0xce1582440fb1e774 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.631933:0:13766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007eda2cca/0xce1582440fb1e774 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.631939:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007eda2cca/0xce1582440fb1e774 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263766.631986:0:13766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bb95dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+9:2397:x1876178888642048:12345-192.168.203.20@tcp:1:lfs.0 Request processed in 3697us (3815us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263766.631993:0:13766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 69 00000100:00100000:0.0:1789263766.633288:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263766.633370:0:14127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888642560 00000100:00100000:3.0:1789263766.633377:0:14127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888642560 00000100:00100000:3.0:1789263766.633414:0:14127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 50 00000100:00100000:3.0:1789263766.633422:0:14127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883f5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+46:12408:x1876178888642560:12345-192.168.203.20@tcp:35:lfs.0 00000004:00010000:3.0:1789263766.633472:0:14127:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1e75f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fcc expref: 46 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789263766.633626:0:14127:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000001:00080000:3.0:1789263766.633657:0:14127:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967477 00000001:00080000:3.0:1789263766.633939:0:14127:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967478 00010000:00010000:3.0:1789263766.633972:0:14127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530800/0xce1582440fb1e77b lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.633988:0:14127:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1e76d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fd3 expref: 50 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.633997:0:14127:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530800/0xce1582440fb1e77b lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.634051:0:14127:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1e76d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fd3 expref: 50 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.634065:0:14127:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1e76d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fd3 expref: 50 pid: 8417 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263766.634125:0:14127:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa6680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14127:1876178898097024:192.168.203.20@tcp:104: 00000100:00100000:3.0:1789263766.634193:0:14127:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd882b9a780 going to sleep for 11 seconds 00000100:00100000:3.0:1789263766.635230:0:14127:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa6680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14127:1876178898097024:192.168.203.20@tcp:104: 00010000:00010000:3.0:1789263766.635249:0:14127:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530800/0xce1582440fb1e77b lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14127 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263766.635318:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263766.635366:0:7428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888642688 00000100:00100000:2.0:1789263766.635373:0:7428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888642688 00010000:00010000:2.0:1789263766.635400:0:7428:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1e76d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fd3 expref: 51 pid: 8417 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263766.635442:0:7428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 97 00000100:00100000:2.0:1789263766.635450:0:7428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883f5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+51:2398:x1876178888642688:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789263766.635462:0:7428:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789263766.635469:0:7428:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1e76d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fd3 expref: 51 pid: 8417 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.635496:0:7428:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1e76d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fd3 expref: 51 pid: 8417 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.635511:0:7428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1e76d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fd3 expref: 51 pid: 8417 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.635522:0:7428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd8829ed300) 00010000:00010000:2.0:1789263766.635525:0:7428:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530800/0xce1582440fb1e77b lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.635531:0:7428:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530800/0xce1582440fb1e77b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.635536:0:7428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530800/0xce1582440fb1e77b lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.635553:0:7428:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789263766.635584:0:14127:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530800/0xce1582440fb1e77b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14127 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263766.635593:0:7428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883f5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+50:2398:x1876178888642688:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 141us (274us total) trans 0 rc 0/0 00010000:00010000:3.0:1789263766.635594:0:14127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530800/0xce1582440fb1e77b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14127 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263766.635612:0:7428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 97 00000001:00080000:3.0:1789263766.635668:0:14127:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967479 00000001:00080000:3.0:1789263766.635798:0:14127:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967480 00000100:00100000:3.0:1789263766.635861:0:14127:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa6680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14127:1876178898097152:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1789263766.635907:0:14127:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263766.635931:0:14127:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9872a5600 going to sleep for 11 seconds 00000100:00100000:1.0:1789263766.635947:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898097152 00000100:00100000:1.0:1789263766.635957:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898097152 00000100:00080000:3.0:1789263766.635983:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789263766.636009:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789263766.636025:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaa4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14127:x1876178898097152:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1789263766.636130:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaa4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14127:x1876178898097152:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 107us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263766.636137:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789263766.636153:0:14127:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa6680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14127:1876178898097152:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:3.0:1789263766.636239:0:14127:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967481 00000100:00100000:3.0:1789263766.636279:0:14127:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa6680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14127:1876178898097280:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1789263766.636311:0:14127:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263766.636336:0:14127:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9b7a9e300 going to sleep for 11 seconds 00000100:00100000:0.0:1789263766.636392:0:8499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898097280 00000100:00100000:0.0:1789263766.636396:0:8499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898097280 00000100:00100000:0.0:1789263766.636420:0:8499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789263766.636425:0:8499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaa6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:14127:x1876178898097280:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1789263766.636543:0:8499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaa6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:14127:x1876178898097280:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 117us (231us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1789263766.636550:0:8499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789263766.636598:0:14127:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa6680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14127:1876178898097280:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:3.0:1789263766.636636:0:14127:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967482 00010000:00010000:3.0:1789263766.636657:0:14127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530800/0xce1582440fb1e77b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.636663:0:14127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530800/0xce1582440fb1e77b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.636667:0:14127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530800/0xce1582440fb1e77b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.636671:0:14127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981530800 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263766.636674:0:14127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530800/0xce1582440fb1e77b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.636679:0:14127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530800/0xce1582440fb1e77b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.636687:0:14127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd8829ed300) 00010000:00010000:3.0:1789263766.636689:0:14127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789263766.636692:0:14127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530800/0xce1582440fb1e77b lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.636697:0:14127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530800/0xce1582440fb1e77b lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14127 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789263766.636778:0:14127:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789263766.636826:0:14127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:3.0:1789263766.636850:0:14127:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 208926772558ns, next at 209926757351ns, rc = 0 00000001:00080000:3.0:1789263766.636863:0:14127:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967483 00010000:00010000:3.0:1789263766.636887:0:14127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd8829ed300) 00010000:00010000:3.0:1789263766.636890:0:14127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789263766.636895:0:14127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59000/0xce1582440fb1e75f lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fcc expref: 54 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263766.636982:0:14127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883f5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+53:12408:x1876178888642560:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 3550us (3688us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1789263766.636991:0:14127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 50 00000020:00080000:3.0:1789263766.636995:0:14127:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789263766.638184:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263766.638216:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888642816 00000100:00100000:2.0:1789263766.638226:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888642816 00000100:00100000:2.0:1789263766.638281:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 215 00000100:00100000:2.0:1789263766.638291:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883f5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+53:12408:x1876178888642816:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:2.0:1789263766.638310:0:7434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263766.638329:0:7434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805c00/0xce1582440fb1e782 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11fda expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.638403:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805c00/0xce1582440fb1e782 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fda expref: 54 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.638419:0:7434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805c00/0xce1582440fb1e782 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fda expref: 54 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.638437:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd9ba858400) 00010000:00010000:2.0:1789263766.638440:0:7434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789263766.638443:0:7434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bb805c00, rc 0) 00000100:00100000:2.0:1789263766.638490:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883f5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+54:12408:x1876178888642816:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 202us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263766.638497:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 215 00000100:00100000:0.0:1789263766.639974:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263766.640014:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888643072 00000100:00100000:2.0:1789263766.640020:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888643072 00000100:00100000:2.0:1789263766.640056:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 51 00000100:00100000:2.0:1789263766.640062:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883f5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+54:12408:x1876178888643072:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:2.0:1789263766.640280:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883f5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+55:12408:x1876178888643072:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 215us (308us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1789263766.640287:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 51 00000100:00100000:0.0:1789263766.672650:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263766.672721:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888643200 00000100:00100000:1.0:1789263766.672730:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888643200 00000100:00100000:1.0:1789263766.672794:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 216 00000100:00100000:1.0:1789263766.672804:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883f5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+55:12418:x1876178888643200:12345-192.168.203.20@tcp:34:lfs.0 00010000:00010000:1.0:1789263766.672874:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1e789 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.672886:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1e789 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.672894:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1e789 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.672901:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58400/0xce1582440fb1e790 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.672906:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58400/0xce1582440fb1e790 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.672910:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58400/0xce1582440fb1e790 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.672973:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1e797 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.672982:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1e797 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.672999:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1e797 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789263766.673037:0:6488:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1e797 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.673046:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1e789 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.673050:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1e789 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.673055:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1e789 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.673058:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883f58800 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263766.673061:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1e789 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.673066:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1e789 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.673074:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dd8829edc00) 00010000:00010000:1.0:1789263766.673099:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263766.673103:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1e789 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.673106:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1e789 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.673114:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58400/0xce1582440fb1e790 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.673123:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58400/0xce1582440fb1e790 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.673128:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58400/0xce1582440fb1e790 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.673133:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883f58400 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263766.673136:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58400/0xce1582440fb1e790 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.673142:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58400/0xce1582440fb1e790 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.673150:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9dd9ba858a00) 00010000:00010000:1.0:1789263766.673153:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263766.673156:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58400/0xce1582440fb1e790 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.673161:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58400/0xce1582440fb1e790 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.673170:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1e797 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.673175:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1e797 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.673181:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1e797 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.673185:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883f58a00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263766.673195:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1e797 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.673201:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1e797 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.673209:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd9ba858400) 00010000:00010000:1.0:1789263766.673212:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263766.673215:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1e797 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.673221:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1e797 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263766.673287:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883f5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+55:12418:x1876178888643200:12345-192.168.203.20@tcp:34:lfs.0 Request processed in 483us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263766.673295:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 216 00000100:00100000:0.0:1789263766.690780:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263766.690824:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888643456 00000100:00100000:3.0:1789263766.690834:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888643456 00000100:00100000:3.0:1789263766.690892:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 217 00000100:00100000:3.0:1789263766.690902:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882a6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+55:12421:x1876178888643456:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:3.0:1789263766.690921:0:8417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263766.690940:0:8417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530800/0xce1582440fb1e79e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11fe1 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.691007:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1e7a5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.691022:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1e7a5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.691033:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1e7a5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.691042:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1e7ac lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.691068:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1e7ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.691108:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1e7ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.691226:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1e7b3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.691234:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1e7b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.691241:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1e7b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789263766.691250:0:8417:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1789263766.691323:0:8417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1e7a5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.691330:0:8417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1e7a5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.691337:0:8417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1e7a5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.691343:0:8417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981530200 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263766.691347:0:8417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1e7a5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.691355:0:8417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1e7a5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.691377:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dd8829edc00) 00010000:00010000:3.0:1789263766.691380:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789263766.691385:0:8417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1e7a5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.691391:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1e7a5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.691405:0:8417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1e7ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.691411:0:8417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1e7ac lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.691417:0:8417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1e7ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.691422:0:8417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981530c00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263766.691425:0:8417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1e7ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.691431:0:8417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1e7ac lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.691451:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9dd9ba858a00) 00010000:00010000:3.0:1789263766.691454:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789263766.691457:0:8417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1e7ac lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.691463:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1e7ac lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.691506:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530800/0xce1582440fb1e79e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fe1 expref: 58 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.691519:0:8417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1e7b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fe1 expref: 57 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.691527:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd9ba858400) 00010000:00010000:3.0:1789263766.691529:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789263766.691531:0:8417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981531600, rc 0) 00000100:00100000:3.0:1789263766.691588:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882a6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+57:12421:x1876178888643456:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 687us (817us total) trans 4294967486 rc 0/0 00000100:00100000:3.0:1789263766.691595:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 217 00000100:00100000:0.0:1789263766.693195:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263766.693259:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888643584 00000100:00100000:2.0:1789263766.693267:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888643584 00000100:00100000:2.0:1789263766.693307:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 218 00000100:00100000:2.0:1789263766.693315:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882a6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+57:12421:x1876178888643584:12345-192.168.203.20@tcp:54:lfs.0 00010000:00010000:2.0:1789263766.693360:0:7434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1e7c1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.693381:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1e7c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.693388:0:7434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1e7c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.693409:0:7434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1e7c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.693413:0:7434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1e7c1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.693417:0:7434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1e7c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.693421:0:7434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bb804400 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263766.693423:0:7434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1e7c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.693427:0:7434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1e7c1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.693432:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd9ba858400) 00010000:00010000:2.0:1789263766.693442:0:7434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789263766.693453:0:7434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1e7c1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.693460:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1e7c1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263766.693509:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882a6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+57:12421:x1876178888643584:12345-192.168.203.20@tcp:54:lfs.0 Request processed in 195us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263766.693522:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 218 00000100:00100000:0.0:1789263766.694504:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263766.694538:0:14127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888643840 00000100:00100000:3.0:1789263766.694543:0:14127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888643840 00000100:00100000:3.0:1789263766.694581:0:14127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 52 00000100:00100000:3.0:1789263766.694589:0:14127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882a6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+57:12421:x1876178888643840:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:3.0:1789263766.694779:0:14127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882a6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+58:12421:x1876178888643840:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 189us (276us total) trans 4294967487 rc 0/0 00000100:00100000:3.0:1789263766.694787:0:14127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 52 00000100:00100000:3.0:1789263766.721674:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263766.721748:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888644096 00000100:00100000:1.0:1789263766.721757:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888644096 00000100:00100000:1.0:1789263766.721812:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 219 00000100:00100000:1.0:1789263766.721824:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaa5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+58:12431:x1876178888644096:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:1.0:1789263766.721847:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263766.721850:0:6488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789263766.721876:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1e73c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fbe expref: 58 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.721894:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dd8829edc00) 00010000:00010000:1.0:1789263766.721899:0:6488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789263766.721912:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1e7c8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11fe8 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.722029:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58400/0xce1582440fb1e7cf lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.722042:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1e7b3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fe1 expref: 58 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.722051:0:6488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58400/0xce1582440fb1e7cf lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.722114:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1e7b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fe1 expref: 58 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.722127:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1e7b3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fe1 expref: 58 pid: 8417 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263766.722142:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6488:1876178898097408:192.168.203.20@tcp:104: 00000100:00100000:1.0:1789263766.722233:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd882616a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789263766.724276:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263766.724280:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6488:1876178898097408:192.168.203.20@tcp:104: 00010000:00010000:1.0:1789263766.724318:0:6488:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58400/0xce1582440fb1e7cf lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263766.724333:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888644224 00000100:00100000:2.0:1789263766.724341:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888644224 00010000:00010000:2.0:1789263766.724368:0:8409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1e7b3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fe1 expref: 59 pid: 8417 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263766.724408:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 98 00000100:00100000:2.0:1789263766.724417:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd991533850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+59:2397:x1876178888644224:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789263766.724429:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789263766.724437:0:8409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1e7b3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fe1 expref: 59 pid: 8417 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.724448:0:8409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1e7b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fe1 expref: 59 pid: 8417 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.724466:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1e7b3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fe1 expref: 59 pid: 8417 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.724480:0:8409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd9ba858400) 00010000:00010000:2.0:1789263766.724485:0:8409:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58400/0xce1582440fb1e7cf lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.724494:0:8409:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58400/0xce1582440fb1e7cf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.724513:0:8409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58400/0xce1582440fb1e7cf lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.724544:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789263766.724574:0:6488:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58400/0xce1582440fb1e7cf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.724581:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58400/0xce1582440fb1e7cf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263766.724590:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd991533850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+58:2397:x1876178888644224:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 173us (319us total) trans 0 rc 0/0 00000004:00200000:1.0:1789263766.724595:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00000100:00100000:2.0:1789263766.724597:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 98 00010000:00010000:1.0:1789263766.724727:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1e7c8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fe8 expref: 59 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.724745:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58400/0xce1582440fb1e7cf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fe8 expref: 58 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.724752:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd9ba858400) 00010000:00010000:1.0:1789263766.724755:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789263766.724758:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd883f58400, rc 0) 00000100:00100000:1.0:1789263766.724785:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaa5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+58:12431:x1876178888644096:12345-192.168.203.20@tcp:101:bash.0 Request processed in 2964us (3116us total) trans 4294967488 rc 0/0 00000100:00100000:1.0:1789263766.724801:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 219 00000100:00100000:0.0:1789263766.725779:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263766.725832:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888644352 00000100:00100000:3.0:1789263766.725839:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888644352 00000100:00100000:3.0:1789263766.725877:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 220 00000100:00100000:3.0:1789263766.725886:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882a6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+58:12431:x1876178888644352:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:3.0:1789263766.725904:0:8417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263766.725925:0:8417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1e7dd lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11fef expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.725967:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530800/0xce1582440fb1e7e4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.725978:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530800/0xce1582440fb1e7e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.725987:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530800/0xce1582440fb1e7e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.726070:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1e7dd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fef expref: 60 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.726121:0:8417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530800/0xce1582440fb1e7e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fef expref: 59 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.726130:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd9ba858400) 00010000:00010000:3.0:1789263766.726134:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789263766.726136:0:8417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981530800, rc 0) 00000100:00100000:3.0:1789263766.726170:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882a6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+59:12431:x1876178888644352:12345-192.168.203.20@tcp:101:bash.0 Request processed in 285us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263766.726177:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 220 00000100:00100000:3.0:1789263766.727245:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263766.727298:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888644608 00000100:00100000:0.0:1789263766.727305:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888644608 00000100:00100000:0.0:1789263766.727348:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 221 00000100:00100000:0.0:1789263766.727356:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaa6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+59:12431:x1876178888644608:12345-192.168.203.20@tcp:36:bash.0 00010000:00010000:0.0:1789263766.727527:0:7434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72e00/0xce1582440fb1e7eb lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263766.727539:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72e00/0xce1582440fb1e7eb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263766.727547:0:7434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72e00/0xce1582440fb1e7eb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789263766.727587:0:7434:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000004:00010000:0.0:1789263766.727605:0:7434:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000983555c7 reply state 00000000886fb9bc transno 4294967490 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72e00/0xce1582440fb1e7eb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263766.727614:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72e00/0xce1582440fb1e7eb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263766.727618:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd9ba858400) 00010000:00010000:0.0:1789263766.727620:0:7434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789263766.727622:0:7434:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789263766.727679:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaa6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+62:12431:x1876178888644608:12345-192.168.203.20@tcp:36:bash.0 Request processed in 324us (438us total) trans 4294967490 rc 0/0 00000100:00100000:0.0:1789263766.727686:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 221 00000020:00080000:0.0:1789263766.727690:0:7434:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789263766.728495:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263766.728553:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888644736 00000100:00100000:1.0:1789263766.728559:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888644736 00000100:00100000:1.0:1789263766.728595:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 222 00000100:00100000:1.0:1789263766.728602:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989afce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+62:12431:x1876178888644736:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:1.0:1789263766.728615:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263766.728625:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1e7f2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11ff6 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.728672:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1e7f9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.728684:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58400/0xce1582440fb1e7cf lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fe8 expref: 63 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.728693:0:6488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1e7f9 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.728748:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58400/0xce1582440fb1e7cf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fe8 expref: 63 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.728761:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58400/0xce1582440fb1e7cf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fe8 expref: 63 pid: 6488 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263766.728781:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6488:1876178898097536:192.168.203.20@tcp:104: 00000100:00100000:1.0:1789263766.728854:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd882616a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789263766.729728:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6488:1876178898097536:192.168.203.20@tcp:104: 00010000:00010000:1.0:1789263766.729747:0:6488:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1e7f9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263766.729999:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263766.730028:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888644864 00000100:00100000:3.0:1789263766.730034:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888644864 00010000:00010000:3.0:1789263766.730111:0:6473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58400/0xce1582440fb1e7cf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fe8 expref: 64 pid: 6488 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263766.730160:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 99 00000100:00100000:3.0:1789263766.730170:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989aff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+64:2398:x1876178888644864:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789263766.730181:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789263766.730187:0:6473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58400/0xce1582440fb1e7cf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fe8 expref: 64 pid: 6488 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.730199:0:6473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58400/0xce1582440fb1e7cf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fe8 expref: 64 pid: 6488 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.730217:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58400/0xce1582440fb1e7cf lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fe8 expref: 64 pid: 6488 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.730231:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd9ba858400) 00010000:00010000:3.0:1789263766.730235:0:6473:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1e7f9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.730241:0:6473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1e7f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.730246:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1e7f9 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.730264:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789263766.730279:0:6488:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1e7f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.730286:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1e7f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263766.730302:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989aff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+63:2398:x1876178888644864:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 135us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263766.730313:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 99 00000004:00200000:1.0:1789263766.730320:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1789263766.730325:0:6488:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789263766.730343:0:6488:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1e7f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.730390:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1e7f2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ff6 expref: 63 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.730406:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1e7f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ff6 expref: 62 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.730426:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd9ba858400) 00010000:00010000:1.0:1789263766.730428:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789263766.730436:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd883f59800, rc 0) 00000100:00100000:1.0:1789263766.730468:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989afce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+62:12431:x1876178888644736:12345-192.168.203.20@tcp:101:bash.0 Request processed in 1866us (1973us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263766.730475:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 222 00000100:00100000:0.0:1789263766.731589:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263766.731681:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888645120 00000100:00100000:2.0:1789263766.731686:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888645120 00000100:00100000:2.0:1789263766.731736:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 53 00000100:00100000:2.0:1789263766.731744:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989afd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+62:12431:x1876178888645120:12345-192.168.203.20@tcp:35:bash.0 00000100:00100000:2.0:1789263766.731898:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989afd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+63:12431:x1876178888645120:12345-192.168.203.20@tcp:35:bash.0 Request processed in 154us (312us total) trans 4294967491 rc 0/0 00000100:00100000:2.0:1789263766.731905:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 53 00000100:00100000:3.0:1789263766.756683:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263766.756765:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888645248 00000100:00100000:0.0:1789263766.756779:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888645248 00000100:00100000:0.0:1789263766.756826:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 223 00000100:00100000:0.0:1789263766.756834:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaa4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+63:12437:x1876178888645248:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:0.0:1789263766.756856:0:8417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263766.756885:0:8417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73800/0xce1582440fb1e800 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d11ffd expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263766.756943:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72c00/0xce1582440fb1e807 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263766.756964:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72c00/0xce1582440fb1e807 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263766.756976:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72c00/0xce1582440fb1e807 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789263766.757017:0:8417:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1789263766.757020:0:8417:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789263766.757037:0:8417:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72c00/0xce1582440fb1e807 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263766.757062:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73800/0xce1582440fb1e800 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ffd expref: 65 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263766.757116:0:8417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72c00/0xce1582440fb1e807 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ffd expref: 64 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263766.757123:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dd8829edc00) 00010000:00010000:0.0:1789263766.757125:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789263766.757129:0:8417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd883e72c00, rc 0) 00000100:00100000:0.0:1789263766.757201:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaa4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+64:12437:x1876178888645248:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 367us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263766.757206:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 223 00000100:00100000:0.0:1789263766.759053:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263766.759211:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888645376 00000100:00100000:2.0:1789263766.759219:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888645376 00000100:00100000:2.0:1789263766.759273:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 224 00000100:00100000:2.0:1789263766.759282:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9907a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+64:12437:x1876178888645376:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:2.0:1789263766.759297:0:7434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263766.759312:0:7434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804c00/0xce1582440fb1e80e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d12004 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.759364:0:7434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805600/0xce1582440fb1e815 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.759386:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805600/0xce1582440fb1e815 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.759396:0:7434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805600/0xce1582440fb1e815 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.759425:0:7434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1e81c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.759432:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1e81c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.759449:0:7434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1e81c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.759525:0:7434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804000/0xce1582440fb1e823 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.759532:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804000/0xce1582440fb1e823 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.759537:0:7434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804000/0xce1582440fb1e823 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789263766.759572:0:7434:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789263766.759576:0:7434:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789263766.759592:0:7434:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804000/0xce1582440fb1e823 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.759603:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804000/0xce1582440fb1e823 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.759611:0:7434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805600/0xce1582440fb1e815 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.759617:0:7434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805600/0xce1582440fb1e815 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.759644:0:7434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805600/0xce1582440fb1e815 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.759650:0:7434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bb805600 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263766.759654:0:7434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805600/0xce1582440fb1e815 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.759670:0:7434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805600/0xce1582440fb1e815 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.759683:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dd8829edc00) 00010000:00010000:2.0:1789263766.759687:0:7434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789263766.759692:0:7434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805600/0xce1582440fb1e815 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.759698:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805600/0xce1582440fb1e815 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.759710:0:7434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1e81c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.759728:0:7434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1e81c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.759734:0:7434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1e81c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.759739:0:7434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bb805800 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263766.759741:0:7434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1e81c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.759757:0:7434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1e81c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.759767:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9dd9ba858a00) 00010000:00010000:2.0:1789263766.759769:0:7434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789263766.759772:0:7434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1e81c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.759777:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1e81c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.759802:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804c00/0xce1582440fb1e80e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12004 expref: 66 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.759816:0:7434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804000/0xce1582440fb1e823 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12004 expref: 65 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.759823:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd9ba858400) 00010000:00010000:2.0:1789263766.759834:0:7434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789263766.759837:0:7434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bb804000, rc 0) 00000100:00100000:2.0:1789263766.759889:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9907a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+65:12437:x1876178888645376:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 607us (841us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263766.759897:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 224 00000100:00100000:2.0:1789263766.761194:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263766.761258:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888645504 00000100:00100000:1.0:1789263766.761265:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888645504 00000100:00100000:1.0:1789263766.761312:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 13 00000100:00100000:1.0:1789263766.761321:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e36300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+65:2397:x1876178888645504:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789263766.761334:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789263766.761352:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804000/0xce1582440fb1e823 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12004 expref: 65 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.761366:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd9ba858400) 00010000:00010000:1.0:1789263766.761370:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789263766.761411:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e36300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+64:2397:x1876178888645504:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 90us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263766.761419:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 13 00000100:00100000:3.0:1789263766.761514:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263766.761623:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888645760 00000100:00100000:1.0:1789263766.761628:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888645760 00000100:00100000:1.0:1789263766.761663:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 225 00000100:00100000:1.0:1789263766.761671:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989ae3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+64:12437:x1876178888645760:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:1.0:1789263766.761686:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263766.761698:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1e82a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d1200b expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.761802:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1e831 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.761816:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1e7f9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ff6 expref: 65 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.761823:0:6488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1e831 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.761859:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1e7f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ff6 expref: 65 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.761873:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1e7f9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ff6 expref: 65 pid: 6488 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263766.761887:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6488:1876178898097664:192.168.203.20@tcp:104: 00000100:00100000:1.0:1789263766.761945:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd882616a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789263766.762794:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6488:1876178898097664:192.168.203.20@tcp:104: 00010000:00010000:1.0:1789263766.762812:0:6488:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1e831 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263766.763056:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263766.763114:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888645888 00000100:00100000:1.0:1789263766.763120:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888645888 00010000:00010000:1.0:1789263766.763150:0:6472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1e7f9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ff6 expref: 66 pid: 6488 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263766.763174:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 100 00000100:00100000:1.0:1789263766.763191:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9907a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+66:2398:x1876178888645888:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789263766.763204:0:6472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789263766.763210:0:6472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1e7f9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ff6 expref: 66 pid: 6488 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.763222:0:6472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1e7f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ff6 expref: 66 pid: 6488 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.763237:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1e7f9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ff6 expref: 66 pid: 6488 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.763246:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd9ba858400) 00010000:00010000:1.0:1789263766.763249:0:6472:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1e831 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.763256:0:6472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1e831 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.763265:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1e831 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263766.763289:0:6472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789263766.763311:0:6488:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1e831 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.763319:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1e831 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263766.763330:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9907a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+65:2398:x1876178888645888:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 139us (274us total) trans 0 rc 0/0 00000004:00200000:2.0:1789263766.763336:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000100:00100000:1.0:1789263766.763339:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 100 00010000:00010000:2.0:1789263766.763467:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1e82a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1200b expref: 66 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.763482:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1e831 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1200b expref: 65 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.763489:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd9ba858400) 00010000:00010000:2.0:1789263766.763492:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789263766.763494:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd883f58a00, rc 0) 00000100:00100000:2.0:1789263766.763746:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989ae3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+65:12437:x1876178888645760:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 1857us (2014us total) trans 4294967492 rc 0/0 00000100:00100000:2.0:1789263766.763753:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 225 00000100:00100000:0.0:1789263766.765596:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263766.765647:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888646144 00000100:00100000:3.0:1789263766.765656:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888646144 00000100:00100000:3.0:1789263766.765726:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 14 00000100:00100000:3.0:1789263766.765740:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9907a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+65:12437:x1876178888646144:12345-192.168.203.20@tcp:103:lfs.0 00010000:00010000:3.0:1789263766.765751:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789263766.765771:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805c00/0xce1582440fb1e782 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fda expref: 65 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263766.765788:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd9ba858400) 00010000:00010000:3.0:1789263766.765792:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789263766.765834:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9907a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+64:12437:x1876178888646144:12345-192.168.203.20@tcp:103:lfs.0 Request processed in 100us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263766.765841:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 14 00000100:00100000:3.0:1789263766.766626:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263766.766669:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888646272 00000100:00100000:0.0:1789263766.766674:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888646272 00000100:00100000:0.0:1789263766.766723:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 226 00000100:00100000:0.0:1789263766.766733:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+64:12437:x1876178888646272:12345-192.168.203.20@tcp:58:lfs.0 00010000:00010000:0.0:1789263766.766836:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72200/0xce1582440fb1e83f lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263766.766850:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72200/0xce1582440fb1e83f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263766.766860:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72200/0xce1582440fb1e83f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789263766.766944:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1789263766.767003:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+64:12437:x1876178888646272:12345-192.168.203.20@tcp:58:lfs.0 Request processed in 273us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263766.767011:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 226 00000100:00100000:0.0:1789263766.768116:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263766.768151:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888646400 00000100:00100000:2.0:1789263766.768158:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888646400 00000100:00100000:2.0:1789263766.768197:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 227 00000100:00100000:2.0:1789263766.768205:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9907a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+64:12437:x1876178888646400:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:2.0:1789263766.768217:0:7434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263766.768236:0:7434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804c00/0xce1582440fb1e846 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d12012 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.768275:0:7434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72200/0xce1582440fb1e83f lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.768283:0:7434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804c00/0xce1582440fb1e846 lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12012 expref: 65 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.768327:0:7434:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72200/0xce1582440fb1e83f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.768341:0:7434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804c00/0xce1582440fb1e846 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12012 expref: 65 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.768359:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd9ba858400) 00010000:00010000:2.0:1789263766.768362:0:7434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789263766.768369:0:7434:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804c00/0xce1582440fb1e846 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12012 expref: 65 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263766.768377:0:7434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bb804c00, rc 0) 00000100:00100000:2.0:1789263766.768419:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9907a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+65:12437:x1876178888646400:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 215us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263766.768425:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 227 00010000:00010000:0.0:1789263766.957462:0:13689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789263767.405314:0:13757:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789263767.405325:0:13757:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789263767.405356:0:13757:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 6 00000040:00080000:1.0:1789263767.405364:0:13757:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789263767.405565:0:13757:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7fb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13757:1876178898097792:192.168.203.20@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789263767.405826:0:13757:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd983a4fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1789263767.407673:0:13757:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7fb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13757:1876178898097792:192.168.203.20@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789263767.407675:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263767.407871:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888646528 00000100:00100000:2.0:1789263767.407887:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888646528 00000100:00080000:3.0:1789263767.407968:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789263767.407992:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 228 00000100:00100000:2.0:1789263767.408005:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9907a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+65:12438:x1876178888646528:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789263767.408046:0:6488:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789263767.408212:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9907a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+65:12438:x1876178888646528:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 Request processed in 209us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263767.408219:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 228 00000100:00100000:3.0:1789263767.409343:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263767.409398:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888646656 00000100:00100000:0.0:1789263767.409406:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888646656 00000100:00100000:0.0:1789263767.409473:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 229 00000100:00100000:0.0:1789263767.409495:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+65:12438:x1876178888646656:12345-192.168.203.20@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789263767.409562:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73e00/0xce1582440fb1e84d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.409586:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73e00/0xce1582440fb1e84d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.409598:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73e00/0xce1582440fb1e84d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.409650:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73600/0xce1582440fb1e854 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.409658:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73600/0xce1582440fb1e854 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.409665:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73600/0xce1582440fb1e854 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.409686:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73a00/0xce1582440fb1e85b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.409694:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73a00/0xce1582440fb1e85b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.409700:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73a00/0xce1582440fb1e85b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789263767.409754:0:8417:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789263767.409758:0:8417:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789263767.409770:0:8417:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73a00/0xce1582440fb1e85b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.409791:0:8417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73e00/0xce1582440fb1e84d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.409798:0:8417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73e00/0xce1582440fb1e84d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.409805:0:8417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73e00/0xce1582440fb1e84d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.409811:0:8417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883e73e00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:0.0:1789263767.409816:0:8417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73e00/0xce1582440fb1e84d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.409832:0:8417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73e00/0xce1582440fb1e84d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.409845:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9dd8829ed700) 00010000:00010000:0.0:1789263767.409848:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789263767.409852:0:8417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73e00/0xce1582440fb1e84d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.409859:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73e00/0xce1582440fb1e84d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.409872:0:8417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73600/0xce1582440fb1e854 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.409878:0:8417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73600/0xce1582440fb1e854 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.409884:0:8417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73600/0xce1582440fb1e854 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.409895:0:8417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883e73600 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:0.0:1789263767.409898:0:8417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73600/0xce1582440fb1e854 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.409904:0:8417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73600/0xce1582440fb1e854 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.409912:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff9dd985ac9700) 00010000:00010000:0.0:1789263767.409914:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789263767.409917:0:8417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73600/0xce1582440fb1e854 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.409923:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73600/0xce1582440fb1e854 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.409935:0:8417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73a00/0xce1582440fb1e85b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.409940:0:8417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73a00/0xce1582440fb1e85b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.409945:0:8417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73a00/0xce1582440fb1e85b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.409949:0:8417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883e73a00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:0.0:1789263767.409952:0:8417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73a00/0xce1582440fb1e85b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.409957:0:8417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73a00/0xce1582440fb1e85b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.409974:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd9ba858400) 00010000:00010000:0.0:1789263767.409976:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789263767.409979:0:8417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73a00/0xce1582440fb1e85b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.409985:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73a00/0xce1582440fb1e85b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263767.410064:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+65:12438:x1876178888646656:12345-192.168.203.20@tcp:34:lhsmtool_posix.0 Request processed in 569us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263767.410073:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 229 00000100:00100000:3.0:1789263767.411299:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263767.411353:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888646912 00000100:00100000:2.0:1789263767.411360:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888646912 00000100:00100000:2.0:1789263767.411402:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 230 00000100:00100000:2.0:1789263767.411421:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+65:12438:x1876178888646912:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789263767.411442:0:7434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263767.411458:0:7434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805600/0xce1582440fb1e862 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d12019 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.411544:0:7434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1e869 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.411558:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1e869 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.411569:0:7434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1e869 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789263767.411580:0:7434:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789263767.411662:0:7434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1e869 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.411670:0:7434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1e869 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.411681:0:7434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1e869 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.411687:0:7434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bb805800 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263767.411691:0:7434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1e869 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.411698:0:7434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1e869 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.411718:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd9ba858400) 00010000:00010000:2.0:1789263767.411727:0:7434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789263767.411731:0:7434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1e869 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.411737:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1e869 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.411771:0:7434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805600/0xce1582440fb1e862 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12019 expref: 67 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.411782:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9dd8829ed700) 00010000:00010000:2.0:1789263767.411784:0:7434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789263767.411788:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805600/0xce1582440fb1e862 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12019 expref: 67 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.411798:0:7434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bb805600, rc 0) 00000100:00100000:2.0:1789263767.411845:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+66:12438:x1876178888646912:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 425us (550us total) trans 4294967493 rc 301/301 00000100:00100000:2.0:1789263767.411852:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 230 00000100:00100000:2.0:1789263767.414344:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263767.414426:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888647040 00000100:00100000:1.0:1789263767.414438:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888647040 00000100:00100000:1.0:1789263767.414505:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 231 00000100:00100000:1.0:1789263767.414518:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+66:12438:x1876178888647040:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789263767.414562:0:6488:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789263767.414696:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+66:12438:x1876178888647040:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 Request processed in 180us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263767.414704:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 231 00000100:00100000:3.0:1789263767.416025:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263767.416290:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888647296 00000100:00100000:0.0:1789263767.416303:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888647296 00000100:00100000:0.0:1789263767.416368:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 232 00000100:00100000:0.0:1789263767.416379:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+66:12438:x1876178888647296:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789263767.416525:0:8417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263767.416529:0:8417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789263767.416563:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72c00/0xce1582440fb1e807 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ffd expref: 66 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.416584:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dd8829edc00) 00010000:00010000:0.0:1789263767.416590:0:8417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789263767.416606:0:8417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73a00/0xce1582440fb1e877 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d12020 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789263767.417119:0:8417:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x6:0x0], index 0: 0 00010000:00010000:0.0:1789263767.417300:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73600/0xce1582440fb1e87e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.417337:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73600/0xce1582440fb1e87e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.417351:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73600/0xce1582440fb1e87e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.417417:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73a00/0xce1582440fb1e877 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12020 expref: 68 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.417435:0:8417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73600/0xce1582440fb1e87e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12020 expref: 67 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.417444:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9dd985ac9700) 00010000:00010000:0.0:1789263767.417446:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789263767.417449:0:8417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd883e73600, rc 0) 00000100:00100000:0.0:1789263767.417526:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+67:12438:x1876178888647296:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 1149us (1510us total) trans 4294967494 rc 0/0 00000100:00100000:0.0:1789263767.417533:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 232 00000100:00100000:3.0:1789263767.419181:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263767.419288:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888647552 00000100:00100000:2.0:1789263767.419297:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888647552 00000100:00100000:2.0:1789263767.419350:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 233 00000100:00100000:2.0:1789263767.419359:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+67:12438:x1876178888647552:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789263767.419435:0:7434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789263767.419459:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73600/0xce1582440fb1e87e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12020 expref: 67 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.419488:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9dd985ac9700) 00010000:00010000:2.0:1789263767.419498:0:7434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789263767.419518:0:7434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805600/0xce1582440fb1e88c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.419530:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805600/0xce1582440fb1e88c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.419540:0:7434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805600/0xce1582440fb1e88c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.419598:0:7434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1e893 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xc074d360 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.419606:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1e893 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xc074d360 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.419612:0:7434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1e893 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xc074d360 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.419651:0:7434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805600/0xce1582440fb1e88c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.419658:0:7434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805600/0xce1582440fb1e88c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.419664:0:7434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805600/0xce1582440fb1e88c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.419669:0:7434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bb805600 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263767.419673:0:7434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805600/0xce1582440fb1e88c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.419686:0:7434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805600/0xce1582440fb1e88c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.419703:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dd8829edc00) 00010000:00010000:2.0:1789263767.419706:0:7434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789263767.419722:0:7434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805600/0xce1582440fb1e88c lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.419728:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805600/0xce1582440fb1e88c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.419741:0:7434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1e893 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xc074d360 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.419747:0:7434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1e893 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xc074d360 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.419753:0:7434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1e893 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xc074d360 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.419758:0:7434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bb805800 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263767.419761:0:7434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1e893 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xc074d360 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.419768:0:7434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1e893 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xc074d360 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.419775:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xc074d360 (ffff9dd9ba858100) 00010000:00010000:2.0:1789263767.419777:0:7434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789263767.419780:0:7434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1e893 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xc074d360 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.419794:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1e893 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xc074d360 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263767.419867:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+66:12438:x1876178888647552:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 Request processed in 508us (693us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789263767.419875:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 233 00000100:00100000:2.0:1789263767.420829:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263767.420914:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888647680 00000100:00100000:1.0:1789263767.420921:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888647680 00000100:00100000:1.0:1789263767.420967:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 234 00000100:00100000:1.0:1789263767.420976:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+66:12438:x1876178888647680:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789263767.420989:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263767.421006:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1e89a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d12027 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263767.421034:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1e8a1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263767.421046:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1e8a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263767.421056:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1e8a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263767.421198:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1e89a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12027 expref: 68 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263767.421214:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1e8a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12027 expref: 67 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263767.421221:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9dd8829edd00) 00010000:00010000:1.0:1789263767.421223:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789263767.421225:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd883f58800, rc 0) 00000100:00100000:1.0:1789263767.421268:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+67:12438:x1876178888647680:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 292us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263767.421275:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 234 00000100:00100000:3.0:1789263767.422207:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263767.422256:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888647936 00000100:00100000:0.0:1789263767.422264:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888647936 00000100:00100000:0.0:1789263767.422316:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 235 00000100:00100000:0.0:1789263767.422328:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+67:12438:x1876178888647936:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789263767.422382:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72c00/0xce1582440fb1e8a8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.422394:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72c00/0xce1582440fb1e8a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.422413:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72c00/0xce1582440fb1e8a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789263767.422735:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00010000:0.0:1789263767.422795:0:8417:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000121e772a reply state 000000007d8d9744 transno 4294967495 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72c00/0xce1582440fb1e8a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.422808:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72c00/0xce1582440fb1e8a8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.422815:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9dd8829edd00) 00010000:00010000:0.0:1789263767.422818:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1789263767.422821:0:8417:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789263767.422898:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+69:12438:x1876178888647936:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 Request processed in 573us (694us total) trans 4294967495 rc 0/0 00000100:00100000:0.0:1789263767.422903:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 235 00000100:00100000:3.0:1789263767.423639:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263767.423679:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888648064 00000100:00100000:2.0:1789263767.423684:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888648064 00000100:00100000:2.0:1789263767.423732:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 236 00000100:00100000:2.0:1789263767.423740:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+69:12438:x1876178888648064:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789263767.423753:0:7434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263767.423765:0:7434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805400/0xce1582440fb1e8af lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d1202e expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.423799:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805400/0xce1582440fb1e8af lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1202e expref: 70 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.423814:0:7434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805400/0xce1582440fb1e8af lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1202e expref: 70 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.423830:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9dd8829edd00) 00010000:00010000:2.0:1789263767.423834:0:7434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789263767.423836:0:7434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bb805400, rc 0) 00000100:00100000:2.0:1789263767.423870:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+70:12438:x1876178888648064:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 131us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263767.423889:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 236 00000100:00100000:2.0:1789263767.425245:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263767.425331:0:8392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888648192 00000100:00100000:1.0:1789263767.425339:0:8392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888648192 00000100:00100000:1.0:1789263767.425387:0:8392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 70 00000100:00080000:3.0:1789263767.425394:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789263767.425408:0:8392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+9:2398:x1876178888648192:12345-192.168.203.20@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789263767.425586:0:8392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+10:2398:x1876178888648192:12345-192.168.203.20@tcp:2:lhsmtool_posix.0 Request processed in 181us (344us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1789263767.425594:0:8392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 70 00000100:00100000:3.0:1789263767.426470:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263767.426514:0:14127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888648448 00000100:00100000:1.0:1789263767.426521:0:14127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888648448 00000100:00100000:1.0:1789263767.426570:0:14127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 54 00000100:00100000:1.0:1789263767.426580:0:14127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd987346050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+70:12438:x1876178888648448:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789263767.426788:0:14127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd987346050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+71:12438:x1876178888648448:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 Request processed in 209us (317us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1789263767.426808:0:14127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 54 00000100:00100000:3.0:1789263767.428608:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263767.428656:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888648704 00000100:00100000:1.0:1789263767.428665:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888648704 00000100:00100000:1.0:1789263767.428725:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 237 00000100:00100000:1.0:1789263767.428737:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+71:12438:x1876178888648704:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789263767.428816:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+71:12438:x1876178888648704:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 Request processed in 84us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263767.428828:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 237 00000100:00100000:2.0:1789263767.429882:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263767.429940:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888648832 00000100:00100000:0.0:1789263767.429950:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888648832 00000100:00100000:0.0:1789263767.429988:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 238 00000100:00100000:0.0:1789263767.429997:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88396b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+71:12438:x1876178888648832:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789263767.430010:0:8417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263767.430036:0:8417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73a00/0xce1582440fb1e8b6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d12035 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.430153:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73e00/0xce1582440fb1e8bd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.430176:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73e00/0xce1582440fb1e8bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.430195:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73e00/0xce1582440fb1e8bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789263767.430236:0:8417:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789263767.430252:0:8417:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73e00/0xce1582440fb1e8bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.430276:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73a00/0xce1582440fb1e8b6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12035 expref: 73 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.430292:0:8417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73e00/0xce1582440fb1e8bd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12035 expref: 72 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.430300:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9dd8829edd00) 00010000:00010000:0.0:1789263767.430302:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789263767.430305:0:8417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd883e73e00, rc 0) 00000100:00100000:0.0:1789263767.430350:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88396b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+72:12438:x1876178888648832:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 354us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263767.430357:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 238 00000100:00100000:3.0:1789263767.432249:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263767.432298:0:8511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888648960 00000100:00100000:0.0:1789263767.432310:0:8511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888648960 00000100:00100000:0.0:1789263767.432372:0:8511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 71 00000100:00100000:0.0:1789263767.432383:0:8511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88431ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+10:2397:x1876178888648960:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789263767.432398:0:8511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263767.432417:0:8511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083027e70/0xce1582440fb1e8c4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d1203c expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789263767.432468:0:8511:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa5ff97, blocks: 0x0 00010000:00010000:0.0:1789263767.432486:0:8511:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=209s v=(0 0) 00010000:00010000:0.0:1789263767.432489:0:8511:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789263767.432497:0:8511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083027e70/0xce1582440fb1e8c4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1203c expref: 11 pid: 8511 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.432514:0:8511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000083027e70/0xce1582440fb1e8c4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1203c expref: 11 pid: 8511 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.432525:0:8511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd883e73600, rc 0) 00000100:00100000:0.0:1789263767.432574:0:8511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88431ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+11:2397:x1876178888648960:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 193us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263767.432580:0:8511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 71 00000100:00100000:3.0:1789263767.434116:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263767.434208:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888649216 00000100:00100000:2.0:1789263767.434218:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888649216 00000100:00100000:2.0:1789263767.434278:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 239 00000100:00100000:2.0:1789263767.434290:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88431df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+72:12438:x1876178888649216:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789263767.434417:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88431df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+72:12438:x1876178888649216:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 Request processed in 128us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263767.434427:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 239 00000100:00100000:2.0:1789263767.435734:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263767.435804:0:13766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888649344 00000100:00100000:1.0:1789263767.435812:0:13766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888649344 00000100:00100000:1.0:1789263767.435859:0:13766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 72 00000100:00100000:1.0:1789263767.435869:0:13766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883f5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+11:12438:x1876178888649344:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789263767.435887:0:13766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263767.435908:0:13766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2ae7395/0xce1582440fb1e8cb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d12043 expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263767.435956:0:13766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000083027e70/0xce1582440fb1e8c4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1203c expref: 12 pid: 8511 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263767.435967:0:13766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789263767.435972:0:13766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789263767.435979:0:13766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2ae7395/0xce1582440fb1e8cb lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12043 expref: 12 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263767.436020:0:13766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000083027e70/0xce1582440fb1e8c4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1203c expref: 12 pid: 8511 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263767.436053:0:13766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000083027e70/0xce1582440fb1e8c4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1203c expref: 12 pid: 8511 timeout: 309 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263767.436068:0:13766:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:13766:1876178898097920:192.168.203.20@tcp:104: 00000100:00100000:1.0:1789263767.436215:0:13766:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9915dc480 going to sleep for 11 seconds 00000100:00100000:1.0:1789263767.437378:0:13766:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:13766:1876178898097920:192.168.203.20@tcp:104: 00010000:00010000:1.0:1789263767.437426:0:13766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c2ae7395/0xce1582440fb1e8cb lrc: 3/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12043 expref: 12 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263767.437451:0:13766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd883f59800, rc 0) 00000100:00100000:2.0:1789263767.437512:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263767.437521:0:13766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883f5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+12:12438:x1876178888649344:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 1647us (1790us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263767.437535:0:13766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 72 00000100:00100000:0.0:1789263767.437578:0:7428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888649472 00000100:00100000:0.0:1789263767.437588:0:7428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888649472 00010000:00010000:0.0:1789263767.437633:0:7428:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000083027e70/0xce1582440fb1e8c4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1203c expref: 12 pid: 8511 timeout: 309 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263767.437681:0:7428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 101 00000100:00100000:0.0:1789263767.437692:0:7428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883f5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+12:2398:x1876178888649472:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789263767.437704:0:7428:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789263767.437736:0:7428:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000083027e70/0xce1582440fb1e8c4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1203c expref: 12 pid: 8511 timeout: 309 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.437767:0:7428:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000083027e70/0xce1582440fb1e8c4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1203c expref: 12 pid: 8511 timeout: 309 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.437797:0:7428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083027e70/0xce1582440fb1e8c4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1203c expref: 12 pid: 8511 timeout: 309 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.437812:0:7428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789263767.437817:0:7428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789263767.437823:0:7428:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c2ae7395/0xce1582440fb1e8cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12043 expref: 11 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.437831:0:7428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2ae7395/0xce1582440fb1e8cb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12043 expref: 11 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.437867:0:7428:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c2ae7395/0xce1582440fb1e8cb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12043 expref: 11 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263767.437880:0:7428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9907a5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7428:1876178898098048:192.168.203.20@tcp:105: 00000100:00100000:0.0:1789263767.437948:0:7428:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9bf982180 going to sleep for 11 seconds 00000100:00100000:0.0:1789263767.438968:0:7428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9907a5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7428:1876178898098048:192.168.203.20@tcp:105: 00010000:00010000:0.0:1789263767.438989:0:7428:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789263767.439026:0:7428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883f5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+11:2398:x1876178888649472:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 1335us (1517us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263767.439039:0:7428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 101 00000100:00100000:3.0:1789263767.439680:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263767.439803:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888649600 00000100:00100000:2.0:1789263767.439817:0:8398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888649600 00002000:00100000:2.0:1789263767.439890:0:8398:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff9dd88431d500 x1876178888649600/t0(0) o4->3ce90ea2-917f-4b54-98b0-25e051f2317f@192.168.203.20@tcp:603/0 lens 504/0 e 0 to 0 dl 1789263778 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789263767.439903:0:8398:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dd88431d500 with x1876178888649600 ext(0->12) 00002000:00010000:2.0:1789263767.439910:0:8398:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dd88431d500 00000100:00100000:2.0:1789263767.439954:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 6 00000100:00100000:2.0:1789263767.439965:0:8398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88431d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+11:2398:x1876178888649600:12345-192.168.203.20@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789263767.441269:0:8398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88431d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+13:2398:x1876178888649600:12345-192.168.203.20@tcp:4:lhsmtool_posix.0 Request processed in 1298us (1586us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1789263767.441282:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 6 00002000:00100000:2.0:1789263767.441300:0:8398:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff9dd88431d500 x1876178888649600/t4294967321(0) o4->3ce90ea2-917f-4b54-98b0-25e051f2317f@192.168.203.20@tcp:603/0 lens 504/448 e 0 to 0 dl 1789263778 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789263767.441320:0:8398:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dd88431d500 with x1876178888649600 ext(0->12) 00002000:00010000:2.0:1789263767.441327:0:8398:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dd88431d500 00000100:00100000:3.0:1789263767.442369:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263767.442431:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888649728 00000100:00100000:1.0:1789263767.442443:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888649728 00000100:00100000:1.0:1789263767.442495:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 240 00000100:00100000:1.0:1789263767.442506:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88431ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+72:12438:x1876178888649728:12345-192.168.203.20@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789263767.443615:0:6466:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967496 is committed 00000004:00080000:3.0:1789263767.443653:0:6466:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00010000:00010000:2.0:1789263767.443658:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1e5de lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.443670:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1e5de lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1789263767.443674:0:6466:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9dd9872a5180 refcount 2 committed 0 result 0 batchid 7 00010000:00010000:2.0:1789263767.443678:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1e5de lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1789263767.443680:0:6466:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9dd9852b6300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9dd9872a5600 00000020:00080000:3.0:1789263767.443689:0:6466:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9dd9852b6d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9dd88434ca00 00010000:00010000:2.0:1789263767.443691:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981530400 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263767.443699:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1e5de lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.443715:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1e5de lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.443734:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9dd8829ed800) 00000004:00080000:3.0:1789263767.443735:0:6466:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00010000:00010000:2.0:1789263767.443739:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000020:00080000:1.0:1789263767.443742:0:6519:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:2.0:1789263767.443746:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1e5de lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.443754:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1e5de lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1789263767.443785:0:6466:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9dd8826166c0 refcount 2 committed 0 result 0 batchid 6 00010000:00010000:2.0:1789263767.443785:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72800/0xce1582440fb1e671 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1789263767.443792:0:6466:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9dd882ad6500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9dd882616d80 00010000:00010000:2.0:1789263767.443796:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72800/0xce1582440fb1e671 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1789263767.443799:0:6466:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9dd882ad6300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9dd8840f2c00 00000100:00100000:0.0:1789263767.443800:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9907a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876178898098176:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1789263767.443815:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72800/0xce1582440fb1e671 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263767.443816:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898098304:0@lo:6:osp-syn-0-0.0 00000020:00080000:3.0:1789263767.443826:0:6466:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00010000:00010000:2.0:1789263767.443828:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883e72800 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263767.443833:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72800/0xce1582440fb1e671 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.443839:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72800/0xce1582440fb1e671 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.443848:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd9bb595600) 00010000:00010000:2.0:1789263767.443850:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789263767.443854:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72800/0xce1582440fb1e671 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.443860:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72800/0xce1582440fb1e671 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263767.443868:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1789263767.443872:0:6519:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00010000:00010000:2.0:1789263767.443878:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804e00/0xce1582440fb1e6ef lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.443885:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804e00/0xce1582440fb1e6ef lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.443891:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804e00/0xce1582440fb1e6ef lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.443896:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bb804e00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263767.443899:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804e00/0xce1582440fb1e6ef lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263767.443907:0:8392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898098176 00000100:00100000:3.0:1789263767.443915:0:8392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898098176 00010000:00010000:2.0:1789263767.443917:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804e00/0xce1582440fb1e6ef lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1789263767.443925:0:6519:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00010000:00010000:2.0:1789263767.443929:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9dd9ba858a00) 00010000:00010000:2.0:1789263767.443933:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789263767.443936:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804e00/0xce1582440fb1e6ef lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263767.443940:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789263767.443947:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804e00/0xce1582440fb1e6ef lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263767.443959:0:8392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898098304 00010000:00010000:2.0:1789263767.443961:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58000/0xce1582440fb1e712 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263767.443965:0:8392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898098304 00010000:00010000:2.0:1789263767.443970:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58000/0xce1582440fb1e712 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.443977:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58000/0xce1582440fb1e712 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.443982:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883f58000 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263767.443985:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58000/0xce1582440fb1e712 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263767.443989:0:8511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00010000:00010000:2.0:1789263767.443993:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58000/0xce1582440fb1e712 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.444004:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9dd9ba858a00) 00000100:00100000:0.0:1789263767.444008:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88431ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+24:12438:x1876178888649728:12345-192.168.203.20@tcp:44:lhsmtool_posix.0 Request processed in 1502us (1640us total) trans 0 rc 0/0 00010000:00010000:2.0:1789263767.444010:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789263767.444011:0:8511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9907a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3619:x1876178898098176:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1789263767.444015:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58000/0xce1582440fb1e712 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263767.444020:0:8392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789263767.444021:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 240 00010000:00010000:2.0:1789263767.444033:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58000/0xce1582440fb1e712 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1789263767.444033:0:8511:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00000100:00100000:3.0:1789263767.444036:0:8392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3620:x1876178898098304:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789263767.444058:0:8392:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00010000:00010000:2.0:1789263767.444060:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72e00/0xce1582440fb1e7eb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.444068:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72e00/0xce1582440fb1e7eb lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.444074:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72e00/0xce1582440fb1e7eb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263767.444103:0:8392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b24c9ac/0xce1582440fb1e8d9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.444110:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883e72e00 already unused, calling callback (ffffffffc18c14f0) 00002000:00010000:1.0:1789263767.444110:0:8511:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6aa5ff96, atime: 0x6aa5ff96, ctime: 0x6aa5ff96, blocks: 0x8 00010000:00010000:2.0:1789263767.444117:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72e00/0xce1582440fb1e7eb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263767.444124:0:8511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb55233c/0xce1582440fb1e8d2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263767.444135:0:8392:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000014c39277/0xce1582440fb1e67f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f94 expref: 12 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.444140:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72e00/0xce1582440fb1e7eb lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263767.444140:0:8511:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=209s v=(0 0) 00010000:00010000:1.0:1789263767.444151:0:8511:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789263767.444153:0:8392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789263767.444160:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd9ba858400) 00010000:00010000:3.0:1789263767.444162:0:8392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789263767.444165:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789263767.444169:0:8392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b24c9ac/0xce1582440fb1e8d9 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.444171:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72e00/0xce1582440fb1e7eb lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263767.444171:0:8511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb55233c/0xce1582440fb1e8d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.444187:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72e00/0xce1582440fb1e7eb lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263767.444207:0:8511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb55233c/0xce1582440fb1e8d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789263767.444208:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789263767.444211:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72c00/0xce1582440fb1e8a8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263767.444225:0:8511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb55233c/0xce1582440fb1e8d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.444226:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72c00/0xce1582440fb1e8a8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263767.444238:0:8511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cb55233c/0xce1582440fb1e8d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.444241:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72c00/0xce1582440fb1e8a8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.444256:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883e72c00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263767.444260:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72c00/0xce1582440fb1e8a8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.444267:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72c00/0xce1582440fb1e8a8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263767.444272:0:8511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789263767.444273:0:8392:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000014c39277/0xce1582440fb1e67f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f94 expref: 12 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.444278:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9dd8829edd00) 00010000:00010000:2.0:1789263767.444285:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789263767.444290:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72c00/0xce1582440fb1e8a8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263767.444297:0:8392:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000014c39277/0xce1582440fb1e67f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f94 expref: 12 pid: 13766 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.444299:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72c00/0xce1582440fb1e8a8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263767.444323:0:8392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88431ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8392:1876178898098432:192.168.203.20@tcp:104: 00000100:00100000:3.0:1789263767.444383:0:8392:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9b7a9e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789263767.444406:0:8511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9907a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3619:x1876178898098176:12345-0@lo:6:osp-syn-1-0.0 Request processed in 399us (539us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1789263767.444415:0:8511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000004:00080000:3.0:1789263767.444437:0:3619:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9dd9907a5c00/2, rc 0, transno 4294967311 00000100:00100000:3.0:1789263767.444444:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9907a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876178898098176:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1789263767.444458:0:13146:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789263767.444466:0:13146:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cb55233c/0xce1582440fb1e8d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.444474:0:13146:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883f58400 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:0.0:1789263767.444477:0:13146:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb55233c/0xce1582440fb1e8d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.444485:0:13146:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb55233c/0xce1582440fb1e8d2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.444500:0:13146:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cb55233c/0xce1582440fb1e8d2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.444506:0:13146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb55233c/0xce1582440fb1e8d2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.444520:0:13146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263767.444522:0:13146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263767.444524:0:13146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789263767.446496:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263767.446544:0:13766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888649856 00000100:00100000:2.0:1789263767.446550:0:13766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888649856 00000100:00100000:1.0:1789263767.446560:0:8392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88431ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8392:1876178898098432:192.168.203.20@tcp:104: 00000100:00100000:3.0:1789263767.446561:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00010000:00010000:1.0:1789263767.446592:0:8392:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009b24c9ac/0xce1582440fb1e8d9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263767.446598:0:13766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 75 00000100:00100000:0.0:1789263767.446611:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888649984 00000100:00100000:2.0:1789263767.446612:0:13766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88431dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+13:2397:x1876178888649856:12345-192.168.203.20@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1789263767.446625:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888649984 00010000:00010000:0.0:1789263767.446649:0:8409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000014c39277/0xce1582440fb1e67f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f94 expref: 14 pid: 13766 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263767.446682:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 102 00000100:00100000:0.0:1789263767.446691:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88431e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+14:2397:x1876178888649984:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789263767.446702:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789263767.446718:0:8409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000014c39277/0xce1582440fb1e67f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f94 expref: 14 pid: 13766 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.446731:0:8409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000014c39277/0xce1582440fb1e67f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f94 expref: 14 pid: 13766 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.446758:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014c39277/0xce1582440fb1e67f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11f94 expref: 14 pid: 13766 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.446772:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789263767.446775:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789263767.446781:0:8409:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009b24c9ac/0xce1582440fb1e8d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.446790:0:8409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b24c9ac/0xce1582440fb1e8d9 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.446814:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789263767.446837:0:8392:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009b24c9ac/0xce1582440fb1e8d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263767.446847:0:8392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b24c9ac/0xce1582440fb1e8d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263767.446856:0:8392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b24c9ac/0xce1582440fb1e8d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263767.446865:0:8392:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b24c9ac/0xce1582440fb1e8d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263767.446867:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88431e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+13:2397:x1876178888649984:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 176us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263767.446883:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 102 00010000:00010000:1.0:1789263767.446886:0:8392:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789263767.446903:0:7427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789263767.446911:0:7427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b24c9ac/0xce1582440fb1e8d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263767.446921:0:7427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981530c00 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:3.0:1789263767.446926:0:7427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b24c9ac/0xce1582440fb1e8d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263767.446936:0:7427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b24c9ac/0xce1582440fb1e8d9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263767.446950:0:7427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b24c9ac/0xce1582440fb1e8d9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263767.446965:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b24c9ac/0xce1582440fb1e8d9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263767.446984:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263767.446986:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263767.446988:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789263767.447227:0:8392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3620:x1876178898098304:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3194us (3288us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1789263767.447234:0:8392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000004:00080000:2.0:1789263767.447260:0:3620:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9dd98ff7fb80/2, rc 0, transno 4294967322 00000100:00100000:2.0:1789263767.447277:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898098304:0@lo:6:osp-syn-0-0.0 00000001:00080000:3.0:1789263767.447911:0:8388:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000001:00080000:3.0:1789263767.447922:0:8388:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967318 is committed 00000100:00100000:2.0:1789263767.448007:0:13766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88431dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+7:2397:x1876178888649856:12345-192.168.203.20@tcp:16:lhsmtool_posix.0 Request processed in 1399us (1516us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263767.448015:0:13766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 75 00000100:00100000:3.0:1789263767.449190:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263767.449234:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888650240 00000100:00100000:0.0:1789263767.449240:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888650240 00000100:00100000:0.0:1789263767.449279:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 241 00000100:00100000:0.0:1789263767.449290:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88431ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+21:12438:x1876178888650240:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789263767.449337:0:8417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789263767.449359:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73e00/0xce1582440fb1e8bd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12035 expref: 21 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.449374:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9dd8829edd00) 00010000:00010000:0.0:1789263767.449379:0:8417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789263767.449405:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73600/0xce1582440fb1e8e0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.449419:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73600/0xce1582440fb1e8e0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.449429:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73600/0xce1582440fb1e8e0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789263767.449526:0:8417:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000023bbb129 reply state 0000000082198cd7 transno 4294967497 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73600/0xce1582440fb1e8e0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.449538:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73600/0xce1582440fb1e8e0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.449544:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9dd8829edd00) 00010000:00010000:0.0:1789263767.449547:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789263767.449558:0:8417:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789263767.449628:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88431ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+22:12438:x1876178888650240:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 Request processed in 340us (439us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1789263767.449635:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 241 00000100:00100000:0.0:1789263767.450558:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263767.450618:0:8394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888650368 00000100:00100000:2.0:1789263767.450629:0:8394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888650368 00000100:00100000:2.0:1789263767.450665:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 76 00000100:00100000:2.0:1789263767.450673:0:8394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c09f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+7:2397:x1876178888650368:12345-192.168.203.20@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789263767.450781:0:8394:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789263767.450785:0:8394:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1789263767 00002000:00010000:2.0:1789263767.450787:0:8394:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 1789263766 00002000:00010000:2.0:1789263767.450789:0:8394:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1789263767 -> 1789263767 00002000:00010000:2.0:1789263767.450791:0:8394:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1789263767.450827:0:8394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c09f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+8:2397:x1876178888650368:12345-192.168.203.20@tcp:2:lhsmtool_posix.0 Request processed in 155us (270us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1789263767.450835:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 76 00000100:00100000:2.0:1789263767.451800:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263767.451851:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888650624 00000100:00100000:0.0:1789263767.451858:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888650624 00000100:00100000:0.0:1789263767.451897:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 242 00000100:00100000:0.0:1789263767.451903:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883f5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+22:12438:x1876178888650624:12345-192.168.203.20@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1789263767.451945:0:7434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73000/0xce1582440fb1e8e7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.451961:0:7434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1e8a1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12027 expref: 22 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.451970:0:7434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73000/0xce1582440fb1e8e7 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.452004:0:7434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1e8a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12027 expref: 22 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.452018:0:7434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1e8a1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12027 expref: 22 pid: 6488 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263767.452031:0:7434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9c09f5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7434:1876178898098560:192.168.203.20@tcp:104: 00000100:00100000:0.0:1789263767.452116:0:7434:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9bf982840 going to sleep for 11 seconds 00000100:00100000:0.0:1789263767.453245:0:7434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9c09f5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7434:1876178898098560:192.168.203.20@tcp:104: 00010000:00010000:0.0:1789263767.453266:0:7434:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73000/0xce1582440fb1e8e7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263767.453495:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263767.453532:0:10303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888650752 00000100:00100000:0.0:1789263767.453537:0:10303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888650752 00010000:00010000:0.0:1789263767.453562:0:10303:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1e8a1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12027 expref: 23 pid: 6488 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263767.453591:0:10303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 103 00000100:00100000:0.0:1789263767.453599:0:10303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd991532c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3ce90ea2-917f-4b54-98b0-25e051f2317f+23:2397:x1876178888650752:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789263767.453613:0:10303:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789263767.453620:0:10303:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1e8a1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12027 expref: 23 pid: 6488 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.453631:0:10303:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1e8a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12027 expref: 23 pid: 6488 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.453652:0:10303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58800/0xce1582440fb1e8a1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12027 expref: 23 pid: 6488 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.453666:0:10303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9dd8829edd00) 00010000:00010000:0.0:1789263767.453671:0:10303:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73000/0xce1582440fb1e8e7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.453680:0:10303:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73000/0xce1582440fb1e8e7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.453699:0:10303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73000/0xce1582440fb1e8e7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.453733:0:10303:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789263767.453769:0:7434:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73000/0xce1582440fb1e8e7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.453779:0:7434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73000/0xce1582440fb1e8e7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263767.453783:0:10303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd991532c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3ce90ea2-917f-4b54-98b0-25e051f2317f+22:2397:x1876178888650752:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 182us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263767.453796:0:10303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 103 00010000:00010000:2.0:1789263767.453826:0:7434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73000/0xce1582440fb1e8e7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.453834:0:7434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73000/0xce1582440fb1e8e7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.453841:0:7434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73000/0xce1582440fb1e8e7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.453848:0:7434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883e73000 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263767.453853:0:7434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73000/0xce1582440fb1e8e7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.453870:0:7434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73000/0xce1582440fb1e8e7 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.453880:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9dd8829edd00) 00010000:00010000:2.0:1789263767.453884:0:7434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789263767.453893:0:7434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73000/0xce1582440fb1e8e7 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.453899:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73000/0xce1582440fb1e8e7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263767.453954:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883f5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+21:12438:x1876178888650624:12345-192.168.203.20@tcp:55:lhsmtool_posix.0 Request processed in 2050us (2156us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789263767.453964:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 242 00000100:00100000:2.0:1789263767.454859:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263767.454912:0:8395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888650880 00000100:00100000:0.0:1789263767.454919:0:8395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888650880 00000100:00100000:0.0:1789263767.454969:0:8395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 77 00000100:00100000:0.0:1789263767.454978:0:8395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883f5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+8:2398:x1876178888650880:12345-192.168.203.20@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789263767.455023:0:8395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002e262b0b/0xce1582440fb1e8ee lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.455042:0:8395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c2ae7395/0xce1582440fb1e8cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12043 expref: 8 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.455050:0:8395:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789263767.455054:0:8395:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789263767.455059:0:8395:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e262b0b/0xce1582440fb1e8ee lrc: 4/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.455114:0:8395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c2ae7395/0xce1582440fb1e8cb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12043 expref: 8 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.455129:0:8395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c2ae7395/0xce1582440fb1e8cb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12043 expref: 8 pid: 13766 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263767.455152:0:8395:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9c09f5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8395:1876178898098688:192.168.203.20@tcp:104: 00000100:00100000:0.0:1789263767.455212:0:8395:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9bf9829c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789263767.455998:0:8395:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9c09f5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8395:1876178898098688:192.168.203.20@tcp:104: 00010000:00010000:0.0:1789263767.456020:0:8395:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002e262b0b/0xce1582440fb1e8ee lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263767.456823:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263767.456891:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888651008 00000100:00100000:1.0:1789263767.456895:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888651008 00010000:00010000:1.0:1789263767.456924:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c2ae7395/0xce1582440fb1e8cb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12043 expref: 9 pid: 13766 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263767.456971:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 104 00000100:00100000:1.0:1789263767.456980:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883f5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+9:2398:x1876178888651008:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789263767.457001:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789263767.457022:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c2ae7395/0xce1582440fb1e8cb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12043 expref: 9 pid: 13766 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263767.457047:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c2ae7395/0xce1582440fb1e8cb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12043 expref: 9 pid: 13766 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263767.457068:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2ae7395/0xce1582440fb1e8cb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12043 expref: 9 pid: 13766 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263767.457113:0:6474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789263767.457117:0:6474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789263767.457123:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002e262b0b/0xce1582440fb1e8ee lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263767.457133:0:6474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e262b0b/0xce1582440fb1e8ee lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263767.457153:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789263767.457174:0:8395:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002e262b0b/0xce1582440fb1e8ee lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.457185:0:8395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e262b0b/0xce1582440fb1e8ee lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263767.457198:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883f5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+8:2398:x1876178888651008:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 218us (373us total) trans 0 rc 0/0 00010000:00010000:0.0:1789263767.457205:0:8395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002e262b0b/0xce1582440fb1e8ee lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263767.457209:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 104 00010000:00010000:0.0:1789263767.457219:0:8395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e262b0b/0xce1582440fb1e8ee lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.457227:0:8395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e262b0b/0xce1582440fb1e8ee lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.457235:0:8395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883e72c00 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:0.0:1789263767.457240:0:8395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e262b0b/0xce1582440fb1e8ee lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.457249:0:8395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e262b0b/0xce1582440fb1e8ee lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.457276:0:8395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e262b0b/0xce1582440fb1e8ee lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.457284:0:8395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e262b0b/0xce1582440fb1e8ee lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263767.457399:0:8395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883f5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+7:2398:x1876178888650880:12345-192.168.203.20@tcp:1:lhsmtool_posix.0 Request processed in 2421us (2541us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263767.457408:0:8395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 77 00000100:00100000:2.0:1789263767.458148:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263767.458188:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888651264 00000100:00100000:0.0:1789263767.458195:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888651264 00000100:00100000:0.0:1789263767.458231:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 243 00000100:00100000:0.0:1789263767.458239:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c08a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+21:12438:x1876178888651264:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789263767.458297:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72e00/0xce1582440fb1e8f5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.458310:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530800/0xce1582440fb1e7e4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fef expref: 21 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.458317:0:6488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72e00/0xce1582440fb1e8f5 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.458343:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530800/0xce1582440fb1e7e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fef expref: 21 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.458354:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530800/0xce1582440fb1e7e4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fef expref: 21 pid: 8417 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263767.458375:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9c09f5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6488:1876178898098816:192.168.203.20@tcp:104: 00000100:00100000:0.0:1789263767.458430:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9bf9829c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789263767.459377:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263767.459382:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9c09f5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6488:1876178898098816:192.168.203.20@tcp:104: 00010000:00010000:0.0:1789263767.459404:0:6488:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72e00/0xce1582440fb1e8f5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263767.459428:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888651392 00000100:00100000:1.0:1789263767.459434:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888651392 00010000:00010000:1.0:1789263767.459454:0:6472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530800/0xce1582440fb1e7e4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fef expref: 22 pid: 8417 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263767.459485:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 105 00000100:00100000:1.0:1789263767.459493:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88431e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+22:2397:x1876178888651392:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789263767.459512:0:6472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789263767.459518:0:6472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530800/0xce1582440fb1e7e4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fef expref: 22 pid: 8417 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263767.459530:0:6472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530800/0xce1582440fb1e7e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fef expref: 22 pid: 8417 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263767.459548:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530800/0xce1582440fb1e7e4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11fef expref: 22 pid: 8417 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263767.459560:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd9ba858400) 00010000:00010000:1.0:1789263767.459566:0:6472:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804c00/0xce1582440fb1e846 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12012 expref: 21 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263767.459574:0:6472:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72e00/0xce1582440fb1e8f5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263767.459581:0:6472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72e00/0xce1582440fb1e8f5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263767.459588:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72e00/0xce1582440fb1e8f5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263767.459608:0:6472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789263767.459621:0:6488:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72e00/0xce1582440fb1e8f5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.459628:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72e00/0xce1582440fb1e8f5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263767.459643:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88431e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+21:2397:x1876178888651392:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 150us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263767.459651:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 105 00010000:00010000:0.0:1789263767.459798:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72800/0xce1582440fb1e8fc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.459810:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805400/0xce1582440fb1e8af lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1202e expref: 21 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.459818:0:6488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72800/0xce1582440fb1e8fc lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.459838:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805400/0xce1582440fb1e8af lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1202e expref: 21 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.459849:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805400/0xce1582440fb1e8af lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1202e expref: 21 pid: 7434 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263767.459860:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9c09f5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6488:1876178898098944:192.168.203.20@tcp:104: 00000100:00100000:0.0:1789263767.459900:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9bf982a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789263767.461393:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263767.461453:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888651520 00000100:00100000:1.0:1789263767.461461:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888651520 00010000:00010000:1.0:1789263767.461496:0:6473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805400/0xce1582440fb1e8af lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1202e expref: 22 pid: 7434 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263767.461536:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 106 00000100:00100000:1.0:1789263767.461546:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88397ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+22:2398:x1876178888651520:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789263767.461559:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789263767.461559:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9c09f5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6488:1876178898098944:192.168.203.20@tcp:104: 00010000:00010000:1.0:1789263767.461572:0:6473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805400/0xce1582440fb1e8af lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1202e expref: 22 pid: 7434 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263767.461588:0:6473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805400/0xce1582440fb1e8af lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1202e expref: 22 pid: 7434 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.461611:0:6488:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72800/0xce1582440fb1e8fc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263767.461624:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805400/0xce1582440fb1e8af lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1202e expref: 22 pid: 7434 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263767.461642:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9dd8829edd00) 00010000:00010000:1.0:1789263767.461648:0:6473:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72800/0xce1582440fb1e8fc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263767.461656:0:6473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72800/0xce1582440fb1e8fc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263767.461662:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72800/0xce1582440fb1e8fc lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263767.461700:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789263767.461736:0:6488:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72800/0xce1582440fb1e8fc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.461747:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72800/0xce1582440fb1e8fc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263767.461761:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88397ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+21:2398:x1876178888651520:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 215us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263767.461771:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 106 00000001:00080000:0.0:1789263767.461863:0:6488:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967498 00000001:00080000:0.0:1789263767.461985:0:6488:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000001:00080000:0.0:1789263767.462029:0:6488:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967500 00000100:00100000:0.0:1789263767.462176:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9c09f5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6488:1876178898099072:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789263767.462231:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263767.462264:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9bf982240 going to sleep for 11 seconds 00000100:00100000:1.0:1789263767.462290:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898099072 00000100:00100000:1.0:1789263767.462298:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898099072 00000100:00100000:1.0:1789263767.462348:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789263767.462355:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c09f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6488:x1876178898099072:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789263767.462454:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c09f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6488:x1876178898099072:12345-0@lo:1000:mdt00_001.0 Request processed in 99us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263767.462463:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789263767.462492:0:6488:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967318 gen 2 00000004:00080000:0.0:1789263767.462499:0:6488:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967318 00000100:00100000:0.0:1789263767.462520:0:6488:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9dd98ff7fb80 x1876178898098304/t4294967322(4294967322) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789263783 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263767.462532:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9c09f5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6488:1876178898099072:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1789263767.462642:0:6488:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000100:00100000:0.0:1789263767.462681:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9c09f5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6488:1876178898099200:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789263767.462719:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263767.462741:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9bf9829c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789263767.462773:0:8499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898099200 00000100:00100000:3.0:1789263767.462779:0:8499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898099200 00000100:00100000:3.0:1789263767.462810:0:8499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789263767.462819:0:8499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c09f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6488:x1876178898099200:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789263767.462934:0:8499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c09f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6488:x1876178898099200:12345-0@lo:1000:mdt00_001.0 Request processed in 116us (226us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1789263767.462942:0:8499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789263767.462970:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9c09f5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6488:1876178898099200:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1789263767.463001:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72800/0xce1582440fb1e8fc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.463023:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72800/0xce1582440fb1e8fc lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.463031:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72800/0xce1582440fb1e8fc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.463038:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883e72800 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:0.0:1789263767.463043:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72800/0xce1582440fb1e8fc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.463051:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72800/0xce1582440fb1e8fc lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.463067:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9dd8829edd00) 00010000:00010000:0.0:1789263767.463070:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789263767.463104:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72800/0xce1582440fb1e8fc lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.463112:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72800/0xce1582440fb1e8fc lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.463141:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72200/0xce1582440fb1e83f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.463148:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72200/0xce1582440fb1e83f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.463154:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72200/0xce1582440fb1e83f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.463160:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883e72200 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:0.0:1789263767.463169:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72200/0xce1582440fb1e83f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.463176:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72200/0xce1582440fb1e83f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.463186:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd9ba858400) 00010000:00010000:0.0:1789263767.463189:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789263767.463195:0:6488:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804c00/0xce1582440fb1e846 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12012 expref: 24 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.463206:0:6488:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804c00/0xce1582440fb1e846 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12012 expref: 24 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.463215:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804c00/0xce1582440fb1e846 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12012 expref: 24 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.463239:0:6488:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804c00/0xce1582440fb1e846 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12012 expref: 24 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263767.463252:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9c09f4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6488:1876178898099328:192.168.203.20@tcp:105: 00000100:00100000:0.0:1789263767.463322:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9bf9829c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789263767.464742:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9c09f4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6488:1876178898099328:192.168.203.20@tcp:105: 00010000:00010000:0.0:1789263767.464776:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72200/0xce1582440fb1e83f lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.464784:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72200/0xce1582440fb1e83f lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.464829:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73e00/0xce1582440fb1e903 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263767.464844:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00010000:00010000:0.0:1789263767.464847:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73e00/0xce1582440fb1e903 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.464863:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73e00/0xce1582440fb1e903 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.464874:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73e00/0xce1582440fb1e903 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.464884:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73e00/0xce1582440fb1e903 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.464891:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73e00/0xce1582440fb1e903 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.464897:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883e73e00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:0.0:1789263767.464902:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73e00/0xce1582440fb1e903 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.464909:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73e00/0xce1582440fb1e903 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.464919:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd9ba858400) 00010000:00010000:0.0:1789263767.464921:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789263767.464924:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73e00/0xce1582440fb1e903 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.464929:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73e00/0xce1582440fb1e903 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263767.464934:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888651648 00000100:00100000:3.0:1789263767.464948:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888651648 00010000:00010000:0.0:1789263767.464952:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72e00/0xce1582440fb1e8f5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.464958:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72e00/0xce1582440fb1e8f5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.464962:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72e00/0xce1582440fb1e8f5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.464965:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883e72e00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:0.0:1789263767.464968:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72e00/0xce1582440fb1e8f5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.464972:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72e00/0xce1582440fb1e8f5 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.464981:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd9ba858400) 00010000:00010000:0.0:1789263767.464982:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789263767.464984:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72e00/0xce1582440fb1e8f5 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.464987:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72e00/0xce1582440fb1e8f5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263767.465002:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 55 00000100:00100000:3.0:1789263767.465021:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c08abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+25:12437:x1876178888651648:12345-192.168.203.20@tcp:49:lfs.0 00000100:00100000:3.0:1789263767.465158:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c08abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+25:12437:x1876178888651648:12345-192.168.203.20@tcp:49:lfs.0 Request processed in 146us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263767.465167:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 55 00000100:00100000:0.0:1789263767.465177:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c08a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+25:12438:x1876178888651264:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 Request processed in 6933us (7025us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1789263767.465196:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 243 00000040:00080000:1.0:1789263767.465201:0:13757:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000020:00080000:0.0:1789263767.465202:0:6488:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1789263767.465213:0:13757:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789263767.465686:0:13757:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 6 00000040:00080000:1.0:1789263767.465694:0:13757:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789263767.466424:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263767.466455:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263767.466465:0:14127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888651904 00000100:00100000:1.0:1789263767.466472:0:14127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888651904 00000100:00100000:0.0:1789263767.466526:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888652160 00000100:00100000:1.0:1789263767.466528:0:14127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 56 00000100:00100000:0.0:1789263767.466539:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888652160 00000100:00100000:1.0:1789263767.466545:0:14127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88397d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+24:12438:x1876178888651904:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789263767.466633:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 244 00000100:00100000:0.0:1789263767.466644:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88397c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+25:12437:x1876178888652160:12345-192.168.203.20@tcp:58:lfs.0 00000040:00080000:0.0:1789263767.466797:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000004:00080000:1.0:1789263767.466820:0:14127:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789263767.466862:0:14127:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967503 00000100:00100000:0.0:1789263767.466869:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88397c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+26:12437:x1876178888652160:12345-192.168.203.20@tcp:58:lfs.0 Request processed in 226us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263767.466884:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 244 00010000:00010000:1.0:1789263767.466915:0:14127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1e90a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263767.466932:0:14127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1e90a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263767.466943:0:14127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1e90a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263767.466951:0:14127:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1e90a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263767.466958:0:14127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1e90a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263767.466977:0:14127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1e90a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263767.466997:0:14127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789263767.467028:0:6475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789263767.467037:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1e90a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.467047:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883f59800 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:0.0:1789263767.467052:0:6475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1e90a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.467062:0:6475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1e90a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14127 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263767.467073:0:14127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88397d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+26:12438:x1876178888651904:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 Request processed in 528us (648us total) trans 4294967504 rc 0/0 00010000:00010000:0.0:1789263767.467115:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9dd8829edd00) 00010000:00010000:0.0:1789263767.467121:0:6475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789263767.467127:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1e90a lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14127 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263767.467144:0:14127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 56 00010000:00010000:0.0:1789263767.467144:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1e90a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14127 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1789263767.467156:0:14127:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789263767.467174:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263767.467182:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263767.467191:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789263767.480286:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263767.480376:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888652288 00000100:00100000:2.0:1789263767.480407:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888652288 00000100:00100000:2.0:1789263767.480488:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 245 00000100:00100000:2.0:1789263767.480510:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88397dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+26:12440:x1876178888652288:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:2.0:1789263767.480542:0:7434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263767.480566:0:7434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805a00/0xce1582440fb1e911 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d1204a expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.480649:0:7434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1e918 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.480684:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1e918 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.480698:0:7434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1e918 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.480724:0:7434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805600/0xce1582440fb1e91f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.480732:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805600/0xce1582440fb1e91f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.480739:0:7434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805600/0xce1582440fb1e91f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.480823:0:7434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1e926 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.480835:0:7434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1e831 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1200b expref: 27 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.480843:0:7434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1e926 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.480885:0:7434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1e831 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1200b expref: 27 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.480902:0:7434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1e831 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1200b expref: 27 pid: 6488 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263767.480937:0:7434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9c08ab800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7434:1876178898099456:192.168.203.20@tcp:104: 00000100:00100000:2.0:1789263767.481058:0:7434:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd8840c9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789263767.481945:0:7434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9c08ab800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7434:1876178898099456:192.168.203.20@tcp:104: 00010000:00010000:0.0:1789263767.481967:0:7434:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1e926 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263767.481999:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263767.482068:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888652544 00000100:00100000:2.0:1789263767.482094:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888652544 00000100:00100000:2.0:1789263767.482143:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 57 00000100:00100000:2.0:1789263767.482152:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88397f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+28:6153:x1876178888652544:12345-192.168.203.20@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789263767.482390:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88397f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+29:6153:x1876178888652544:12345-192.168.203.20@tcp:35:ldlm_bl.0 Request processed in 235us (389us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1789263767.482406:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 57 00000100:00100000:2.0:1789263767.483240:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263767.483295:0:7428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888652672 00000100:00100000:0.0:1789263767.483302:0:7428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888652672 00010000:00010000:0.0:1789263767.483331:0:7428:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1e831 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1200b expref: 29 pid: 6488 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263767.483362:0:7428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 107 00000100:00100000:0.0:1789263767.483371:0:7428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c08ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+29:2397:x1876178888652672:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789263767.483385:0:7428:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789263767.483393:0:7428:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1e831 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1200b expref: 29 pid: 6488 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.483411:0:7428:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1e831 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1200b expref: 29 pid: 6488 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.483436:0:7428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1e831 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1200b expref: 29 pid: 6488 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.483452:0:7428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd9ba858400) 00010000:00010000:0.0:1789263767.483457:0:7428:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1e926 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.483471:0:7428:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1e926 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.483479:0:7428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1e926 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263767.483509:0:7428:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789263767.483537:0:7434:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1e926 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.483544:0:7434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1e926 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263767.483560:0:7428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c08ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+28:2397:x1876178888652672:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 189us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263767.483569:0:7428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 107 00000004:00200000:2.0:1789263767.483592:0:7434:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789263767.483601:0:7434:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789263767.483621:0:7434:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1e926 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.483635:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1e926 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.483645:0:7434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1e918 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.483654:0:7434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1e918 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.483669:0:7434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1e918 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.483676:0:7434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bb804400 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263767.483682:0:7434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1e918 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.483691:0:7434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1e918 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.483701:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dd8829edc00) 00010000:00010000:2.0:1789263767.483704:0:7434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789263767.483719:0:7434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1e918 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.483727:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804400/0xce1582440fb1e918 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.483738:0:7434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805600/0xce1582440fb1e91f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.483744:0:7434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805600/0xce1582440fb1e91f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.483749:0:7434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805600/0xce1582440fb1e91f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.483754:0:7434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bb805600 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263767.483757:0:7434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805600/0xce1582440fb1e91f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.483774:0:7434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805600/0xce1582440fb1e91f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.483783:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9dd9ba858a00) 00010000:00010000:2.0:1789263767.483785:0:7434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789263767.483789:0:7434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805600/0xce1582440fb1e91f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.483795:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805600/0xce1582440fb1e91f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.483828:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805a00/0xce1582440fb1e911 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1204a expref: 28 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.483838:0:7434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1e926 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1204a expref: 27 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263767.483843:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd9ba858400) 00010000:00010000:2.0:1789263767.483845:0:7434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789263767.483846:0:7434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bb805800, rc 0) 00000100:00100000:2.0:1789263767.483881:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88397dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+27:12440:x1876178888652288:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 3376us (3601us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263767.483889:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 245 00000100:00100000:2.0:1789263767.597948:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789263767.597970:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898099584:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789263767.598047:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263767.598123:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898099584 00000100:00100000:1.0:1789263767.598132:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898099584 00000100:00100000:1.0:1789263767.598183:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789263767.598194:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898099584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789263767.598224:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1789263767.598277:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898099584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263767.598284:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789263767.598323:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898099584:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1789263767.791349:0:14763:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789263767.791358:0:14763:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789263767.791403:0:14763:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 7 00000040:00080000:2.0:1789263767.791409:0:14763:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1789263767.981281:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789263768.493286:0:13757:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789263768.493294:0:13757:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789263768.493328:0:13757:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 7 00000040:00080000:1.0:1789263768.493336:0:13757:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789263768.493472:0:13757:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7d880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13757:1876178898099712:192.168.203.20@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789263768.493565:0:13757:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9bf9820c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789263768.494924:0:13757:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7d880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13757:1876178898099712:192.168.203.20@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789263768.495577:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263768.495767:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888652800 00000100:00100000:1.0:1789263768.495775:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888652800 00000100:00100000:1.0:1789263768.495825:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 246 00000100:00100000:1.0:1789263768.495848:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c09f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+27:12452:x1876178888652800:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789263768.495882:0:6488:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789263768.495983:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c09f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+27:12452:x1876178888652800:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 Request processed in 136us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263768.495991:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 246 00000100:00100000:3.0:1789263768.497062:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263768.497121:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888653056 00000100:00100000:0.0:1789263768.497128:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888653056 00000100:00100000:0.0:1789263768.497173:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 247 00000100:00100000:0.0:1789263768.497183:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88397d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+27:12452:x1876178888653056:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789263768.497197:0:8417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263768.497215:0:8417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72600/0xce1582440fb1e92d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d12051 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263768.497301:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73800/0xce1582440fb1e934 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263768.497316:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73800/0xce1582440fb1e934 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263768.497328:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73800/0xce1582440fb1e934 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789263768.497339:0:8417:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1789263768.497433:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72600/0xce1582440fb1e92d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12051 expref: 30 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263768.497450:0:8417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73800/0xce1582440fb1e934 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12051 expref: 29 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263768.497459:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd9ba858400) 00010000:00010000:0.0:1789263768.497471:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789263768.497475:0:8417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd883e73800, rc 0) 00000100:00100000:0.0:1789263768.497520:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88397d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+29:12452:x1876178888653056:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 338us (458us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1789263768.497527:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 247 00000100:00100000:2.0:1789263768.498860:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263768.498911:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888653184 00000100:00100000:0.0:1789263768.498918:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888653184 00000100:00100000:0.0:1789263768.498982:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 15 00000100:00100000:0.0:1789263768.498991:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa64000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+29:2398:x1876178888653184:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789263768.499003:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789263768.499021:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73800/0xce1582440fb1e934 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12051 expref: 29 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263768.499034:0:8409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd9ba858400) 00010000:00010000:0.0:1789263768.499039:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789263768.499098:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa64000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+28:2398:x1876178888653184:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 86us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263768.499106:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 15 00000100:00100000:3.0:1789263768.499212:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263768.499673:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888653440 00000100:00100000:0.0:1789263768.499678:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888653440 00000100:00100000:0.0:1789263768.499783:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 248 00000100:00100000:0.0:1789263768.499792:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88397c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+28:12452:x1876178888653440:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789263768.499848:0:7434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73a00/0xce1582440fb1e942 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263768.499862:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73a00/0xce1582440fb1e942 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263768.499886:0:7434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73a00/0xce1582440fb1e942 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263768.500012:0:7434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73a00/0xce1582440fb1e942 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263768.500020:0:7434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73a00/0xce1582440fb1e942 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263768.500026:0:7434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73a00/0xce1582440fb1e942 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263768.500032:0:7434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883e73a00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:0.0:1789263768.500037:0:7434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73a00/0xce1582440fb1e942 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263768.500044:0:7434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73a00/0xce1582440fb1e942 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263768.500051:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd9ba858400) 00010000:00010000:0.0:1789263768.500053:0:7434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789263768.500056:0:7434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73a00/0xce1582440fb1e942 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263768.500060:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73a00/0xce1582440fb1e942 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7434 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263768.500163:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88397c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+29:12452:x1876178888653440:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 Request processed in 372us (953us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1789263768.500169:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 248 00000040:00080000:1.0:1789263768.500231:0:13757:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789263768.500237:0:13757:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789263768.500745:0:13757:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 7 00000040:00080000:1.0:1789263768.500754:0:13757:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789263768.501000:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263768.501057:0:14127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888653696 00000100:00100000:1.0:1789263768.501063:0:14127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888653696 00000100:00100000:1.0:1789263768.501128:0:14127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 58 00000100:00100000:1.0:1789263768.501138:0:14127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+29:12452:x1876178888653696:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789263768.501268:0:14127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+30:12452:x1876178888653696:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 Request processed in 132us (269us total) trans 4294967508 rc 0/0 00000100:00100000:1.0:1789263768.501276:0:14127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 58 00010000:00010000:0.0:1789263769.005258:0:13689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789263769.123870:0:14815:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789263769.123880:0:14815:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789263769.123921:0:14815:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 7 00000040:00080000:3.0:1789263769.123928:0:14815:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789263769.180121:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263769.180407:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888653952 00000100:00100000:1.0:1789263769.180417:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888653952 00000100:00100000:1.0:1789263769.180492:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 249 00000100:00080000:0.0:1789263769.180492:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789263769.180503:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8838f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+30:12472:x1876178888653952:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:1.0:1789263769.180528:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263769.180545:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1e949 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d12058 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263769.180642:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1e950 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263769.180666:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1e950 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263769.180679:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1e950 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789263769.180691:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1789263769.180804:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58a00/0xce1582440fb1e949 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12058 expref: 33 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263769.180836:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1e950 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12058 expref: 32 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263769.180845:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd9ba858400) 00010000:00010000:1.0:1789263769.180848:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789263769.180852:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd883f59800, rc 0) 00000100:00100000:1.0:1789263769.180908:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8838f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+32:12472:x1876178888653952:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 406us (795us total) trans 4294967509 rc 0/0 00000100:00100000:1.0:1789263769.180917:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 249 00000100:00100000:2.0:1789263769.184304:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263769.184344:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888654080 00000100:00100000:2.0:1789263769.184354:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888654080 00000100:00100000:2.0:1789263769.184410:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 250 00000100:00100000:2.0:1789263769.184422:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8838f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+32:12472:x1876178888654080:12345-192.168.203.20@tcp:54:lfs.0 00010000:00010000:2.0:1789263769.184499:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805a00/0xce1582440fb1e95e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263769.184515:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805a00/0xce1582440fb1e95e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263769.184528:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805a00/0xce1582440fb1e95e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263769.184559:0:8417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805a00/0xce1582440fb1e95e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263769.184567:0:8417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805a00/0xce1582440fb1e95e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263769.184574:0:8417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805a00/0xce1582440fb1e95e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263769.184581:0:8417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bb805a00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263769.184593:0:8417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805a00/0xce1582440fb1e95e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263769.184601:0:8417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805a00/0xce1582440fb1e95e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263769.184614:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd9ba858400) 00010000:00010000:2.0:1789263769.184618:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789263769.184622:0:8417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805a00/0xce1582440fb1e95e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263769.184629:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805a00/0xce1582440fb1e95e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263769.184720:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8838f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+32:12472:x1876178888654080:12345-192.168.203.20@tcp:54:lfs.0 Request processed in 300us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263769.184729:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 250 00000100:00100000:2.0:1789263769.217677:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263769.217733:0:13766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888654208 00000100:00100000:1.0:1789263769.217743:0:13766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888654208 00000100:00080000:0.0:1789263769.217793:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789263769.217817:0:13766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 78 00000100:00100000:1.0:1789263769.217830:0:13766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8838f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+7:2399:x1876178888654208:12345-192.168.203.20@tcp:101:cat.0 00010000:00010000:1.0:1789263769.217848:0:13766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263769.217869:0:13766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b1160dc5/0xce1582440fb1e965 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d1205f expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789263769.217909:0:13766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 13, mtime: 0x6aa5ff97, atime: 0x6aa5ff96, ctime: 0x6aa5ff97, blocks: 0x8 00010000:00010000:1.0:1789263769.217925:0:13766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=211s v=(0 0) 00010000:00010000:1.0:1789263769.217928:0:13766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789263769.217935:0:13766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1160dc5/0xce1582440fb1e965 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1205f expref: 8 pid: 13766 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263769.217950:0:13766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b1160dc5/0xce1582440fb1e965 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1205f expref: 8 pid: 13766 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263769.217963:0:13766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd883f58a00, rc 0) 00000100:00100000:1.0:1789263769.218020:0:13766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8838f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3ce90ea2-917f-4b54-98b0-25e051f2317f+8:2399:x1876178888654208:12345-192.168.203.20@tcp:101:cat.0 Request processed in 194us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263769.218029:0:13766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 78 00000100:00100000:2.0:1789263769.219527:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263769.219572:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888654336 00000100:00100000:3.0:1789263769.219578:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888654336 00002000:00100000:3.0:1789263769.219614:0:8400:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff9dd8838f0e00 x1876178888654336/t0(0) o3->3ce90ea2-917f-4b54-98b0-25e051f2317f@192.168.203.20@tcp:605/0 lens 488/0 e 0 to 0 dl 1789263780 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789263769.219625:0:8400:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dd8838f0e00 with x1876178888654336 ext(0->4095) 00002000:00010000:3.0:1789263769.219630:0:8400:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dd8838f0e00 00000100:00100000:3.0:1789263769.219655:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 7 00000100:00100000:3.0:1789263769.219663:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8838f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+8:2398:x1876178888654336:12345-192.168.203.20@tcp:3:cat.0 00000100:00100000:3.0:1789263769.219800:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8838f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+8:2398:x1876178888654336:12345-192.168.203.20@tcp:3:cat.0 Request processed in 137us (276us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789263769.219807:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 7 00002000:00100000:3.0:1789263769.219813:0:8400:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff9dd8838f0e00 x1876178888654336/t0(0) o3->3ce90ea2-917f-4b54-98b0-25e051f2317f@192.168.203.20@tcp:605/0 lens 488/4536 e 0 to 0 dl 1789263780 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789263769.219823:0:8400:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dd8838f0e00 with x1876178888654336 ext(0->4095) 00002000:00010000:3.0:1789263769.219827:0:8400:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dd8838f0e00 00000001:00080000:2.0:1789263769.647714:0:9479:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:2.0:1789263769.647732:0:9479:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00010000:00010000:1.0:1789263770.029223:0:13146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789263770.554192:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263770.554236:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263770.554251:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888654464 00000100:00100000:1.0:1789263770.554260:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888654464 00000100:00100000:2.0:1789263770.554269:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263770.554292:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888654592 00000100:00100000:0.0:1789263770.554297:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888654592 00000100:00100000:2.0:1789263770.554306:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263770.554319:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 336 00000100:00100000:3.0:1789263770.554328:0:8394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888654848 00000100:00100000:0.0:1789263770.554334:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888654720 00000100:00100000:3.0:1789263770.554335:0:8394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888654848 00000100:00100000:1.0:1789263770.554335:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a06c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+13:2399:x1876178888654464:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789263770.554339:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888654720 00000100:00100000:2.0:1789263770.554344:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263770.554377:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888655104 00000100:00100000:2.0:1789263770.554380:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263770.554383:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888655104 00000100:00100000:3.0:1789263770.554387:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 81 00000100:00100000:3.0:1789263770.554398:0:8394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882611c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+8:2400:x1876178888654848:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789263770.554413:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 159 00000100:00100000:1.0:1789263770.554414:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a06c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+13:2399:x1876178888654464:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 81us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263770.554428:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 336 00000100:00100000:0.0:1789263770.554428:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882613800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+32:2400:x1876178888654592:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1789263770.554441:0:8394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882611c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+8:2400:x1876178888654848:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 44us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263770.554447:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 81 00000100:00100000:3.0:1789263770.554462:0:8394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888654976 00000100:00100000:3.0:1789263770.554465:0:8394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888654976 00000100:00100000:0.0:1789263770.554476:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882613800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+32:2400:x1876178888654592:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 50us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263770.554481:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 160 00000100:00100000:0.0:1789263770.554491:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 159 00000100:00100000:3.0:1789263770.554492:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 82 00000100:00100000:1.0:1789263770.554498:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882610380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+5:2399:x1876178888654720:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1789263770.554504:0:8394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882613480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+5:2399:x1876178888654976:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789263770.554519:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263770.554527:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 161 00000100:00100000:0.0:1789263770.554539:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882611f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:857a0866-badb-47ac-9591-fbf273e4680e+5:2400:x1876178888655104:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1789263770.554583:0:8394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882613480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+5:2399:x1876178888654976:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 79us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263770.554594:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 82 00000100:00100000:1.0:1789263770.554594:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882610380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+5:2399:x1876178888654720:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 101us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263770.554600:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882611f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:857a0866-badb-47ac-9591-fbf273e4680e+5:2400:x1876178888655104:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 61us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263770.554609:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 160 00000100:00100000:0.0:1789263770.554617:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 161 00000100:00100000:1.0:1789263770.554635:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888655232 00000100:00100000:1.0:1789263770.554640:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888655232 00000100:00080000:0.0:1789263770.554656:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789263770.554662:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789263770.554665:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789263770.554679:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 162 00000100:00100000:1.0:1789263770.554703:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882612a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:857a0866-badb-47ac-9591-fbf273e4680e+5:2399:x1876178888655232:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1789263770.554739:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882612a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:857a0866-badb-47ac-9591-fbf273e4680e+5:2399:x1876178888655232:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 51us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263770.554746:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 162 00000100:00100000:2.0:1789263770.669210:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898099968:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789263770.669220:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882610700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898099840:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789263770.669286:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263770.669298:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:66a76ccf-c64c-4b18-8369-a2861ec3956c:3620:1876178898100096:0@lo:400:kworker.0 00000100:00100000:1.0:1789263770.669334:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1876178898100224:0@lo:400:kworker.0 00000100:00100000:2.0:1789263770.669342:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263770.669358:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898100352:0@lo:400:kworker.0 00000100:00100000:2.0:1789263770.669386:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1876178898100608:0@lo:400:kworker.0 00000100:00100000:1.0:1789263770.669387:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263770.669400:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263770.669422:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3621:1876178898100736:0@lo:400:kworker.0 00000100:00100000:2.0:1789263770.669431:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263770.669438:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898100864:0@lo:400:kworker.0 00000100:00100000:2.0:1789263770.669462:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989aff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898101120:0@lo:400:kworker.0 00000100:00100000:1.0:1789263770.669463:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263770.669478:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263770.669494:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989afd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3621:1876178898101248:0@lo:400:kworker.0 00000100:00100000:2.0:1789263770.669504:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263770.669510:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1876178898101376:0@lo:400:kworker.0 00000100:00100000:1.0:1789263770.669529:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263770.669559:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263770.669576:0:8499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898100352 00000100:00100000:2.0:1789263770.669583:0:8499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898100352 00000100:00100000:1.0:1789263770.669583:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898100096 00000100:00100000:3.0:1789263770.669590:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789263770.669591:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898100096 00000100:00100000:3.0:1789263770.669599:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876178898100480:0@lo:400:kworker.0 00000100:00100000:3.0:1789263770.669628:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263770.669628:0:8499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789263770.669634:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1789263770.669640:0:8499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1876178898100352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789263770.669650:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a06450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+24:3620:x1876178898100096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263770.669653:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882a6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898100992:0@lo:400:kworker.0 00000100:00100000:3.0:1789263770.669725:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263770.669725:0:8499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1876178898100352:12345-0@lo:400:kworker.0 Request processed in 84us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263770.669737:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a06450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66a76ccf-c64c-4b18-8369-a2861ec3956c+24:3620:x1876178898100096:12345-0@lo:400:kworker.0 Request processed in 91us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263770.669738:0:8499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789263770.669749:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:3.0:1789263770.669754:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898101504:0@lo:400:kworker.0 00000100:00100000:2.0:1789263770.669774:0:8499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898100992 00000100:00100000:2.0:1789263770.669778:0:8499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898100992 00000100:00100000:3.0:1789263770.669788:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263770.669798:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898100224 00000100:00100000:2.0:1789263770.669800:0:8499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789263770.669805:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898100224 00000100:00100000:2.0:1789263770.669808:0:8499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989aedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1876178898100992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263770.669829:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898100352:0@lo:400:kworker.0 00000100:00100000:2.0:1789263770.669851:0:8499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989aedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1876178898100992:12345-0@lo:400:kworker.0 Request processed in 41us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263770.669852:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898100608 00000100:00100000:1.0:1789263770.669858:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898100608 00000100:00100000:3.0:1789263770.669864:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882a6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898100992:0@lo:400:kworker.0 00000100:00100000:2.0:1789263770.669864:0:8499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789263770.669896:0:8396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898099840 00000100:00100000:2.0:1789263770.669901:0:8396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898099840 00000100:00100000:1.0:1789263770.669903:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898100736 00000100:00100000:3.0:1789263770.669904:0:13766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898100864 00000100:00100000:3.0:1789263770.669910:0:13766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898100864 00000100:00100000:1.0:1789263770.669910:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898100736 00000100:00100000:1.0:1789263770.669939:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898101248 00000100:00100000:1.0:1789263770.669943:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898101248 00000100:00100000:2.0:1789263770.669947:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789263770.669958:0:13766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898101120 00000100:00100000:2.0:1789263770.669958:0:8396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88397ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876178898099840:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789263770.669964:0:13766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898101120 00000100:00100000:1.0:1789263770.669966:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898101376 00000100:00100000:1.0:1789263770.669971:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898101376 00002000:00000024:2.0:1789263770.669984:0:8396:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789263770.669991:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898100480 00000100:00100000:1.0:1789263770.669994:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898100480 00000100:00100000:1.0:1789263770.670006:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789263770.670013:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1876178898100224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263770.670015:0:13766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898101504 00000100:00100000:3.0:1789263770.670021:0:13766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898101504 00000100:00100000:2.0:1789263770.670035:0:8396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88397ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876178898099840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263770.670052:0:13766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789263770.670055:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789263770.670066:0:13766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3618:x1876178898100864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789263770.670072:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1876178898100224:12345-0@lo:400:kworker.0 Request processed in 58us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263770.670107:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789263770.670113:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789263770.670126:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882613b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1876178898100608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789263770.670130:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789263770.670136:0:13766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3618:x1876178898100864:12345-0@lo:400:kworker.0 Request processed in 71us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263770.670145:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1876178898100736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263770.670147:0:13766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789263770.670176:0:13766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789263770.670178:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882613b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1876178898100608:12345-0@lo:400:kworker.0 Request processed in 53us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263770.670189:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789263770.670191:0:13766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3620:x1876178898101120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789263770.670199:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1876178898100736:12345-0@lo:400:kworker.0 Request processed in 56us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263770.670207:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789263770.670214:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789263770.670225:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1876178898101248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789263770.670231:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789263770.670239:0:13766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3620:x1876178898101120:12345-0@lo:400:kworker.0 Request processed in 52us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263770.670245:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1876178898101376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263770.670251:0:13766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789263770.670272:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1876178898101248:12345-0@lo:400:kworker.0 Request processed in 49us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263770.670274:0:13766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789263770.670285:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789263770.670287:0:13766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989aee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3618:x1876178898101504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789263770.670294:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1876178898101376:12345-0@lo:400:kworker.0 Request processed in 53us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263770.670303:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789263770.670309:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789263770.670320:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876178898100480:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789263770.670326:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789263770.670331:0:13766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989aee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3618:x1876178898101504:12345-0@lo:400:kworker.0 Request processed in 46us (543us total) trans 0 rc 0/0 00000100:00080000:1.0:1789263770.670334:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789263770.670338:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789263770.670342:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789263770.670352:0:13766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789263770.670367:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876178898100480:12345-0@lo:400:kworker.0 Request processed in 49us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263770.670374:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789263770.670383:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1876178898100224:0@lo:400:kworker.0 00010000:00080000:1.0:1789263770.670400:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd98ff7ce00 x1876178898100736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263786 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789263770.670403:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263770.670415:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3621:1876178898100736:0@lo:400:kworker.0 00000100:00100000:1.0:1789263770.670430:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989afd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3621:1876178898101248:0@lo:400:kworker.0 00000100:00100000:3.0:1789263770.670449:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876178898100480:0@lo:400:kworker.0 00000100:00100000:1.0:1789263770.670468:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898099968 00000100:00100000:3.0:1789263770.670469:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898101504:0@lo:400:kworker.0 00000100:00100000:1.0:1789263770.670473:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898099968 00000100:00100000:2.0:1789263770.670475:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:66a76ccf-c64c-4b18-8369-a2861ec3956c:3620:1876178898100096:0@lo:400:kworker.0 00000100:00100000:3.0:1789263770.670491:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898100864:0@lo:400:kworker.0 00000100:00100000:2.0:1789263770.670497:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1876178898100608:0@lo:400:kworker.0 00000100:00100000:1.0:1789263770.670509:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00010000:00080000:3.0:1789263770.670514:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd9bfaae680 x1876178898101376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263786 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789263770.670518:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989aff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898101120:0@lo:400:kworker.0 00000100:00100000:1.0:1789263770.670520:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1876178898099968:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789263770.670536:0:8397:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789263770.670537:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1876178898101376:0@lo:400:kworker.0 00000100:00100000:3.0:1789263770.670558:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:3.0:1789263770.670564:0:3618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967311 00000100:00100000:1.0:1789263770.670578:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1876178898099968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (175us total) trans 0 rc 0/0 00000004:00080000:3.0:1789263770.670584:0:3618:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9dd9c08a9f80, transno 4294967308 00000100:00100000:1.0:1789263770.670589:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000004:00080000:3.0:1789263770.670601:0:3618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000100:00100000:2.0:1789263770.670606:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898099968:0@lo:13:osp-pre-1-1.0 00000004:00080000:3.0:1789263770.670622:0:3618:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9dd9907a5c00, transno 4294967311 00000100:00100000:3.0:1789263770.670635:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882610700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898099840:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789263770.963000:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263770.963058:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888655360 00000100:00100000:1.0:1789263770.963066:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888655360 00000100:00100000:1.0:1789263770.963141:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 251 00000100:00100000:1.0:1789263770.963153:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+32:12117:x1876178888655360:12345-192.168.203.20@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1789263770.963243:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+32:12117:x1876178888655360:12345-192.168.203.20@tcp:60:lhsmtool_posix.0 Request processed in 94us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263770.963249:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 251 00000100:00100000:0.0:1789263770.964047:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263770.964107:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888655488 00000100:00100000:3.0:1789263770.964113:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888655488 00000100:00100000:3.0:1789263770.964150:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 252 00000100:00100000:3.0:1789263770.964158:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaa6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+5:12117:x1876178888655488:12345-192.168.203.20@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1789263770.964200:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaa6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+5:12117:x1876178888655488:12345-192.168.203.20@tcp:60:lhsmtool_posix.0 Request processed in 44us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263770.964204:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 252 00000100:00100000:2.0:1789263770.964909:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263770.964967:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888655744 00000100:00100000:3.0:1789263770.964971:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888655744 00000100:00100000:3.0:1789263770.965008:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 59 00000100:00100000:3.0:1789263770.965016:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+32:12117:x1876178888655744:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789263770.965225:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+33:12117:x1876178888655744:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 Request processed in 209us (315us total) trans 4294967510 rc 0/0 00000100:00100000:3.0:1789263770.965232:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 59 00000100:00100000:2.0:1789263771.030212:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263771.030273:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888655872 00000100:00100000:3.0:1789263771.030284:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888655872 00000100:00100000:3.0:1789263771.030350:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 253 00000100:00100000:3.0:1789263771.030363:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:857a0866-badb-47ac-9591-fbf273e4680e+5:12928:x1876178888655872:12345-192.168.203.20@tcp:101:lsof.0 00010000:00010000:3.0:1789263771.030382:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263771.030400:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1e96c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d12066 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263771.030451:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1e973 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263771.030462:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1e973 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263771.030472:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1e973 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789263771.030511:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789263771.030515:0:6488:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789263771.030539:0:6488:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1e973 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263771.030563:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1e96c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12066 expref: 7 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263771.030581:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1e973 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12066 expref: 6 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263771.030603:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd9ba858600) 00010000:00010000:3.0:1789263771.030606:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789263771.030610:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981530200, rc 0) 00000100:00100000:3.0:1789263771.030666:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:857a0866-badb-47ac-9591-fbf273e4680e+6:12928:x1876178888655872:12345-192.168.203.20@tcp:101:lsof.0 Request processed in 307us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263771.030673:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 253 00010000:00010000:3.0:1789263771.053254:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789263771.181333:0:8509:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 213471253331ns, next at 214471249254ns, rc = 0 00000100:00100000:1.0:1789263771.181337:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaa5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898101760:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789263771.181367:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989aeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898101888:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789263771.181371:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898101632:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789263771.181433:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263771.181468:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263771.181544:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263771.181552:0:8512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898101760 00000100:00100000:0.0:1789263771.181565:0:8512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898101760 00000100:00100000:1.0:1789263771.181580:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898101632 00000100:00100000:1.0:1789263771.181588:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898101632 00000100:00100000:2.0:1789263771.181634:0:8499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898101888 00000100:00100000:2.0:1789263771.181644:0:8499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898101888 00000100:00100000:0.0:1789263771.181651:0:8512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789263771.181663:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789263771.181670:0:8512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989aec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876178898101632:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789263771.181707:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3621:x1876178898101760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789263771.181744:0:8397:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00002000:00000024:0.0:1789263771.181744:0:8512:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1789263771.181746:0:8499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789263771.181776:0:8499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c08a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1876178898101888:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789263771.181831:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3621:x1876178898101760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263771.181836:0:8512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989aec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876178898101632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 174us (372us total) trans 0 rc 0/0 00000004:00000024:2.0:1789263771.181841:0:8499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789263771.181849:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789263771.181859:0:8512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789263771.181926:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898101632:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789263771.181946:0:8499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c08a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1876178898101888:12345-0@lo:41:osp-pre-1-0.0 Request processed in 180us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263771.181960:0:8499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789263771.181972:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaa5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898101760:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789263771.182006:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989aeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898101888:0@lo:41:osp-pre-1-0.0 00000001:02000400:0.0:1789263771.913390:0:15011:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 21:42:51 (1789263771) 00010000:00010000:3.0:1789263772.077271:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789263772.717283:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898102016:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789263772.717354:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263772.717444:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898102016 00000100:00100000:1.0:1789263772.717453:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898102016 00000100:00100000:1.0:1789263772.717530:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789263772.717540:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaa5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1876178898102016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789263772.717573:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1789263772.717629:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaa5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1876178898102016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263772.717636:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789263772.717719:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898102016:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789263772.892391:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263772.892464:0:14127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888656128 00000100:00100000:1.0:1789263772.892475:0:14127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888656128 00000100:00080000:0.0:1789263772.892523:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789263772.892549:0:14127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 60 00000100:00100000:1.0:1789263772.892573:0:14127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd987346c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+33:13151:x1876178888656128:12345-192.168.203.20@tcp:35:umount.0 00000100:00100000:1.0:1789263772.892832:0:14127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd987346c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+34:13151:x1876178888656128:12345-192.168.203.20@tcp:35:umount.0 Request processed in 271us (460us total) trans 4294967511 rc 0/0 00000100:00100000:1.0:1789263772.892841:0:14127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 60 00000100:00100000:2.0:1789263772.894284:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263772.894354:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888656384 00000100:00100000:3.0:1789263772.894361:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888656384 00000001:00080000:2.0:1789263772.894411:0:6466:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967511 is committed 00000100:00100000:3.0:1789263772.894415:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 61 00000004:00080000:2.0:1789263772.894424:0:6466:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000100:00100000:3.0:1789263772.894430:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c08abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+33:13151:x1876178888656384:12345-192.168.203.20@tcp:35:umount.0 00010000:00010000:0.0:1789263772.894467:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73600/0xce1582440fb1e8e0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1789263772.894471:0:6466:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9dd9bf982240 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1789263772.894479:0:6466:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9dd9bb641500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9dd9bf982600 00000020:00080000:2.0:1789263772.894484:0:6466:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9dd9bb641d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9dd8840f3000 00010000:00010000:0.0:1789263772.894485:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73600/0xce1582440fb1e8e0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263772.894497:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73600/0xce1582440fb1e8e0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263772.894504:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883e73600 already unused, calling callback (ffffffffc18c14f0) 00000020:00080000:2.0:1789263772.894507:0:6466:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00010000:00010000:0.0:1789263772.894510:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73600/0xce1582440fb1e8e0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263772.894520:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73600/0xce1582440fb1e8e0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1789263772.894536:0:6519:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00010000:00010000:0.0:1789263772.894541:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9dd8829edd00) 00010000:00010000:0.0:1789263772.894556:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789263772.894562:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73600/0xce1582440fb1e8e0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263772.894568:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1789263772.894569:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73600/0xce1582440fb1e8e0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8417 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263772.894590:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898102144:0@lo:2:osp-syn-0-0.0 00000020:00080000:1.0:1789263772.894590:0:6519:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:2.0:1789263772.894639:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263772.894666:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c08abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+19:13151:x1876178888656384:12345-192.168.203.20@tcp:35:umount.0 Request processed in 240us (384us total) trans 4294967512 rc 0/0 00000100:00100000:3.0:1789263772.894688:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 61 00000100:00100000:1.0:1789263772.894701:0:13766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898102144 00000100:00100000:1.0:1789263772.894707:0:13766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898102144 00000100:00080000:2.0:1789263772.894742:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789263772.894763:0:13766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789263772.894779:0:13766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88397f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3621:x1876178898102144:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1789263772.894864:0:13766:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1789263772.894868:0:13766:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 1789263767 -> 1789263767 00002000:00010000:1.0:1789263772.894870:0:13766:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 1789263766 -> 1789263766 00002000:00010000:1.0:1789263772.894873:0:13766:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1789263767 -> 1789263767 00002000:00010000:1.0:1789263772.894875:0:13766:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1789263772.894906:0:13766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88397f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3621:x1876178898102144:12345-0@lo:2:osp-syn-0-0.0 Request processed in 130us (268us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1789263772.894913:0:13766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000004:00080000:2.0:1789263772.894952:0:3621:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9dd88397d500/2, rc 0, transno 4294967325 00000100:00100000:2.0:1789263772.894959:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898102144:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789263772.895996:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263772.896062:0:14127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888656640 00000100:00100000:1.0:1789263772.896068:0:14127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888656640 00000001:00080000:3.0:1789263772.896123:0:8388:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00000100:00100000:1.0:1789263772.896129:0:14127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 62 00000001:00080000:3.0:1789263772.896131:0:8388:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000100:00100000:1.0:1789263772.896141:0:14127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88397ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+19:13151:x1876178888656640:12345-192.168.203.20@tcp:35:umount.0 00000100:00100000:1.0:1789263772.896811:0:14127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88397ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+20:13151:x1876178888656640:12345-192.168.203.20@tcp:35:umount.0 Request processed in 670us (816us total) trans 4294967513 rc 0/0 00000100:00100000:1.0:1789263772.896820:0:14127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 62 00000100:00100000:0.0:1789263772.898209:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263772.898254:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888656896 00000100:00100000:3.0:1789263772.898262:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888656896 00000100:00100000:3.0:1789263772.898305:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 63 00000100:00100000:3.0:1789263772.898314:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+20:13151:x1876178888656896:12345-192.168.203.20@tcp:35:umount.0 00000100:00100000:3.0:1789263772.898534:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+21:13151:x1876178888656896:12345-192.168.203.20@tcp:35:umount.0 Request processed in 220us (339us total) trans 4294967514 rc 0/0 00000100:00100000:3.0:1789263772.898542:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 63 00000100:00100000:2.0:1789263772.899974:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263772.900019:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263772.900118:0:10303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888657024 00000100:00100000:0.0:1789263772.900126:0:10303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888657024 00000100:00100000:2.0:1789263772.900132:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263772.900168:0:10303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888657152 00000100:00100000:0.0:1789263772.900172:0:10303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888657152 00000100:00100000:2.0:1789263772.900181:0:7428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888657280 00000100:00100000:2.0:1789263772.900188:0:7428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888657280 00000100:00100000:0.0:1789263772.900206:0:10303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 16 00000100:00100000:3.0:1789263772.900216:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 17 00000100:00100000:0.0:1789263772.900219:0:10303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+15:2398:x1876178888657024:12345-192.168.203.20@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1789263772.900227:0:7428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 18 00000100:00100000:3.0:1789263772.900228:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd991533050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+15:2400:x1876178888657152:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789263772.900235:0:10303:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789263772.900236:0:7428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+15:2397:x1876178888657280:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789263772.900237:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789263772.900243:0:7428:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789263772.900262:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd990433e00/0xce1582440fb1d8c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11b88 expref: 15 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263772.900262:0:10303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd981682000/0xce1582440fb1d904 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11bc7 expref: 15 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263772.900266:0:7428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd981531a00/0xce1582440fb1db96 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ca0 expref: 15 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263772.900287:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789263772.900289:0:10303:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789263772.900290:0:7428:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789263772.900329:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd991533050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+12:2400:x1876178888657152:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 101us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263772.900330:0:10303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+12:2398:x1876178888657024:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 112us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263772.900346:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 17 00000100:00100000:0.0:1789263772.900360:0:10303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 16 00000100:00100000:2.0:1789263772.900628:0:7428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+10:2397:x1876178888657280:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 392us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263772.900636:0:7428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 18 00000100:00100000:2.0:1789263772.900942:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263772.900981:0:8395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888657408 00000100:00100000:3.0:1789263772.900986:0:8395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888657408 00000100:00080000:2.0:1789263772.901032:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789263772.901037:0:8395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 80 00000100:00100000:3.0:1789263772.901045:0:8395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+5:2396:x1876178888657408:12345-192.168.203.20@tcp:9:umount.0 00000020:00000080:3.0:1789263772.901065:0:8395:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1dca0 00000100:00080000:3.0:1789263772.901072:0:8395:0:(import.c:65:import_set_state_nolock()) ffff9dd88400b800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1789263772.901133:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1789263772.901147:0:8395:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:3.0:1789263772.901244:0:8395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ce90ea2-917f-4b54-98b0-25e051f2317f+2:2396:x1876178888657408:12345-192.168.203.20@tcp:9:umount.0 Request processed in 199us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263772.901251:0:8395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 80 00000100:00100000:3.0:1789263772.903773:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263772.903859:0:8394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888657792 00000100:00100000:0.0:1789263772.903868:0:8394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888657792 00000100:00080000:2.0:1789263772.903916:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789263772.903936:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 81 00000100:00100000:0.0:1789263772.903947:0:8394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989aeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+7:2396:x1876178888657792:12345-192.168.203.20@tcp:9:umount.0 00000020:00000080:0.0:1789263772.903972:0:8394:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1df01 00000020:00010000:0.0:1789263772.903991:0:8394:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9dd88400f000: total 0 00000100:00080000:0.0:1789263772.903995:0:8394:0:(import.c:65:import_set_state_nolock()) ffff9dd883886800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789263772.904051:0:8394:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000020:00010000:1.0:1789263772.904062:0:13689:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9dd88400f000: total 0 00010000:00010000:1.0:1789263772.904138:0:13689:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9dd88400f000, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1789263772.904193:0:13689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b1160dc5/0xce1582440fb1e965 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1205f expref: 5 pid: 13766 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263772.904206:0:8394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989aeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ce90ea2-917f-4b54-98b0-25e051f2317f+4:2396:x1876178888657792:12345-192.168.203.20@tcp:9:umount.0 Request processed in 260us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263772.904215:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 81 00010000:00010000:1.0:1789263772.904226:0:13689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002408307c/0xce1582440fb1e2b2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e83 expref: 3 pid: 8395 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263772.904243:0:13689:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9dd88400f000, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1789263772.904262:0:13689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263772.904264:0:13689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263772.904266:0:13689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789263772.908189:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263772.908249:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888658816 00000100:00100000:0.0:1789263772.908260:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888658816 00000100:00100000:0.0:1789263772.908315:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 254 00000100:00100000:0.0:1789263772.908326:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+21:2396:x1876178888658816:12345-192.168.203.20@tcp:39:umount.0 00000020:00000080:0.0:1789263772.908357:0:7434:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1d8d3 00000020:00010000:0.0:1789263772.908373:0:7434:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9dd882a32000: total 0 00000100:00080000:0.0:1789263772.908377:0:7434:0:(import.c:65:import_set_state_nolock()) ffff9dd882a37800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789263772.908406:0:7434:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967514 00000020:00010000:1.0:1789263772.908445:0:13146:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9dd882a32000: total 0 00010000:00010000:1.0:1789263772.908493:0:13146:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9dd882a32000, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1789263772.908522:0:13146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dd8829ed600) 00010000:00010000:1.0:1789263772.908525:0:13146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789263772.908531:0:13146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531200/0xce1582440fb1dd1e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11d10 expref: 20 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263772.908546:0:13146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd8829ed200) 00010000:00010000:1.0:1789263772.908548:0:13146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789263772.908551:0:13146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804800/0xce1582440fb1e29d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e7c expref: 19 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263772.908564:0:13146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd9ba858600) 00000100:00100000:0.0:1789263772.908564:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ce90ea2-917f-4b54-98b0-25e051f2317f+18:2396:x1876178888658816:12345-192.168.203.20@tcp:39:umount.0 Request processed in 238us (378us total) trans 4294967515 rc 0/0 00010000:00010000:1.0:1789263772.908569:0:13146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789263772.908577:0:13146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804200/0xce1582440fb1e31b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e9f expref: 18 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263772.908580:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 254 00010000:00010000:1.0:1789263772.908598:0:13146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd9ba858400) 00010000:00010000:1.0:1789263772.908601:0:13146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789263772.908605:0:13146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb805800/0xce1582440fb1e926 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1204a expref: 16 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263772.908621:0:13146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9dd8829ed100) 00010000:00010000:1.0:1789263772.908633:0:13146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789263772.908638:0:13146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f58e00/0xce1582440fb1dbff lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11cae expref: 15 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263772.908684:0:13146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd8829ed200) 00010000:00010000:1.0:1789263772.908688:0:13146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789263772.908692:0:13146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73200/0xce1582440fb1e273 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e6e expref: 14 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263772.908705:0:13146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dd8829edc00) 00010000:00010000:1.0:1789263772.908708:0:13146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789263772.908711:0:13146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3e00/0xce1582440fb1e3d8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11eec expref: 13 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263772.908722:0:13146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dd8829ed600) 00010000:00010000:1.0:1789263772.908724:0:13146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789263772.908727:0:13146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59a00/0xce1582440fb1dc76 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11cca expref: 12 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263772.908740:0:13146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd9ba858400) 00010000:00010000:1.0:1789263772.908742:0:13146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789263772.908746:0:13146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59800/0xce1582440fb1e950 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12058 expref: 11 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263772.908755:0:13146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dd8829edc00) 00010000:00010000:1.0:1789263772.908757:0:13146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789263772.908760:0:13146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3a00/0xce1582440fb1e337 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11ea6 expref: 10 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263772.908773:0:13146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd9ba858400) 00010000:00010000:1.0:1789263772.908775:0:13146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789263772.908786:0:13146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bb804c00/0xce1582440fb1e846 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12012 expref: 9 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263772.908805:0:13146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd8829ed200) 00010000:00010000:1.0:1789263772.908808:0:13146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789263772.908812:0:13146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3400/0xce1582440fb1e193 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11e36 expref: 8 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263772.908828:0:13146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9dd8829ed700) 00010000:00010000:1.0:1789263772.908830:0:13146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263772.908834:0:13146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883f59400/0xce1582440fb1dc1b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11cb5 expref: 7 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263772.908845:0:13146:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9dd882a32000, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1789263772.908859:0:13146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263772.908861:0:13146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263772.908862:0:13146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789263772.913569:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263772.913700:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888658944 00000100:00100000:3.0:1789263772.913711:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888658944 00000100:00080000:2.0:1789263772.913779:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789263772.913807:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 255 00000100:00100000:3.0:1789263772.913819:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+5:2396:x1876178888658944:12345-192.168.203.20@tcp:39:umount.0 00000020:00000080:3.0:1789263772.913849:0:6487:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1d8da 00000100:00080000:3.0:1789263772.913865:0:6487:0:(import.c:65:import_set_state_nolock()) ffff9dd883f0d800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789263772.913893:0:6487:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:1.0:1789263772.913910:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789263772.914141:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ce90ea2-917f-4b54-98b0-25e051f2317f+3:2396:x1876178888658944:12345-192.168.203.20@tcp:39:umount.0 Request processed in 324us (579us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1789263772.914151:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 255 00010000:00010000:3.0:1789263773.101245:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789263773.192908:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263773.192960:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263773.193039:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263773.193109:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888659200 00000100:00100000:1.0:1789263773.193118:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888659200 00000100:00100000:1.0:1789263773.193171:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888659072 00000100:00100000:1.0:1789263773.193174:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888659072 00000100:00100000:0.0:1789263773.194108:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888659328 00000100:00100000:0.0:1789263773.194115:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888659328 00000100:00100000:0.0:1789263773.194151:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 19 00000100:00100000:0.0:1789263773.194160:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882610700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+12:2397:x1876178888659200:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789263773.194175:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789263773.194195:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd883e72400/0xce1582440fb1d9dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11c0d expref: 12 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263773.194213:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789263773.194223:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 20 00000100:00100000:1.0:1789263773.194234:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+11:2399:x1876178888659072:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789263773.194244:0:6472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789263773.194256:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd883e73400/0xce1582440fb1d9d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11bdc expref: 11 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263773.194263:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882610700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+11:2397:x1876178888659200:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 100us (1361us total) trans 0 rc 0/0 00010000:00010000:1.0:1789263773.194271:0:6472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789263773.194274:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 19 00000100:00100000:1.0:1789263773.194310:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+9:2399:x1876178888659072:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 77us (1347us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263773.194311:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 21 00000100:00100000:0.0:1789263773.194322:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+9:2399:x1876178888659328:12345-192.168.203.20@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1789263773.194323:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 20 00010000:00010000:0.0:1789263773.194337:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789263773.194349:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd883f58c00/0xce1582440fb1db8f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11c99 expref: 8 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263773.194361:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789263773.194381:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+7:2399:x1876178888659328:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 62us (1343us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263773.194388:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 21 00000100:00100000:1.0:1789263773.196758:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263773.196809:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888659584 00000100:00100000:3.0:1789263773.196818:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888659584 00000100:00100000:3.0:1789263773.196923:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 256 00000100:00100000:3.0:1789263773.196933:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:857a0866-badb-47ac-9591-fbf273e4680e+6:2396:x1876178888659584:12345-192.168.203.20@tcp:39:umount.0 00000020:00000080:3.0:1789263773.196969:0:6488:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1d9eb 00000020:00010000:3.0:1789263773.196978:0:6488:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9dd883faf000: total 0 00000100:00080000:3.0:1789263773.196982:0:6488:0:(import.c:65:import_set_state_nolock()) ffff9dd883fac000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789263773.197006:0:6488:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967515 00000100:00100000:3.0:1789263773.197188:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:857a0866-badb-47ac-9591-fbf273e4680e+5:2396:x1876178888659584:12345-192.168.203.20@tcp:39:umount.0 Request processed in 257us (434us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1789263773.197196:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 256 00000100:00080000:2.0:1789263773.197287:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:1.0:1789263773.197517:0:6476:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9dd883faf000: total 0 00010000:00010000:1.0:1789263773.197558:0:6476:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9dd883faf000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789263773.197582:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd9ba858600) 00010000:00010000:1.0:1789263773.197585:0:6476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789263773.197589:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530200/0xce1582440fb1e973 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12066 expref: 4 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263773.197605:0:6476:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9dd883faf000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1789263773.197612:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263773.197613:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263773.197614:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789263773.201471:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263773.201564:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888659712 00000100:00100000:0.0:1789263773.201574:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888659712 00000100:00080000:2.0:1789263773.201665:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789263773.201692:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 257 00000100:00100000:0.0:1789263773.201704:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:857a0866-badb-47ac-9591-fbf273e4680e+5:2396:x1876178888659712:12345-192.168.203.20@tcp:39:umount.0 00000020:00000080:0.0:1789263773.201742:0:7434:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1d9f2 00000100:00080000:0.0:1789263773.201752:0:7434:0:(import.c:65:import_set_state_nolock()) ffff9dd9bfa30000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789263773.201777:0:7434:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00010000:00010000:2.0:1789263773.201793:0:13689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789263773.201938:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:857a0866-badb-47ac-9591-fbf273e4680e+3:2396:x1876178888659712:12345-192.168.203.20@tcp:39:umount.0 Request processed in 236us (476us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1789263773.201961:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 257 00000100:00100000:0.0:1789263773.214473:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263773.214542:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888659968 00000100:00100000:1.0:1789263773.214553:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888659968 00000100:00100000:1.0:1789263773.214609:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 338 00000100:00100000:1.0:1789263773.214618:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a05450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+7:2396:x1876178888659968:12345-192.168.203.20@tcp:251:umount.0 00000020:00000080:1.0:1789263773.214658:0:6481:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1d8b0 00000020:00010000:1.0:1789263773.214664:0:6481:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9dd883894800: total 0 00000100:00080000:1.0:1789263773.214679:0:6481:0:(import.c:65:import_set_state_nolock()) ffff9dd883890000 : changing import state from FULL to CLOSED 00000020:00010000:0.0:1789263773.214723:0:13146:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9dd883894800: total 0 00000100:00100000:1.0:1789263773.214738:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a05450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce+3:2396:x1876178888659968:12345-192.168.203.20@tcp:251:umount.0 Request processed in 121us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263773.214745:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 338 00010000:00010000:0.0:1789263773.214782:0:13146:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9dd883894800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1789263773.214830:0:13146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd981683400/0xce1582440fb1d90b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d11bce expref: 2 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263773.214847:0:13146:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9dd883894800, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1789263773.214874:0:13146:0:(genops.c:885:class_export_put()) final put ffff9dd883894800/17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce 00010000:00010000:0.0:1789263773.214890:0:13146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263773.214892:0:13146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263773.214894:0:13146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789263773.214904:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd883894800/17d0d5a3-744d-4c14-9d8e-92ad1ee1cbce for MGS 00000020:00000080:1.0:1789263773.214936:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd883890000 for MGS 00000040:00080000:1.0:1789263773.357919:0:13759:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1789263773.613792:0:13757:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789263773.613801:0:13757:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789263773.613921:0:13757:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1789263773.613929:0:13757:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000020:01000004:3.0:1789263773.907243:0:15206:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1789263773.916233:0:15206:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1789263773.916294:0:15206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd981682600/0xce1582440fb1d997 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d99e expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263773.916323:0:15206:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd981682600/0xce1582440fb1d997 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1d99e expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263773.916328:0:15206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd981682600/0xce1582440fb1d997 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xce1582440fb1d99e expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263773.916332:0:15206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff9dd981682600/0xce1582440fb1d997 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xce1582440fb1d99e expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263773.916351:0:15206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789263773.916354:0:15206:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789263773.916377:0:15206:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789263773.916382:0:15206:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789263773.916387:0:15206:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789263773.916411:0:15206:0:(import.c:65:import_set_state_nolock()) ffff9dd984ce5800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1789263773.916461:0:7427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1789263773.916462:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88297f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876178898102272:0@lo:39:umount.0 00010000:00010000:1.0:1789263773.916472:0:7427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd981682600/0xce1582440fb1d997 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xce1582440fb1d99e expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263773.916483:0:7427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981682600 already unused, calling callback (ffffffffc12b1c20) 10000000:00010000:1.0:1789263773.916486:0:7427:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd981682600/0xce1582440fb1d997 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xce1582440fb1d99e expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263773.916507:0:7427:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd981682600/0xce1582440fb1d997 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xce1582440fb1d99e expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789263773.916515:0:7427:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd981682600/0xce1582440fb1d997 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xce1582440fb1d99e expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789263773.916522:0:7427:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789263773.916525:0:7427:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789263773.916527:0:7427:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00100000:2.0:1789263773.916534:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789263773.916554:0:7427:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff9dd981682600/0xce1582440fb1d997 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xce1582440fb1d99e expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263773.916563:0:7427:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789263773.916576:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898102272 00000100:00100000:3.0:1789263773.916584:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898102272 00010000:00010000:1.0:1789263773.916593:0:7427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd981682600/0xce1582440fb1d997 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xce1582440fb1d99e expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263773.916606:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd981682600/0xce1582440fb1d997 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xce1582440fb1d99e expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263773.916616:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:66a76ccf-c64c-4b18-8369-a2861ec3956c:3621:1876178898102400:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789263773.916638:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263773.916641:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263773.916644:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789263773.916648:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1789263773.916673:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1876178898102272:12345-0@lo:39:umount.0 00000100:00100000:0.0:1789263773.916676:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:3.0:1789263773.916703:0:6487:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1d50d 00000100:00080000:3.0:1789263773.916712:0:6487:0:(import.c:65:import_set_state_nolock()) ffff9dd99f96b000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1789263773.916715:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898102400 00000100:00100000:1.0:1789263773.916721:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898102400 00010000:00010000:2.0:1789263773.916741:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789263773.916768:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789263773.916776:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883f5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a76ccf-c64c-4b18-8369-a2861ec3956c+24:3621:x1876178898102400:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789263773.916787:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3617:x1876178898102272:12345-0@lo:39:umount.0 Request processed in 127us (252us total) trans 0 rc 0/0 00010000:00010000:1.0:1789263773.916792:0:6472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789263773.916797:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000020:00000080:3.0:1789263773.916810:0:6487:0:(genops.c:885:class_export_put()) final put ffff9dd99f96a000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:1.0:1789263773.916812:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd990433a00/0xce1582440fb1d99e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xce1582440fb1d997 expref: 24 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789263773.916824:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd984ce5800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00010000:00010000:1.0:1789263773.916827:0:6472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789263773.916838:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88297f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876178898102272:0@lo:39:umount.0 00000100:00080000:3.0:1789263773.916843:0:15206:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000020:00000080:0.0:1789263773.916848:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd99f96a000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00100000:3.0:1789263773.916854:0:15206:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dd88297f480 x1876178898102272/t0(0) o39->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263783 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789263773.916870:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883f5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66a76ccf-c64c-4b18-8369-a2861ec3956c+23:3621:x1876178898102400:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263773.916873:0:15206:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789263773.916880:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789263773.916890:0:15206:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789263773.916908:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd99f96b000 for lustre-MDT0000 00000100:00100000:1.0:1789263773.916931:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:66a76ccf-c64c-4b18-8369-a2861ec3956c:3621:1876178898102400:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789263773.917789:0:15206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9813fc400/0xce1582440fb1d9a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d9ac expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263773.917799:0:15206:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9813fc400/0xce1582440fb1d9a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1d9ac expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263773.917806:0:15206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9813fc400/0xce1582440fb1d9a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xce1582440fb1d9ac expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263773.917813:0:15206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff9dd9813fc400/0xce1582440fb1d9a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xce1582440fb1d9ac expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263773.917830:0:15206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789263773.917837:0:15206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23400/0xce1582440fb1d86a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d871 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263773.917841:0:15206:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23400/0xce1582440fb1d86a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1d871 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263773.917845:0:15206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23400/0xce1582440fb1d86a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xce1582440fb1d871 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263773.917849:0:15206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23400/0xce1582440fb1d86a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xce1582440fb1d871 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263773.917856:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789263773.917860:0:15206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789263773.917863:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd9813fc400/0xce1582440fb1d9a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xce1582440fb1d9ac expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263773.917865:0:15206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883e72000/0xce1582440fb1dbc7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1dbce expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263773.917872:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9813fc400 already unused, calling callback (ffffffffc12b1c20) 10000000:00010000:1.0:1789263773.917878:0:6476:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd9813fc400/0xce1582440fb1d9a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xce1582440fb1d9ac expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263773.917880:0:15206:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883e72000/0xce1582440fb1dbc7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1dbce expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263773.917888:0:13689:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789263773.917895:0:15206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883e72000/0xce1582440fb1dbc7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xce1582440fb1dbce expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263773.917898:0:6476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd9813fc400/0xce1582440fb1d9a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xce1582440fb1d9ac expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263773.917903:0:13689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23400/0xce1582440fb1d86a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xce1582440fb1d871 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263773.917911:0:15206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff9dd883e72000/0xce1582440fb1dbc7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xce1582440fb1dbce expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263773.917926:0:13689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bfa23400 already unused, calling callback (ffffffffc12b1c20) 10000000:00010000:2.0:1789263773.917934:0:13689:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23400/0xce1582440fb1d86a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xce1582440fb1d871 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789263773.917937:0:6476:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd9813fc400/0xce1582440fb1d9a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xce1582440fb1d9ac expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263773.917945:0:15206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789263773.917948:0:13689:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23400/0xce1582440fb1d86a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xce1582440fb1d871 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789263773.917952:0:6476:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789263773.917956:0:15206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9813fd200/0xce1582440fb1d46c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d473 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789263773.917959:0:6476:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:00010000:2.0:1789263773.917965:0:13689:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23400/0xce1582440fb1d86a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xce1582440fb1d871 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263773.917968:0:15206:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9813fd200/0xce1582440fb1d46c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1d473 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263773.917978:0:6476:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff9dd9813fc400/0xce1582440fb1d9a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xce1582440fb1d9ac expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789263773.917979:0:13689:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789263773.917984:0:13146:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:2.0:1789263773.917987:0:13689:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:3.0:1789263773.917988:0:15206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9813fd200/0xce1582440fb1d46c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xce1582440fb1d473 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263773.917991:0:13146:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd883e72000/0xce1582440fb1dbc7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xce1582440fb1dbce expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789263773.917992:0:13689:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1789263773.917998:0:6476:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789263773.918011:0:13146:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883e72000 already unused, calling callback (ffffffffc12b1c20) 00010000:00010000:3.0:1789263773.918012:0:15206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff9dd9813fd200/0xce1582440fb1d46c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xce1582440fb1d473 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263773.918015:0:13689:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23400/0xce1582440fb1d86a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xce1582440fb1d871 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789263773.918016:0:13146:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd883e72000/0xce1582440fb1dbc7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xce1582440fb1dbce expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263773.918021:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd9813fc400/0xce1582440fb1d9a5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xce1582440fb1d9ac expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263773.918038:0:15206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789263773.918039:0:13146:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd883e72000/0xce1582440fb1dbc7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xce1582440fb1dbce expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263773.918041:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd9813fc400/0xce1582440fb1d9a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xce1582440fb1d9ac expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789263773.918043:0:15206:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1789263773.918048:0:15206:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:2.0:1789263773.918048:0:13689:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:0.0:1789263773.918059:0:13146:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd883e72000/0xce1582440fb1dbc7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xce1582440fb1dbce expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263773.918061:0:13689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23400/0xce1582440fb1d86a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xce1582440fb1d871 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263773.918065:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263773.918073:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd9813fd200/0xce1582440fb1d46c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xce1582440fb1d473 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263773.918096:0:13689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23400/0xce1582440fb1d86a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xce1582440fb1d871 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263773.918108:0:13689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789263773.918108:0:13146:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789263773.918112:0:13689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263773.918113:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9813fd200 already unused, calling callback (ffffffffc12b1c20) 10000000:01000000:0.0:1789263773.918113:0:13146:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1789263773.918116:0:13689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789263773.918117:0:13146:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:00010000:1.0:1789263773.918120:0:6476:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd9813fd200/0xce1582440fb1d46c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xce1582440fb1d473 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263773.918129:0:6476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd9813fd200/0xce1582440fb1d46c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xce1582440fb1d473 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789263773.918131:0:15206:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00010000:00010000:0.0:1789263773.918137:0:13146:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff9dd883e72000/0xce1582440fb1dbc7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xce1582440fb1dbce expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:3.0:1789263773.918138:0:15206:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 10000000:00010000:1.0:1789263773.918140:0:6476:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd9813fd200/0xce1582440fb1d46c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xce1582440fb1d473 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1789263773.918147:0:15206:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000100:00100000:2.0:1789263773.918151:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8840b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:66a76ccf-c64c-4b18-8369-a2861ec3956c:3619:1876178898102656:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789263773.918154:0:13146:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00000080:3.0:1789263773.918155:0:15206:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 10000000:01000000:1.0:1789263773.918159:0:6476:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00000020:00080000:3.0:1789263773.918169:0:15206:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9dd9bfa35800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 10000000:01000000:1.0:1789263773.918170:0:6476:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:0.0:1789263773.918173:0:13146:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd883e72000/0xce1582440fb1dbc7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xce1582440fb1dbce expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789263773.918175:0:6476:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000020:00080000:3.0:1789263773.918181:0:15206:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9dd9ba938800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789263773.918197:0:15206:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9dd9c1ba0800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:1.0:1789263773.918197:0:6476:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff9dd9813fd200/0xce1582440fb1d46c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xce1582440fb1d473 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263773.918198:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789263773.918200:0:13146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd883e72000/0xce1582440fb1dbc7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xce1582440fb1dbce expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1789263773.918214:0:15206:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9dd9c1b40000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00010000:00010000:1.0:1789263773.918217:0:6476:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00080000:3.0:1789263773.918227:0:15206:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9dd883faf000 857a0866-badb-47ac-9591-fbf273e4680e 192.168.203.20@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:0.0:1789263773.918229:0:13146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263773.918230:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd9813fd200/0xce1582440fb1d46c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xce1582440fb1d473 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263773.918234:0:13146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1789263773.918238:0:15206:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9dd882a32000 3ce90ea2-917f-4b54-98b0-25e051f2317f 192.168.203.20@tcp 5 (0 5 0) 1 0 0 0: 0000000000000000 4294967511 stale:0 00010000:00010000:0.0:1789263773.918239:0:13146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263773.918245:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd9813fd200/0xce1582440fb1d46c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xce1582440fb1d473 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1789263773.918247:0:15206:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9dd9873199b8) has exports, disconnecting them 00000100:00100000:2.0:1789263773.918249:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1789263773.918255:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789263773.918261:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:66a76ccf-c64c-4b18-8369-a2861ec3956c:3619:1876178898102528:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789263773.918263:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263773.918267:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1789263773.918269:0:15206:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9dd9bfa35800), last request at 1789263770 00010000:00010000:1.0:1789263773.918272:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789263773.918276:0:15206:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1d7d7 00000100:00100000:1.0:1789263773.918288:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88431e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:66a76ccf-c64c-4b18-8369-a2861ec3956c:3620:1876178898102784:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1789263773.918293:0:15206:0:(import.c:65:import_set_state_nolock()) ffff9dd9bfa35000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1789263773.918299:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263773.918302:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:66a76ccf-c64c-4b18-8369-a2861ec3956c:3621:1876178898102912:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789263773.918329:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1789263773.918333:0:15206:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dd9bfa35800): rc 0 00000020:00000080:3.0:1789263773.918336:0:15206:0:(genops.c:885:class_export_put()) final put ffff9dd9bfa35800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1789263773.918348:0:15206:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9dd9ba938800), last request at 1789263770 00000020:00000080:3.0:1789263773.918352:0:15206:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1d679 00000100:00100000:2.0:1789263773.918357:0:7428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898102656 00000100:00080000:3.0:1789263773.918360:0:15206:0:(import.c:65:import_set_state_nolock()) ffff9dd9ba93e000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1789263773.918361:0:7428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898102656 00000100:00100000:0.0:1789263773.918362:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898102528 00000100:00100000:0.0:1789263773.918367:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898102528 00000020:00080000:3.0:1789263773.918373:0:15206:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dd9ba938800): rc 0 00000020:00000080:3.0:1789263773.918376:0:15206:0:(genops.c:885:class_export_put()) final put ffff9dd9ba938800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1789263773.918378:0:15206:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9dd9c1ba0800), last request at 1789263670 00000020:00000080:3.0:1789263773.918381:0:15206:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1d5f4 00000100:00080000:3.0:1789263773.918385:0:15206:0:(import.c:65:import_set_state_nolock()) ffff9dd9c1ba4000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789263773.918394:0:15206:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dd9c1ba0800): rc 0 00000020:00000080:3.0:1789263773.918396:0:15206:0:(genops.c:885:class_export_put()) final put ffff9dd9c1ba0800/lustre-MDT0000-lwp-MDT0001_UUID 00000100:00100000:2.0:1789263773.918398:0:7428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898102784 00000020:00080000:3.0:1789263773.918401:0:15206:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9dd9c1b40000), last request at 1789263670 00000100:00100000:2.0:1789263773.918402:0:7428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898102784 00000020:00000080:3.0:1789263773.918406:0:15206:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1d5bc 00000100:00080000:3.0:1789263773.918411:0:15206:0:(import.c:65:import_set_state_nolock()) ffff9dd9c0a4a800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1789263773.918415:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000001:00000004:3.0:1789263773.918424:0:15206:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967516 00000100:00100000:0.0:1789263773.918431:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789263773.918436:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8840b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a76ccf-c64c-4b18-8369-a2861ec3956c+25:3619:x1876178898102656:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789263773.918445:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd991531850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a76ccf-c64c-4b18-8369-a2861ec3956c+25:3619:x1876178898102528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789263773.918449:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789263773.918456:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789263773.918464:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd981531000/0xce1582440fb1d871 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xce1582440fb1d86a expref: 25 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263773.918469:0:7428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00010000:00010000:0.0:1789263773.918471:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd9813fd000/0xce1582440fb1d9ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xce1582440fb1d9a5 expref: 25 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263773.918484:0:7428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a76ccf-c64c-4b18-8369-a2861ec3956c+25:3620:x1876178898102784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789263773.918488:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789263773.918493:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789263773.918496:0:7428:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789263773.918508:0:7428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd883f59200/0xce1582440fb1dbce lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xce1582440fb1dbc7 expref: 23 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263773.918528:0:7428:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789263773.918537:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8840b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a76ccf-c64c-4b18-8369-a2861ec3956c+22:3619:x1876178898102656:12345-0@lo:103:ldlm_bl.0 Request processed in 104us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263773.918539:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd991531850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66a76ccf-c64c-4b18-8369-a2861ec3956c+22:3619:x1876178898102528:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (241us total) trans 0 rc 0/0 00000020:00080000:3.0:1789263773.918549:0:15206:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dd9c1b40000): rc 0 00000100:00100000:1.0:1789263773.918549:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000004:00000080:3.0:1789263773.918558:0:15206:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb38e48587ae0 00000100:00100000:0.0:1789263773.918558:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789263773.918572:0:7428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66a76ccf-c64c-4b18-8369-a2861ec3956c+21:3620:x1876178898102784:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (242us total) trans 0 rc 0/0 00000100:00080000:3.0:1789263773.918577:0:15206:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789263773.918581:0:15206:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000100:00100000:2.0:1789263773.918582:0:7428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789263773.918592:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:66a76ccf-c64c-4b18-8369-a2861ec3956c:3619:1876178898102528:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789263773.918606:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8840b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:66a76ccf-c64c-4b18-8369-a2861ec3956c:3619:1876178898102656:0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1789263773.918615:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd9bfa35800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00010000:00010000:2.0:1789263773.918619:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789263773.918638:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88431e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:66a76ccf-c64c-4b18-8369-a2861ec3956c:3620:1876178898102784:0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1789263773.918656:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd9ba938800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00010000:00010000:2.0:1789263773.918660:0:13689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789263773.918701:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd9c1ba0800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1789263773.918731:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd9bfa35000 for lustre-MDT0000 00000020:00000080:0.0:1789263773.918736:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd9ba93e000 for lustre-MDT0000 00000020:00000080:0.0:1789263773.918739:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd9c1ba4000 for lustre-MDT0000 00010000:00010000:0.0:1789263773.918757:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789263773.918766:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263773.918869:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898102912 00000100:00100000:1.0:1789263773.918874:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898102912 00010000:00010000:0.0:1789263773.918888:0:13146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789263773.918910:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789263773.918917:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88431e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a76ccf-c64c-4b18-8369-a2861ec3956c+20:3621:x1876178898102912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789263773.918925:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789263773.918935:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd990432800/0xce1582440fb1d473 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xce1582440fb1d46c expref: 20 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263773.918943:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789263773.918974:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88431e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66a76ccf-c64c-4b18-8369-a2861ec3956c+19:3621:x1876178898102912:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263773.918981:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789263773.919003:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:66a76ccf-c64c-4b18-8369-a2861ec3956c:3621:1876178898102912:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1789263773.919345:0:15206:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1789263773.919362:0:15206:0:(import.c:65:import_set_state_nolock()) ffff9dd984ce7000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789263773.919417:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88297f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1876178898103040:0@lo:39:umount.0 00000100:00100000:3.0:1789263773.919461:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263773.919501:0:8499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898103040 00000100:00100000:0.0:1789263773.919506:0:8499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898103040 00000100:00080000:3.0:1789263773.919595:0:15206:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789263773.919599:0:15206:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967318 gen 3 00000100:00100000:3.0:1789263773.919607:0:15206:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9dd98ff7fb80 x1876178898098304/t4294967322(4294967322) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789263783 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1789263773.919617:0:15206:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9dd98ff7fb80, transno 4294967322 00000100:00100000:3.0:1789263773.919636:0:15206:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9dd9c09f5c00 x1876178898099200/t4294967324(4294967324) o1000->lustre-OST0000-osc-MDT0000@0@lo:24/4 lens 408/4320 e 0 to 0 dl 1789263783 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'mdt00_001.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1789263773.919644:0:15206:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967318 00000100:00100000:3.0:1789263773.919675:0:15206:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9dd88397d500 x1876178898102144/t4294967325(4294967325) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1789263788 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1789263773.919682:0:15206:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9dd88397d500, transno 4294967325 00000004:00080000:3.0:1789263773.919698:0:15206:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1789263773.919762:0:15206:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1789263773.919773:0:8499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00080000:3.0:1789263773.919774:0:15206:0:(import.c:65:import_set_state_nolock()) ffff9dd9bb5f9800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1789263773.919785:0:8499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882a6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1876178898103040:12345-0@lo:39:umount.0 00000100:00080000:3.0:1789263773.919793:0:15206:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789263773.919797:0:15206:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:3.0:1789263773.919804:0:15206:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789263773.919836:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9c09f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1876178898103168:0@lo:9:umount.0 00000100:00080000:3.0:1789263773.919869:0:15206:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:2.0:1789263773.919875:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789263773.919881:0:15206:0:(import.c:65:import_set_state_nolock()) ffff9dd9bf8ed800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1789263773.919908:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1876178898103296:0@lo:9:umount.0 00000100:00100000:2.0:1789263773.919937:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1789263773.919940:0:15206:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9dd9873199b8) has no exports 00000100:00100000:3.0:1789263773.919977:0:8511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898103168 00000100:00100000:3.0:1789263773.919983:0:8511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898103168 00000100:00100000:3.0:1789263773.920022:0:8511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898103296 00000100:00100000:3.0:1789263773.920026:0:8511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898103296 00000020:00000080:0.0:1789263773.920027:0:8499:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1d72f 00000100:00100000:2.0:1789263773.920048:0:8395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789263773.920060:0:8395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8840b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1876178898103168:12345-0@lo:9:umount.0 00000100:00100000:3.0:1789263773.920067:0:8511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000020:00000080:2.0:1789263773.920098:0:8395:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1d74b 00000100:00100000:3.0:1789263773.920109:0:8511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8840b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1876178898103296:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789263773.920126:0:8511:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1d89b 00000100:00080000:2.0:1789263773.920132:0:8395:0:(import.c:65:import_set_state_nolock()) ffff9dd9bf99d800 : changing import state from FULL to CLOSED 00000100:00080000:3.0:1789263773.920135:0:8511:0:(import.c:65:import_set_state_nolock()) ffff9dd882a35800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789263773.920225:0:8395:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000001:00000004:3.0:1789263773.920232:0:8511:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00080000:0.0:1789263773.920246:0:8499:0:(import.c:65:import_set_state_nolock()) ffff9dd9bf99f800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789263773.920264:0:8499:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:3.0:1789263773.920372:0:8511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8840b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3617:x1876178898103296:12345-0@lo:9:umount.0 Request processed in 297us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263773.920381:0:8395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8840b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3617:x1876178898103168:12345-0@lo:9:umount.0 Request processed in 324us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263773.920384:0:8511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789263773.920386:0:8499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882a6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3617:x1876178898103040:12345-0@lo:39:umount.0 Request processed in 601us (924us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1789263773.920396:0:8395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789263773.920400:0:8499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:3.0:1789263773.920442:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789263773.920455:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263773.920465:0:13689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789263773.920482:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd9bf8ed800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789263773.920494:0:3617:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789263773.920497:0:3617:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789263773.920501:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1876178898103296:0@lo:9:umount.0 00000100:00100000:2.0:1789263773.920517:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000100:00080000:2.0:1789263773.920521:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd9bb5f9800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789263773.920533:0:3617:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789263773.920536:0:3617:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789263773.920540:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9c09f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1876178898103168:0@lo:9:umount.0 00000100:00080000:2.0:1789263773.920560:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd984ce7000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1789263773.920566:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88297f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1876178898103040:0@lo:39:umount.0 00010000:00010000:1.0:1789263773.920739:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263774.125265:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263775.149263:0:13146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789263775.789763:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3621:1876178898103808:0@lo:400:kworker.0 00000100:00100000:1.0:1789263775.789785:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1876178898103680:0@lo:400:kworker.0 00000100:00100000:1.0:1789263775.789824:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263775.789861:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263775.789874:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989afd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1876178898104192:0@lo:400:kworker.0 00000100:00100000:0.0:1789263775.789898:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3621:1876178898104320:0@lo:400:kworker.0 00000100:00100000:1.0:1789263775.789905:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263775.789930:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263775.789962:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898103680 00000100:00100000:0.0:1789263775.789969:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898103808 00000100:00100000:1.0:1789263775.789970:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898103680 00000100:00100000:0.0:1789263775.789975:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898103808 00000100:00100000:1.0:1789263775.790007:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898104192 00000100:00100000:1.0:1789263775.790012:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898104192 00000100:00100000:0.0:1789263775.790018:0:7434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898104320 00000100:00100000:0.0:1789263775.790022:0:7434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898104320 00000100:00100000:1.0:1789263775.790048:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1789263775.790061:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3620:x1876178898103680:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1789263775.790072:0:8417:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1789263775.790118:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1789263775.790120:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:66a76ccf-c64c-4b18-8369-a2861ec3956c:3618:1876178898103424:0@lo:400:kworker.0 00000100:00100000:0.0:1789263775.790133:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1789263775.790145:0:7434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3621:x1876178898103808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263775.790148:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882610700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1876178898104320:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1789263775.790161:0:7434:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1789263775.790162:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3620:x1876178898103680:12345-0@lo:400:kworker.0 Request processed in 101us (332us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789263775.790174:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1789263775.790176:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263775.790216:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1789263775.790223:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3620:x1876178898104192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789263775.790226:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1876178898103936:0@lo:400:kworker.0 00000100:00100000:0.0:1789263775.790230:0:7434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3621:x1876178898103808:12345-0@lo:400:kworker.0 Request processed in 85us (368us total) trans 0 rc -107/-107 00000020:00080000:1.0:1789263775.790235:0:8417:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1789263775.790249:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1789263775.790258:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882610700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1876178898104320:12345-0@lo:400:kworker.0 Request processed in 125us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263775.790268:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1789263775.790282:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263775.790292:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3620:x1876178898104192:12345-0@lo:400:kworker.0 Request processed in 67us (387us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789263775.790302:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00080000:0.0:1789263775.790307:0:3621:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00100000:3.0:1789263775.790312:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898103936 00000100:00080000:0.0:1789263775.790314:0:3621:0:(import.c:65:import_set_state_nolock()) ffff9dd88269f000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:00100000:2.0:1789263775.790318:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898104448:0@lo:400:kworker.0 00000100:00100000:3.0:1789263775.790322:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898103936 00000100:02000400:0.0:1789263775.790323:0:3621:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1789263775.790350:0:3620:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789263775.790355:0:3620:0:(import.c:65:import_set_state_nolock()) ffff9dd9c1ba3800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1789263775.790361:0:3620:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1789263775.790367:0:3620:0:(import.c:65:import_set_state_nolock()) ffff9dd9c1ba3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1789263775.790376:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789263775.790376:0:3620:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 112 00000100:00080000:1.0:1789263775.790388:0:3620:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9dd9c1ba3800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:3.0:1789263775.790398:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789263775.790413:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8840b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876178898103936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789263775.790413:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789263775.790415:0:3620:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd9bfa86d80 x1876178898104576/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789263775.790432:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898103552:0@lo:400:kworker.0 00000100:00100000:1.0:1789263775.790454:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1876178898103680:0@lo:400:kworker.0 00000100:00080000:1.0:1789263775.790481:0:3620:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789263775.790486:0:3620:0:(import.c:65:import_set_state_nolock()) ffff9dd883880800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:00100000:3.0:1789263775.790491:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8840b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876178898103936:12345-0@lo:400:kworker.0 Request processed in 80us (209us total) trans 0 rc 0/0 00000100:02000400:1.0:1789263775.790496:0:3620:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:2.0:1789263775.790500:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789263775.790513:0:3620:0:(import.c:65:import_set_state_nolock()) ffff9dd883880800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1789263775.790521:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00080000:1.0:1789263775.790525:0:3620:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 129 00000100:00080000:1.0:1789263775.790531:0:3620:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9dd883880800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:2.0:1789263775.790537:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989aff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898104064:0@lo:400:kworker.0 00000100:00100000:1.0:1789263775.790550:0:3620:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd9bfa85c00 x1876178898104704/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789263775.790564:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989afd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1876178898104192:0@lo:400:kworker.0 00000100:00100000:2.0:1789263775.790597:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263775.790611:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3617:1876178898104576:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1789263775.790624:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898103552 00000100:00100000:3.0:1789263775.790630:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898103552 00010000:00080000:2.0:1789263775.790665:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd99f9a6300 x1876178898103936/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263791 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789263775.790675:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263775.790685:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789263775.790702:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c09f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3618:x1876178898103552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789263775.790704:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1876178898103936:0@lo:400:kworker.0 00000100:00100000:1.0:1789263775.790705:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3617:1876178898104704:0@lo:38:ptlrpcd_00_02.0 00000020:00080000:3.0:1789263775.790721:0:6492:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1789263775.790730:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789263775.790745:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898104832:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789263775.790755:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263775.790785:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c09f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3618:x1876178898103552:12345-0@lo:400:kworker.0 Request processed in 84us (294us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789263775.790795:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789263775.790803:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263775.790829:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898104576 00000100:00100000:1.0:1789263775.790835:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898104576 00000100:00100000:3.0:1789263775.790845:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898104704 00000100:00100000:3.0:1789263775.790851:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898104704 00000100:00080000:2.0:1789263775.790854:0:3618:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789263775.790859:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9dd9c0bdc800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:00100000:1.0:1789263775.790862:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:02000400:2.0:1789263775.790866:0:3618:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1789263775.790873:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9dd9c0bdc800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789263775.790879:0:3618:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 112 00000100:00100000:3.0:1789263775.790886:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00080000:2.0:1789263775.790888:0:3618:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9dd9c0bdc800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:3.0:1789263775.790900:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989afd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3617:x1876178898104704:12345-0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1789263775.790900:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3617:x1876178898104576:12345-0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1789263775.790915:0:3618:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd884acea00 x1876178898104960/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:02000000:3.0:1789263775.790932:0:6487:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:1.0:1789263775.790936:0:8417:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1789263775.790942:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898103552:0@lo:400:kworker.0 00000100:00100000:1.0:1789263775.790977:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3617:x1876178898104576:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 104us (306us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789263775.790979:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898103424 00000100:00100000:2.0:1789263775.790985:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898103424 00000100:00100000:1.0:1789263775.790989:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1789263775.791019:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1789263775.791027:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9b7a14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+19:3618:x1876178898103424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789263775.791066:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9b7a14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66a76ccf-c64c-4b18-8369-a2861ec3956c+19:3618:x1876178898103424:12345-0@lo:400:kworker.0 Request processed in 40us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263775.791071:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1789263775.791120:0:8394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898104448 00000100:00100000:2.0:1789263775.791129:0:8394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898104448 00000100:00100000:1.0:1789263775.791143:0:8396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898104832 00000100:00100000:1.0:1789263775.791150:0:8396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898104832 00000100:00100000:2.0:1789263775.791163:0:8394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898104064 00000100:00100000:2.0:1789263775.791168:0:8394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898104064 00000100:00100000:1.0:1789263775.791183:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789263775.791192:0:8396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd884acfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3618:x1876178898104832:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789263775.791199:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789263775.791209:0:8394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8840b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3618:x1876178898104448:12345-0@lo:400:kworker.0 00002000:00000024:1.0:1789263775.791214:0:8396:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789263775.791249:0:8394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8840b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3618:x1876178898104448:12345-0@lo:400:kworker.0 Request processed in 42us (879us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263775.791258:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789263775.791261:0:8396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd884acfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3618:x1876178898104832:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263775.791269:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789263775.791274:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789263775.791284:0:8394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd884acca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1876178898104064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789263775.791320:0:8394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd884acca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1876178898104064:12345-0@lo:400:kworker.0 Request processed in 38us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263775.791326:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd884acea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1876178898104960:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1789263775.791327:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789263775.791361:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263775.791370:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898104832:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789263775.791386:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989aff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898104064:0@lo:400:kworker.0 00000100:00080000:1.0:1789263775.791392:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd9c1ba3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789263775.791399:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789263775.791402:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:66a76ccf-c64c-4b18-8369-a2861ec3956c:3618:1876178898103424:0@lo:400:kworker.0 00000100:00100000:1.0:1789263775.791406:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3617:1876178898104576:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1789263775.791416:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898104448:0@lo:400:kworker.0 00000100:00080000:2.0:1789263775.791467:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789263775.791468:0:8499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898104960 00000100:00080000:2.0:1789263775.791471:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789263775.791474:0:8499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898104960 00000100:00080000:2.0:1789263775.791476:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789263775.791497:0:8499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789263775.791503:0:8499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3617:x1876178898104960:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:1.0:1789263775.791512:0:8499:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1789263775.791547:0:8499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3617:x1876178898104960:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 44us (187us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789263775.791553:0:8499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:2.0:1789263775.792714:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd9c0bdc800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789263775.792720:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789263775.792724:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd884acea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1876178898104960:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:0.0:1789263775.795848:0:3621:0:(import.c:65:import_set_state_nolock()) ffff9dd88269f000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789263775.795857:0:3621:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 120 00000100:00080000:0.0:1789263775.795866:0:3621:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9dd88269f000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:0.0:1789263775.795907:0:3621:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd9bfaae680 x1876178898105088/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789263775.795946:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3621:1876178898103808:0@lo:400:kworker.0 00010000:00080000:0.0:1789263775.795974:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd9bfa86300 x1876178898104320/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263791 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263775.795986:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3621:1876178898104320:0@lo:400:kworker.0 00000100:00100000:2.0:1789263775.795998:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3617:1876178898105088:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1789263775.796065:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263775.796158:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898105088 00000100:00100000:1.0:1789263775.796171:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898105088 00000100:00100000:1.0:1789263775.796220:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1789263775.796228:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd884acea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3617:x1876178898105088:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:1.0:1789263775.796244:0:8417:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1789263775.796291:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd884acea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3617:x1876178898105088:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 62us (226us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789263775.796299:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00080000:2.0:1789263775.796318:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd88269f000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789263775.796325:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789263775.796329:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3617:1876178898105088:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1789263775.803009:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989afd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3617:x1876178898104704:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 12106us (12249us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789263775.803026:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00080000:2.0:1789263775.803070:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd883880800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789263775.803107:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789263775.803113:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3617:1876178898104704:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:3.0:1789263776.173225:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789263776.301267:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789263776.301290:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898105216:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789263776.301351:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263776.301475:0:8512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898105216 00000100:00100000:2.0:1789263776.301482:0:8512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898105216 00000100:00100000:2.0:1789263776.301528:0:8512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789263776.301537:0:8512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1876178898105216:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789263776.301563:0:8512:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1789263776.301608:0:8512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1876178898105216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263776.301615:0:8512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789263776.301667:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898105216:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789263777.197243:0:13689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263778.222251:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789263778.862313:0:6466:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789263778.862321:0:6466:0:(genops.c:885:class_export_put()) final put ffff9dd9c1b40000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1789263778.862355:0:6466:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 857a0866-badb-47ac-9591-fbf273e4680e 00000001:00080000:1.0:1789263778.862363:0:6466:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967516 is committed 00000020:00000080:2.0:1789263778.862366:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd9c1b40000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1789263778.862368:0:6466:0:(genops.c:885:class_export_put()) final put ffff9dd883faf000/857a0866-badb-47ac-9591-fbf273e4680e 00000001:00100000:1.0:1789263778.862386:0:6466:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3ce90ea2-917f-4b54-98b0-25e051f2317f 00000001:00080000:1.0:1789263778.862391:0:6466:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967515 is committed 00000020:00080000:1.0:1789263778.862401:0:6466:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00000080:1.0:1789263778.862416:0:6466:0:(genops.c:885:class_export_put()) final put ffff9dd882a32000/3ce90ea2-917f-4b54-98b0-25e051f2317f 00000020:00080000:3.0:1789263778.862447:0:6519:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9dd9bf982240 refcount 1 committed 1 result 0 batchid 8 00000020:00080000:3.0:1789263778.862454:0:6519:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9dd9bb641500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9dd9bf982600 00000020:00080000:3.0:1789263778.862458:0:6519:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9dd9bb641d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9dd8840f3000 00000020:00000080:3.0:1789263778.862578:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd883faf000/857a0866-badb-47ac-9591-fbf273e4680e for lustre-MDT0000 00000020:00000080:3.0:1789263778.862611:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd9c0a4a800 for lustre-MDT0000 00000020:00000080:3.0:1789263778.862616:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd882a32000/3ce90ea2-917f-4b54-98b0-25e051f2317f for lustre-MDT0000 00000020:00000080:3.0:1789263778.862660:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd883fac000 for lustre-MDT0000 00000020:00000080:3.0:1789263778.862664:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd882a37800 for lustre-MDT0000 00000001:00100000:3.0:1789263778.862906:0:9479:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789263778.862916:0:9479:0:(genops.c:885:class_export_put()) final put ffff9dd882a34800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1789263778.862994:0:7417:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1789263778.863002:0:7417:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000001:00100000:3.0:1789263778.863007:0:9479:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3ce90ea2-917f-4b54-98b0-25e051f2317f 00000020:00000080:3.0:1789263778.863013:0:9479:0:(genops.c:885:class_export_put()) final put ffff9dd884009800/3ce90ea2-917f-4b54-98b0-25e051f2317f 00000020:00000080:1.0:1789263778.863014:0:7417:0:(genops.c:885:class_export_put()) final put ffff9dd88269f800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1789263778.863026:0:7417:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 857a0866-badb-47ac-9591-fbf273e4680e 00000001:00080000:1.0:1789263778.863030:0:7417:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:1.0:1789263778.863032:0:7417:0:(genops.c:885:class_export_put()) final put ffff9dd9bfa32000/857a0866-badb-47ac-9591-fbf273e4680e 00000001:00100000:1.0:1789263778.863037:0:7417:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 3ce90ea2-917f-4b54-98b0-25e051f2317f 00000001:00080000:1.0:1789263778.863041:0:7417:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:1.0:1789263778.863042:0:7417:0:(genops.c:885:class_export_put()) final put ffff9dd883f0f800/3ce90ea2-917f-4b54-98b0-25e051f2317f 00000020:00000080:2.0:1789263778.863065:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd882a34800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1789263778.863122:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd884009800/3ce90ea2-917f-4b54-98b0-25e051f2317f for lustre-OST0001 00000020:00000080:2.0:1789263778.863137:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd88269f800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1789263778.863161:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd9bfa32000/857a0866-badb-47ac-9591-fbf273e4680e for lustre-MDT0001 00000020:00000080:2.0:1789263778.863177:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd883f0f800/3ce90ea2-917f-4b54-98b0-25e051f2317f for lustre-MDT0001 00000020:00000080:2.0:1789263778.863196:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd882a35800 for lustre-OST0001 00000020:00000080:2.0:1789263778.863201:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd88400b800 for lustre-OST0001 00000020:00000080:2.0:1789263778.863204:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd9bf99f800 for lustre-MDT0001 00000020:00000080:2.0:1789263778.863207:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd9bfa30000 for lustre-MDT0001 00000020:00000080:2.0:1789263778.863210:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd883f0d800 for lustre-MDT0001 00000001:00100000:2.0:1789263778.863855:0:8388:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789263778.863866:0:8388:0:(genops.c:885:class_export_put()) final put ffff9dd9bf99d000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1789263778.863885:0:8388:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3ce90ea2-917f-4b54-98b0-25e051f2317f 00000020:00000080:2.0:1789263778.863888:0:8388:0:(genops.c:885:class_export_put()) final put ffff9dd88400f000/3ce90ea2-917f-4b54-98b0-25e051f2317f 00000020:00000080:3.0:1789263778.863912:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd9bf99d000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1789263778.863956:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd88400f000/3ce90ea2-917f-4b54-98b0-25e051f2317f for lustre-OST0000 00000020:00000080:3.0:1789263778.863981:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd9bf99d800 for lustre-OST0000 00000020:00000080:3.0:1789263778.863986:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd883886800 for lustre-OST0000 00000020:00080000:1.0:1789263778.872508:0:15206:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9dd9873199b8) has no exports 00000020:00000080:1.0:1789263778.899230:0:15206:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1d4c7 00000020:00000080:1.0:1789263778.899246:0:15206:0:(genops.c:885:class_export_put()) final put ffff9dd9c08ec000/lustre-QMT0000_UUID 00000020:01000000:1.0:1789263778.899265:0:15206:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1789263778.899276:0:15206:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789263778.899284:0:15206:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789263778.899289:0:15206:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9dd99f9c3370) has no exports 00000020:00000080:3.0:1789263778.899425:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd9c08ec000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1789263778.899517:0:15206:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1d4c0 00000020:00000080:1.0:1789263778.899524:0:15206:0:(genops.c:885:class_export_put()) final put ffff9dd9c088b000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789263778.899562:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd9c088b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789263778.899581:0:15206:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789263778.899587:0:15206:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1789263778.899589:0:15206:0:(genops.c:885:class_export_put()) final put ffff9dd99f9cb800/lustre-QMT0000_UUID 00000020:00000080:1.0:1789263778.899591:0:15206:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd99f9cb800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1789263778.899596:0:15206:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:1.0:1789263778.899721:0:15206:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9dd98e776cc0 - data ffff9dd9b3e7b948/ffff9dd9bb5d5800 00000020:01000000:1.0:1789263778.899832:0:15206:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9dd99157cf00 - data ffff9dd9b3c686c0/ffff9dd99f9a0800 00000001:00000004:1.0:1789263778.912295:0:15206:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967516 00000100:00080000:0.0:1789263778.932957:0:15206:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789263778.932965:0:15206:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:0.0:1789263778.932979:0:15206:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9dd88297f480 x1876178898103040/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789263783 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263778.933013:0:15206:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1789263778.933984:0:15206:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789263778.933997:0:15206:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:0.0:1789263778.934013:0:15206:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789263778.934015:0:15206:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1789263778.934341:0:8508:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1789263778.934345:0:8508:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 3 00000040:00080000:2.0:1789263778.934354:0:8508:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1789263778.934551:0:15206:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789263778.934554:0:15206:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:0.0:1789263778.934568:0:15206:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789263778.934570:0:15206:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789263778.934768:0:9683:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789263778.934772:0:9683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:1.0:1789263778.934784:0:9683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1789263778.935721:0:15206:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1d48f 00000020:00000080:0.0:1789263778.935730:0:15206:0:(genops.c:885:class_export_put()) final put ffff9dd99f968800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789263778.935767:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd99f968800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789263778.938010:0:15206:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1d4a4 00000020:00000080:0.0:1789263778.938020:0:15206:0:(genops.c:885:class_export_put()) final put ffff9dd99f9cb000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1789263778.938034:0:15206:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1789263778.938044:0:15206:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789263778.938051:0:15206:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789263778.938055:0:15206:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9dd98731cd28) has no exports 00000020:00000080:1.0:1789263778.938058:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd99f9cb000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:0.0:1789263778.938297:0:15206:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1789263778.938305:0:15206:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1d894 00000020:00000080:0.0:1789263778.938309:0:15206:0:(genops.c:885:class_export_put()) final put ffff9dd883892000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1789263778.938319:0:15206:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1789263778.938324:0:15206:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789263778.938328:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd883892000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1789263778.938334:0:15206:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789263778.938338:0:15206:0:(genops.c:1558:class_disconnect_exports()) OBD device 28 (ffff9dd88389cd28) has no exports 00000020:00000080:0.0:1789263778.938345:0:15206:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1d88d 00000020:00000080:0.0:1789263778.938351:0:15206:0:(genops.c:885:class_export_put()) final put ffff9dd9c1b47000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789263778.938366:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd9c1b47000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1789263778.938802:0:15206:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1789263778.938807:0:15206:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789263778.938811:0:15206:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:0.0:1789263778.938817:0:15206:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789263778.938819:0:15206:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789263778.938843:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd9bf8ed800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1789263778.938863:0:15206:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789263778.938872:0:15206:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789263778.938876:0:15206:0:(genops.c:885:class_export_put()) final put ffff9dd883893800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789263778.938879:0:15206:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd883893800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1789263778.938892:0:15206:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789263778.938975:0:15206:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1d744 00000020:00000080:0.0:1789263778.938984:0:15206:0:(genops.c:885:class_export_put()) final put ffff9dd9bf8e9000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1789263778.938989:0:15206:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1789263778.938992:0:15206:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789263778.938997:0:15206:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789263778.939000:0:15206:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9dd9b7984d28) has no exports 00000020:00000080:0.0:1789263778.939004:0:15206:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1d73d 00000020:00000080:0.0:1789263778.939006:0:15206:0:(genops.c:885:class_export_put()) final put ffff9dd9bb5fc800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789263778.939028:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd9bf8e9000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1789263778.939039:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd9bb5fc800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1789263778.939460:0:15206:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1789263778.939464:0:15206:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789263778.939466:0:15206:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:0.0:1789263778.939470:0:15206:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789263778.939471:0:15206:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789263778.939506:0:15206:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789263778.939513:0:15206:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789263778.939517:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd9bb5f9800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1789263778.939526:0:8:0:(genops.c:885:class_export_put()) final put ffff9dd881f8d000/lustre-MDT0000-mdtlov_UUID 00000004:01000000:0.0:1789263778.939528:0:15206:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1789263778.939529:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd881f8d000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1789263778.939536:0:15206:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1d728 00000020:01000000:1.0:1789263778.939537:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789263778.939549:0:15206:0:(genops.c:885:class_export_put()) final put ffff9dd9c08ea000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1789263778.939555:0:15206:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:0.0:1789263778.939559:0:15206:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789263778.939564:0:15206:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789263778.939566:0:15206:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff9dd9bf8f19b8) has no exports 00000020:00000080:0.0:1789263778.939570:0:15206:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1d721 00000020:00000080:0.0:1789263778.939573:0:15206:0:(genops.c:885:class_export_put()) final put ffff9dd9c1ba0000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789263778.939621:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd9c08ea000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1789263778.939648:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd9c1ba0000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1789263778.941115:0:15206:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1789263778.941120:0:15206:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789263778.941123:0:15206:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:1.0:1789263778.941131:0:15206:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789263778.941157:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd984ce7000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1789263778.941179:0:15206:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789263778.941190:0:15206:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789263778.941193:0:15206:0:(genops.c:885:class_export_put()) final put ffff9dd88269e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789263778.941196:0:15206:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd88269e800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1789263778.941201:0:15206:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789263778.941273:0:15206:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789263778.941278:0:15206:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789263778.941281:0:15206:0:(genops.c:885:class_export_put()) final put ffff9dd99f96d800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789263778.941284:0:15206:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd99f96d800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1789263778.941291:0:15206:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789263778.941411:0:15206:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1d4ab 00000020:00000080:1.0:1789263778.941418:0:15206:0:(genops.c:885:class_export_put()) final put ffff9dd99f9ce000/lustre-MDD0000_UUID 00000020:01000000:1.0:1789263778.941429:0:15206:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1789263778.941434:0:15206:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789263778.941435:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd99f9ce000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1789263778.941447:0:15206:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789263778.941451:0:15206:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9dd99f9c19b8) has no exports 00000020:00000080:1.0:1789263778.941488:0:15206:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789263778.941493:0:15206:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1789263778.941496:0:15206:0:(genops.c:885:class_export_put()) final put ffff9dd99f969800/lustre-MDD0000_UUID 00000020:00000080:1.0:1789263778.941499:0:15206:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd99f969800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1789263778.941506:0:15206:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1789263778.941549:0:15206:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1d4b2 00000020:00000080:1.0:1789263778.941555:0:15206:0:(genops.c:885:class_export_put()) final put ffff9dd99f9c9800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789263778.941572:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd99f9c9800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:1.0:1789263778.941577:0:15206:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dd9896b8000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1789263778.941582:0:15206:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dd9896b8000 3 00000020:01000004:1.0:1789263778.941586:0:15206:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9dd9896b8000 from lustre-MDT0000 00000020:00000080:1.0:1789263778.941607:0:15206:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789263778.941612:0:15206:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1789263778.941615:0:15206:0:(genops.c:885:class_export_put()) final put ffff9dd99f96a800/lustre-MDT0000_UUID 00000020:00000080:1.0:1789263778.941618:0:15206:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd99f96a800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1789263778.941639:0:15206:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1789263778.941677:0:15206:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1789263778.941681:0:15206:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1789263778.941684:0:15206:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1789263778.941687:0:15206:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789263778.941691:0:15206:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789263778.941702:0:15206:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9dd991569000 66a76ccf-c64c-4b18-8369-a2861ec3956c 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789263778.941708:0:15206:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9dd987318000) has exports, disconnecting them 00000020:00080000:1.0:1789263778.941713:0:15206:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9dd991569000), last request at 1789263662 00000020:00000080:1.0:1789263778.941727:0:15206:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1d450 00000020:00010000:1.0:1789263778.941738:0:15206:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9dd991569000: total 0 00000100:00080000:1.0:1789263778.941741:0:15206:0:(import.c:65:import_set_state_nolock()) ffff9dd99156f800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1789263778.941759:0:15206:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dd991569000): rc 0 00000020:00080000:1.0:1789263778.941764:0:15206:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9dd987318000) has no exports 00000020:00010000:2.0:1789263778.941772:0:7427:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9dd991569000: total 0 00010000:00010000:2.0:1789263778.941777:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789263778.941830:0:7427:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9dd991569000, canceled 0 locks, left on hash table 13. 00000100:00100000:1.0:1789263778.941841:0:6481:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9dd9acb84000:6481] 1 exiting: rc = 0 00010000:00010000:2.0:1789263778.941865:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd990433000/0xce1582440fb1d92e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xce1582440fb1d927 expref: 14 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263778.941882:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd981683c00/0xce1582440fb1d920 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xce1582440fb1d919 expref: 13 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263778.941897:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd9bfa23c00/0xce1582440fb1d82b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xce1582440fb1d824 expref: 12 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263778.941921:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd990432600/0xce1582440fb1d94a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xce1582440fb1d943 expref: 11 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263778.941938:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd990432a00/0xce1582440fb1d9c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xce1582440fb1d9c1 expref: 10 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263778.941953:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd883f59600/0xce1582440fb1dbb2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xce1582440fb1dbab expref: 9 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263778.941966:0:6480:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9dd9b79ce600:6480] 0 exiting: rc = 1 00010000:00010000:2.0:1789263778.941968:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd9813fda00/0xce1582440fb1d958 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xce1582440fb1d951 expref: 8 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263778.942000:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd990432c00/0xce1582440fb1d54c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xce1582440fb1d545 expref: 7 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263778.942026:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd883f58200/0xce1582440fb1dba4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xce1582440fb1db9d expref: 6 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263778.942047:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd990433400/0xce1582440fb1d55a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xce1582440fb1d553 expref: 5 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263778.942063:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd9813fd800/0xce1582440fb1d974 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xce1582440fb1d96d expref: 4 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263778.942104:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd9bfa22800/0xce1582440fb1d982 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xce1582440fb1d97b expref: 3 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263778.942126:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd883e72a00/0xce1582440fb1dbc0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xce1582440fb1dbb9 expref: 2 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263778.942141:0:7427:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9dd991569000, canceled 13 locks, left on hash table 0. 00000100:00100000:1.0:1789263778.942145:0:6482:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9dd9984a9200:6482] 2 exiting: rc = 0 00000020:00000080:2.0:1789263778.942161:0:7427:0:(genops.c:885:class_export_put()) final put ffff9dd991569000/66a76ccf-c64c-4b18-8369-a2861ec3956c 00010000:00010000:2.0:1789263778.942194:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789263778.942196:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789263778.942200:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789263778.942238:0:15206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263778.942254:0:15206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263778.942262:0:15206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263778.942271:0:15206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1789263778.942276:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd991569000/66a76ccf-c64c-4b18-8369-a2861ec3956c for MGS 00000100:00100000:1.0:1789263778.942283:0:15206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263778.942293:0:15206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263778.942306:0:15206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1789263778.942315:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd99156f800 for MGS 00000100:00100000:1.0:1789263778.942322:0:15206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263778.942332:0:15206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263778.942341:0:15206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263778.942355:0:15206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263778.942367:0:15206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263778.942382:0:15206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263778.942392:0:15206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263778.942400:0:15206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263778.942413:0:15206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263778.942425:0:15206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263778.942437:0:15206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263778.942446:0:15206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263778.942454:0:15206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263778.942463:0:15206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263778.942470:0:15206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263778.942478:0:15206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263778.942485:0:15206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263778.942492:0:15206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263778.942498:0:15206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263778.942505:0:15206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263778.942512:0:15206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263778.942519:0:15206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263778.942527:0:15206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263778.942534:0:15206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263778.942542:0:15206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263778.942550:0:15206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263778.942558:0:15206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263778.942574:0:15206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263778.942581:0:15206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263778.942587:0:15206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263778.942594:0:15206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263778.942603:0:15206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263778.942613:0:15206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263778.942624:0:15206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263778.942645:0:15206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263778.942651:0:15206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263778.942657:0:15206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263778.942669:0:15206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263778.942675:0:15206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263778.942679:0:15206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263778.942688:0:15206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263778.942695:0:15206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263778.942703:0:15206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263778.942710:0:15206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263778.942718:0:15206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263778.942725:0:15206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263778.942732:0:15206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263778.942739:0:15206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263778.942747:0:15206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263778.942755:0:15206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263778.942763:0:15206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263778.942771:0:15206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263778.942778:0:15206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263778.942785:0:15206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263778.942792:0:15206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263778.942797:0:15206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263778.942801:0:15206:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1789263778.943564:0:15206:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9dd883b02d20 - data ffff9dd9b3ccbd80/ffff9dd883f16800 00000020:01000000:1.0:1789263778.943761:0:15206:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9dd985bb96c0 - data ffff9dd98342e0d8/ffff9dd9908f3000 00000020:00000080:1.0:1789263778.944390:0:15206:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1d434 00000020:00000080:1.0:1789263778.944397:0:15206:0:(genops.c:885:class_export_put()) final put ffff9dd989576000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1789263778.944418:0:15206:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dd9896b8000 from MGS, refs=2 00000020:01000004:1.0:1789263778.944422:0:15206:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dd9896b8000 2 00000020:01000004:1.0:1789263778.944425:0:15206:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9dd9896b8000 from MGS 00000020:00000080:2.0:1789263778.944426:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd989576000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789263778.944450:0:15206:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789263778.944456:0:15206:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1789263778.944458:0:15206:0:(genops.c:885:class_export_put()) final put ffff9dd9ac8fd000/MGS 00000020:00000080:1.0:1789263778.944460:0:15206:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd9ac8fd000/MGS for MGS 00000020:01000000:1.0:1789263778.944464:0:15206:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1789263778.944524:0:15206:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1789263778.944535:0:15206:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789263778.944541:0:15206:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789263778.944547:0:15206:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9dd9c0a4e000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789263778.944552:0:15206:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff9dd9c09c0000) has exports, disconnecting them 00000020:00080000:1.0:1789263778.944557:0:15206:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9dd9c0a4e000), last request at 1789263662 00000020:00000080:1.0:1789263778.944560:0:15206:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1d4ff 00000020:00080000:1.0:1789263778.944572:0:15206:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dd9c0a4e000): rc 0 00000020:00000080:1.0:1789263778.944576:0:15206:0:(genops.c:885:class_export_put()) final put ffff9dd9c0a4e000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1789263778.944597:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd9c0a4e000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1789263778.947130:0:15206:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1789263778.947137:0:15206:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789263778.947141:0:15206:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789263778.947149:0:15206:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789263778.947194:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd984ce5800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1789263778.947437:0:15206:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789263778.947446:0:15206:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1789263778.947450:0:15206:0:(genops.c:885:class_export_put()) final put ffff9dd985540000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1789263778.947464:0:15206:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd985540000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1789263778.947471:0:15206:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1789263778.947621:0:15206:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dd9896b8000 1 00000020:00000080:0.0:1789263778.947637:0:15206:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1d426 00000020:00000080:0.0:1789263778.947644:0:15206:0:(genops.c:885:class_export_put()) final put ffff9dd9ac8ff800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1789263778.947653:0:15206:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1789263778.947658:0:15206:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789263778.947663:0:15206:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00000080:2.0:1789263778.947665:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd9ac8ff800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00080000:0.0:1789263778.947667:0:15206:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9dd98731b370) has no exports 00000020:00000080:1.0:1789263778.973286:0:15206:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789263778.973297:0:15206:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1789263778.973302:0:15206:0:(genops.c:885:class_export_put()) final put ffff9dd9896b9000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789263778.973307:0:15206:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd9896b9000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1789263778.973312:0:15206:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1789263778.973417:0:15206:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9dd9896bd000 00000020:02000400:1.0:1789263778.973505:0:15206:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1789263779.246373:0:13146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263780.269247:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789263780.343197:0:15407:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1789263780.351262:0:15407:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:0.0:1789263780.351317:0:15407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd990432e00/0xce1582440fb1d96d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d974 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263780.351332:0:15407:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd990432e00/0xce1582440fb1d96d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1d974 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263780.351340:0:15407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd990432e00/0xce1582440fb1d96d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xce1582440fb1d974 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263780.351347:0:15407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff9dd990432e00/0xce1582440fb1d96d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xce1582440fb1d974 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263780.351369:0:15407:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789263780.351375:0:15407:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789263780.351412:0:15407:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789263780.351417:0:15407:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789263780.351425:0:15407:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789263780.351433:0:15407:0:(import.c:65:import_set_state_nolock()) ffff9dd9c1ba3800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1789263780.351439:0:15407:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:3.0:1789263780.351449:0:13689:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1789263780.351455:0:15407:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00010000:00010000:3.0:1789263780.351460:0:13689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd990432e00/0xce1582440fb1d96d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xce1582440fb1d974 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263780.351461:0:15407:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789263780.351471:0:13689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd990432e00 already unused, calling callback (ffffffffc12b1c20) 10000000:00010000:3.0:1789263780.351475:0:13689:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd990432e00/0xce1582440fb1d96d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xce1582440fb1d974 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263780.351484:0:13689:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd990432e00/0xce1582440fb1d96d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xce1582440fb1d974 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789263780.351491:0:13689:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd990432e00/0xce1582440fb1d96d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xce1582440fb1d974 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789263780.351496:0:13689:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789263780.351499:0:13689:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789263780.351501:0:13689:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789263780.351537:0:13689:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff9dd990432e00/0xce1582440fb1d96d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xce1582440fb1d974 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263780.351554:0:13689:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789263780.351589:0:13689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd990432e00/0xce1582440fb1d96d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xce1582440fb1d974 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263780.351596:0:13689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd990432e00/0xce1582440fb1d96d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xce1582440fb1d974 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263780.351610:0:13689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789263780.351611:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1789263780.351613:0:13689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263780.351628:0:13689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789263780.351642:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:66a76ccf-c64c-4b18-8369-a2861ec3956c:3620:1876178898105344:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789263780.351724:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263780.351773:0:10303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898105344 00000100:00100000:1.0:1789263780.351781:0:10303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898105344 00000100:00100000:1.0:1789263780.351826:0:10303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789263780.351833:0:10303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd884ace300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0+-99:3620:x1876178898105344:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1789263780.351838:0:10303:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789263780 with bad export cookie 14849918575156778064 00010000:00010000:0.0:1789263780.352722:0:15407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9813fc600/0xce1582440fb1d97b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d982 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263780.352734:0:15407:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9813fc600/0xce1582440fb1d97b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1d982 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263780.352755:0:15407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9813fc600/0xce1582440fb1d97b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xce1582440fb1d982 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263780.352762:0:15407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff9dd9813fc600/0xce1582440fb1d97b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xce1582440fb1d982 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263780.352796:0:15407:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789263780.352803:0:15407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd990432000/0xce1582440fb1d824 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d82b expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263780.352810:0:15407:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd990432000/0xce1582440fb1d824 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1d82b expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263780.352817:0:15407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd990432000/0xce1582440fb1d824 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xce1582440fb1d82b expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263780.352823:0:15407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff9dd990432000/0xce1582440fb1d824 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xce1582440fb1d82b expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263780.352840:0:15407:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789263780.352846:0:15407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883f58600/0xce1582440fb1dbb9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1dbc0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263780.352862:0:7427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789263780.352866:0:15407:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883f58600/0xce1582440fb1dbb9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1dbc0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263780.352869:0:7427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd9813fc600/0xce1582440fb1d97b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xce1582440fb1d982 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263780.352882:0:15407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883f58600/0xce1582440fb1dbb9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xce1582440fb1dbc0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263780.352883:0:7427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9813fc600 already unused, calling callback (ffffffffc12b1c20) 10000000:00010000:2.0:1789263780.352886:0:7427:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd9813fc600/0xce1582440fb1d97b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xce1582440fb1d982 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263780.352892:0:7427:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd9813fc600/0xce1582440fb1d97b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xce1582440fb1d982 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789263780.352897:0:7427:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd9813fc600/0xce1582440fb1d97b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xce1582440fb1d982 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789263780.352913:0:7427:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789263780.352914:0:7427:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:2.0:1789263780.352931:0:7427:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff9dd9813fc600/0xce1582440fb1d97b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xce1582440fb1d982 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263780.352936:0:7427:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789263780.352939:0:15407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff9dd883f58600/0xce1582440fb1dbb9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xce1582440fb1dbc0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263780.352957:0:7427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd9813fc600/0xce1582440fb1d97b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xce1582440fb1d982 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263780.352965:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd9813fc600/0xce1582440fb1d97b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xce1582440fb1d982 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263780.352983:0:7427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789263780.352986:0:7427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd990432000/0xce1582440fb1d824 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xce1582440fb1d82b expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263780.352993:0:15407:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789263780.353003:0:7427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd990432000 already unused, calling callback (ffffffffc12b1c20) 10000000:00010000:2.0:1789263780.353007:0:7427:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd990432000/0xce1582440fb1d824 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xce1582440fb1d82b expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263780.353015:0:7427:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd990432000/0xce1582440fb1d824 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xce1582440fb1d82b expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263780.353020:0:13146:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:00010000:2.0:1789263780.353021:0:7427:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd990432000/0xce1582440fb1d824 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xce1582440fb1d82b expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263780.353026:0:13146:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd883f58600/0xce1582440fb1dbb9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xce1582440fb1dbc0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789263780.353029:0:7427:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1789263780.353034:0:7427:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1789263780.353037:0:7427:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1789263780.353051:0:13146:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883f58600 already unused, calling callback (ffffffffc12b1c20) 00010000:00010000:2.0:1789263780.353052:0:7427:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff9dd990432000/0xce1582440fb1d824 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xce1582440fb1d82b expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789263780.353056:0:13146:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd883f58600/0xce1582440fb1dbb9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xce1582440fb1dbc0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263780.353062:0:7427:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789263780.353069:0:7427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd990432000/0xce1582440fb1d824 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xce1582440fb1d82b expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263780.353092:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd990432000/0xce1582440fb1d824 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xce1582440fb1d82b expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263780.353107:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789263780.353109:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789263780.353113:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789263780.353129:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd884aced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:66a76ccf-c64c-4b18-8369-a2861ec3956c:3618:1876178898105472:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789263780.353150:0:13146:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd883f58600/0xce1582440fb1dbb9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xce1582440fb1dbc0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263780.353160:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789263780.353169:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:0.0:1789263780.353169:0:13146:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd883f58600/0xce1582440fb1dbb9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xce1582440fb1dbc0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789263780.353178:0:13146:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789263780.353181:0:13146:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789263780.353184:0:13146:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000100:00100000:2.0:1789263780.353210:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789263780.353218:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898105472 00000100:00100000:2.0:1789263780.353227:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd884ace680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:66a76ccf-c64c-4b18-8369-a2861ec3956c:3618:1876178898105600:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789263780.353229:0:13146:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff9dd883f58600/0xce1582440fb1dbb9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xce1582440fb1dbc0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263780.353232:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898105472 00010000:00010000:0.0:1789263780.353267:0:13146:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789263780.353281:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263780.353296:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898105600 00000100:00100000:3.0:1789263780.353302:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898105600 00010000:00010000:0.0:1789263780.353322:0:13146:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd883f58600/0xce1582440fb1dbb9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xce1582440fb1dbc0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263780.353333:0:13146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd883f58600/0xce1582440fb1dbb9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xce1582440fb1dbc0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263780.353345:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00010000:00010000:0.0:1789263780.353354:0:13146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263780.353360:0:13146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789263780.353366:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd884acd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3618:x1876178898105472:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789263780.353366:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00010000:00010000:0.0:1789263780.353375:0:13146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00020000:3.0:1789263780.353382:0:6473:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789263780 with bad export cookie 14849918575156778064 00000100:00100000:2.0:1789263780.353384:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd884acdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3618:x1876178898105600:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789263780.353397:0:8409:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789263780 with bad export cookie 14849918575156778064 00010000:00010000:0.0:1789263780.353407:0:15407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd981531e00/0xce1582440fb1d553 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d55a expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263780.353417:0:15407:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd981531e00/0xce1582440fb1d553 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1d55a expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263780.353434:0:15407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd981531e00/0xce1582440fb1d553 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xce1582440fb1d55a expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263780.353441:0:15407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff9dd981531e00/0xce1582440fb1d553 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xce1582440fb1d55a expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263780.353469:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd884acdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3618:x1876178898105600:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (190us total) trans 0 rc -107/-107 00010000:00010000:0.0:1789263780.353470:0:15407:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789263780.353480:0:15407:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:0.0:1789263780.353484:0:15407:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000100:00100000:2.0:1789263780.353489:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789263780.353511:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd884acd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3618:x1876178898105472:12345-0@lo:103:ldlm_bl.0 Request processed in 148us (335us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789263780.353522:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789263780.353533:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:66a76ccf-c64c-4b18-8369-a2861ec3956c:3620:1876178898105728:0@lo:103:ldlm_bl.0 00000020:01000004:0.0:1789263780.353539:0:15407:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:0.0:1789263780.353546:0:15407:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00010000:00010000:3.0:1789263780.353563:0:6475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000020:00000080:0.0:1789263780.353564:0:15407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000100:00100000:2.0:1789263780.353575:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789263780.353576:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd981531e00/0xce1582440fb1d553 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xce1582440fb1d55a expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1789263780.353586:0:15407:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00010000:00010000:3.0:1789263780.353590:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981531e00 already unused, calling callback (ffffffffc12b1c20) 10000000:00010000:3.0:1789263780.353598:0:6475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd981531e00/0xce1582440fb1d553 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xce1582440fb1d55a expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789263780.353603:0:15407:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9dd883895000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000100:00100000:2.0:1789263780.353615:0:7428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898105728 00000100:00100000:2.0:1789263780.353634:0:7428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898105728 00000020:00080000:0.0:1789263780.353641:0:15407:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9dd881fec000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:3.0:1789263780.353649:0:6475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd981531e00/0xce1582440fb1d553 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xce1582440fb1d55a expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789263780.353651:0:15407:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff9dd9890e8000) has exports, disconnecting them 00000020:00080000:0.0:1789263780.353665:0:15407:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9dd883895000), last request at 1789263775 00000100:00100000:2.0:1789263780.353670:0:7428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 10000000:00010000:3.0:1789263780.353673:0:6475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd981531e00/0xce1582440fb1d553 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xce1582440fb1d55a expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263780.353680:0:7428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd884acf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3620:x1876178898105728:12345-0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1789263780.353689:0:15407:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1d7ec 00010000:00020000:2.0:1789263780.353700:0:7428:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789263780 with bad export cookie 14849918575156778064 10000000:01000000:3.0:1789263780.353701:0:6475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1789263780.353712:0:6475:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1789263780.353715:0:6475:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00080000:0.0:1789263780.353722:0:15407:0:(import.c:65:import_set_state_nolock()) ffff9dd883897800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1789263780.353750:0:7428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd884acf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3620:x1876178898105728:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (176us total) trans 0 rc -107/-107 00010000:00010000:3.0:1789263780.353751:0:6475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff9dd981531e00/0xce1582440fb1d553 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xce1582440fb1d55a expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263780.353772:0:6475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789263780.353774:0:7428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:3.0:1789263780.353788:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd981531e00/0xce1582440fb1d553 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xce1582440fb1d55a expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789263780.353796:0:15407:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dd883895000): rc 0 00010000:00010000:3.0:1789263780.353803:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd981531e00/0xce1582440fb1d553 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xce1582440fb1d55a expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1789263780.353804:0:15407:0:(genops.c:885:class_export_put()) final put ffff9dd883895000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:0.0:1789263780.353823:0:15407:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9dd881fec000), last request at 1789263775 00000100:00080000:2.0:1789263780.353825:0:3618:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.120@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000020:00000080:0.0:1789263780.353831:0:15407:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1d68e 00000100:00080000:2.0:1789263780.353832:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9dd985683800 MGS: changing import state from FULL to DISCONN 00010000:00010000:3.0:1789263780.353834:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789263780.353840:0:15407:0:(import.c:65:import_set_state_nolock()) ffff9dd881fe9000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1789263780.353841:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:02020000:2.0:1789263780.353841:0:3618:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.120@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:3.0:1789263780.353849:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263780.353866:0:13689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789263780.353867:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd883895000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000100:00080000:3.0:1789263780.353932:0:3620:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.120@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000020:00000080:0.0:1789263780.354018:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd883897800 for lustre-MDT0001 00000020:00080000:0.0:1789263780.354042:0:15407:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dd881fec000): rc 0 00000020:00000080:0.0:1789263780.354140:0:15407:0:(genops.c:885:class_export_put()) final put ffff9dd881fec000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:0.0:1789263780.354161:0:15407:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb38e41897ae0 00000020:00000080:0.0:1789263780.354173:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd881fec000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:0.0:1789263780.354221:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd881fe9000 for lustre-MDT0001 00000100:00080000:0.0:1789263780.354250:0:15407:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789263780.354254:0:15407:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00080000:0.0:1789263780.355663:0:15407:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789263780.355669:0:15407:0:(import.c:65:import_set_state_nolock()) ffff9dd9c0bdc800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1789263780.355869:0:15407:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789263780.355873:0:15407:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:0.0:1789263780.355893:0:15407:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1789263780.355982:0:15407:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1789263780.356034:0:15407:0:(import.c:65:import_set_state_nolock()) ffff9dd9b7a92800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1789263780.356065:0:15407:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789263780.356100:0:15407:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:0.0:1789263780.356122:0:15407:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1789263780.356263:0:15407:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1789263780.356284:0:15407:0:(import.c:65:import_set_state_nolock()) ffff9dd882a36800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1789263780.356361:0:15407:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9dd9890e8000) has no exports 00000100:00080000:2.0:1789263780.360310:0:3618:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.120@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1789263780.360314:0:3618:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1789263780.360322:0:3618:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dd98ff7c700 x1876178898105344/t0(0) o103->MGC192.168.203.120@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789263796 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789263780.360333:0:3618:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dd884aced80 x1876178898105472/t0(0) o103->MGC192.168.203.120@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789263796 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789263780.360358:0:3618:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dd884ace680 x1876178898105600/t0(0) o103->MGC192.168.203.120@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789263796 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789263780.360367:0:3618:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dd9bfaae680 x1876178898105728/t0(0) o103->MGC192.168.203.120@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789263796 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1789263780.360383:0:3618:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1789263780.360385:0:3620:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9dd985683800 already not connected (conn 1, was 1): DISCONN 00000100:00080000:2.0:1789263780.360386:0:3618:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1789263780.360389:0:3618:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1789263780.360395:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9dd985683800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789263780.360403:0:3618:0:(import.c:510:import_select_connection()) MGC192.168.203.120@tcp: connect to NID 0@lo last attempt 104 00000100:00100000:0.0:1789263780.360403:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:66a76ccf-c64c-4b18-8369-a2861ec3956c:0:1876178898105856:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1789263780.360414:0:3618:0:(import.c:624:import_select_connection()) MGC192.168.203.120@tcp: import ffff9dd985683800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:2.0:1789263780.360434:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88297f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1876178898105984:0@lo:9:umount.0 00000100:00100000:3.0:1789263780.360452:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:66a76ccf-c64c-4b18-8369-a2861ec3956c:3620:1876178898105344:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789263780.360478:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:66a76ccf-c64c-4b18-8369-a2861ec3956c:3620:1876178898105728:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789263780.360498:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789263780.360529:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789263780.360536:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1876178898106112:0@lo:9:umount.0 00000100:00100000:2.0:1789263780.360564:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263780.360585:0:3618:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd98ff7c700 x1876178898106240/t0(0) o250->MGC192.168.203.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789263780.360607:0:8395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898105984 00000100:00100000:2.0:1789263780.360615:0:8395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898105984 00000100:00100000:3.0:1789263780.360639:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd884aced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:66a76ccf-c64c-4b18-8369-a2861ec3956c:3618:1876178898105472:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789263780.360660:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd884ace680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:66a76ccf-c64c-4b18-8369-a2861ec3956c:3618:1876178898105600:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789263780.360682:0:8395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898106112 00000100:00100000:2.0:1789263780.360686:0:8395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898106112 00000100:00100000:3.0:1789263780.360711:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:66a76ccf-c64c-4b18-8369-a2861ec3956c:3617:1876178898106240:0@lo:250:ptlrpcd_00_00.0 00000100:00100000:2.0:1789263780.360720:0:8395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789263780.360731:0:8395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd884acd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1876178898105984:12345-0@lo:9:umount.0 00000400:00000100:3.0:1789263780.360740:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876178898106240 offset 0 length 520: 4 00000020:00000080:2.0:1789263780.360755:0:8395:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1d6db 00000100:00080000:2.0:1789263780.360764:0:8395:0:(import.c:65:import_set_state_nolock()) ffff9dd881f8d800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1789263780.360784:0:13766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789263780.360793:0:13766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd884acc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3617:x1876178898106112:12345-0@lo:9:umount.0 00000100:00080000:3.0:1789263780.360800:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00000004:2.0:1789263780.360803:0:8395:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00080000:3.0:1789263780.360806:0:6483:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:0.0:1789263780.360808:0:13766:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1d855 00000100:00080000:0.0:1789263780.360818:0:13766:0:(import.c:65:import_set_state_nolock()) ffff9dd883896800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1789263780.360820:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263780.360848:0:13146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1789263780.360850:0:13766:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:2.0:1789263780.360951:0:8395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd884acd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3617:x1876178898105984:12345-0@lo:9:umount.0 Request processed in 222us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263780.360959:0:8395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789263780.360964:0:13766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd884acc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+2:3617:x1876178898106112:12345-0@lo:9:umount.0 Request processed in 171us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263780.360971:0:13766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:2.0:1789263780.360997:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd9b7a92800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789263780.361016:0:3617:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789263780.361019:0:3617:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789263780.361023:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88297f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1876178898105984:0@lo:9:umount.0 00000100:00080000:2.0:1789263780.361039:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd882a36800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789263780.361048:0:3617:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789263780.361050:0:3617:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789263780.361053:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1876178898106112:0@lo:9:umount.0 00000400:00000100:1.0:1789263780.363197:0:10303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1876178898105344 offset 224 length 224: 4 00000100:00100000:1.0:1789263780.363226:0:10303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd884ace300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0+-99:3620:x1876178898105344:12345-0@lo:103:ldlm_bl.0 Request processed in 11391us (11504us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789263780.363236:0:10303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000020:00080000:2.0:1789263780.372472:0:15407:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9dd9890e8000) has no exports 00000020:01000000:3.0:1789263780.397521:0:15407:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9dd985a39d80 - data ffff9dd9b3f00af8/ffff9dd9bb760400 00000020:01000000:3.0:1789263780.397693:0:15407:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9dd882524120 - data ffff9dd882010288/ffff9dd882688c00 00000001:00000004:0.0:1789263780.408347:0:15407:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:2.0:1789263780.430934:0:15407:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789263780.430943:0:15407:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1789263780.430951:0:15407:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1789263780.432062:0:15407:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789263780.432067:0:15407:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:2.0:1789263780.432102:0:15407:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789263780.432105:0:15407:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789263780.432351:0:8497:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789263780.432356:0:8497:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:1.0:1789263780.432369:0:8497:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1789263780.432934:0:15407:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789263780.432937:0:15407:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:2.0:1789263780.432945:0:15407:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789263780.432953:0:15407:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789263780.433155:0:9677:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789263780.433160:0:9677:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:1.0:1789263780.433171:0:9677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1789263780.434170:0:15407:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1d576 00000020:00000080:2.0:1789263780.434179:0:15407:0:(genops.c:885:class_export_put()) final put ffff9dd9ba93f800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789263780.434506:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd9ba93f800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1789263780.435752:0:15407:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1d58b 00000020:00000080:2.0:1789263780.435761:0:15407:0:(genops.c:885:class_export_put()) final put ffff9dd9ba94a000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1789263780.435777:0:15407:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:2.0:1789263780.435782:0:15407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789263780.435795:0:15407:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789263780.435799:0:15407:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9dd9890eb370) has no exports 00000020:00000080:0.0:1789263780.435808:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd9ba94a000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000004:01000000:2.0:1789263780.436024:0:15407:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1789263780.436032:0:15407:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1d84e 00000020:00000080:2.0:1789263780.436043:0:15407:0:(genops.c:885:class_export_put()) final put ffff9dd883f0b800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1789263780.436049:0:15407:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:2.0:1789263780.436059:0:15407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789263780.436062:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd883f0b800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:2.0:1789263780.436068:0:15407:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789263780.436072:0:15407:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff9dd9c09c3370) has no exports 00000020:00000080:2.0:1789263780.436102:0:15407:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1d847 00000020:00000080:2.0:1789263780.436108:0:15407:0:(genops.c:885:class_export_put()) final put ffff9dd882a33000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789263780.436126:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd882a33000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1789263780.436568:0:15407:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:2.0:1789263780.436573:0:15407:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789263780.436577:0:15407:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:2.0:1789263780.436581:0:15407:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789263780.436583:0:15407:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789263780.436611:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd882a36800 for lustre-OST0001-osc-MDT0001 00000020:00000080:2.0:1789263780.436640:0:15407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789263780.436648:0:15407:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789263780.436652:0:15407:0:(genops.c:885:class_export_put()) final put ffff9dd882a2d000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789263780.436655:0:15407:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd882a2d000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:2.0:1789263780.436663:0:15407:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789263780.436742:0:15407:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1d6d4 00000020:00000080:2.0:1789263780.436748:0:15407:0:(genops.c:885:class_export_put()) final put ffff9dd88269e000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1789263780.436766:0:15407:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:2.0:1789263780.436769:0:15407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789263780.436774:0:15407:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789263780.436776:0:15407:0:(genops.c:1558:class_disconnect_exports()) OBD device 20 (ffff9dd9c09c19b8) has no exports 00000020:00000080:2.0:1789263780.436780:0:15407:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1d6cd 00000020:00000080:2.0:1789263780.436783:0:15407:0:(genops.c:885:class_export_put()) final put ffff9dd9b7a93800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789263780.436956:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd88269e000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1789263780.436963:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd9b7a93800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1789263780.437304:0:15407:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:2.0:1789263780.437307:0:15407:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789263780.437310:0:15407:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:2.0:1789263780.437313:0:15407:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789263780.437315:0:15407:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789263780.437352:0:15407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789263780.437353:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd9b7a92800 for lustre-OST0000-osc-MDT0001 00000020:00000080:2.0:1789263780.437359:0:15407:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789263780.437364:0:15407:0:(genops.c:885:class_export_put()) final put ffff9dd881fec800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789263780.437372:0:15407:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd881fec800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:2.0:1789263780.437376:0:15407:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000004:01000000:2.0:1789263780.437418:0:15407:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1789263780.437424:0:15407:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1d5ae 00000020:00000080:2.0:1789263780.437429:0:15407:0:(genops.c:885:class_export_put()) final put ffff9dd9c1b55000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1789263780.437443:0:15407:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:2.0:1789263780.437447:0:15407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789263780.437451:0:15407:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789263780.437454:0:15407:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9dd99f9c4d28) has no exports 00000020:00000080:2.0:1789263780.437458:0:15407:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1d5a7 00000020:00000080:2.0:1789263780.437461:0:15407:0:(genops.c:885:class_export_put()) final put ffff9dd9c0bdd000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789263780.437490:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd9c1b55000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1789263780.437501:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd9c0bdd000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1789263780.440131:0:15407:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1789263780.440147:0:15407:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789263780.440151:0:15407:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1789263780.440163:0:15407:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789263780.440207:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd9c0bdc800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1789263780.440218:0:15407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789263780.440227:0:15407:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789263780.440233:0:15407:0:(genops.c:885:class_export_put()) final put ffff9dd9c0bd9800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789263780.440237:0:15407:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd9c0bd9800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:0.0:1789263780.440248:0:15407:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789263780.440439:0:15407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789263780.440444:0:15407:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789263780.440448:0:15407:0:(genops.c:885:class_export_put()) final put ffff9dd9ba939800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789263780.440451:0:15407:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd9ba939800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1789263780.440457:0:15407:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789263780.440644:0:15407:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1d592 00000020:00000080:0.0:1789263780.440652:0:15407:0:(genops.c:885:class_export_put()) final put ffff9dd9ba94b800/lustre-MDD0001_UUID 00000020:01000000:0.0:1789263780.440662:0:15407:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1789263780.440667:0:15407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789263780.440673:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd9ba94b800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:0.0:1789263780.440673:0:15407:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789263780.440679:0:15407:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff9dd9890ecd28) has no exports 00000020:00000080:0.0:1789263780.440708:0:15407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789263780.440712:0:15407:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1789263780.440715:0:15407:0:(genops.c:885:class_export_put()) final put ffff9dd9ba93d800/lustre-MDD0001_UUID 00000020:00000080:0.0:1789263780.440717:0:15407:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd9ba93d800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:0.0:1789263780.440722:0:15407:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:0.0:1789263780.440946:0:15407:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1d599 00000020:00000080:0.0:1789263780.440951:0:15407:0:(genops.c:885:class_export_put()) final put ffff9dd9ba94a800/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1789263780.440968:0:15407:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dd9c0889800 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1789263780.440971:0:15407:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dd9c0889800 2 00000020:01000004:0.0:1789263780.440975:0:15407:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9dd9c0889800 from lustre-MDT0001 00000020:00000080:1.0:1789263780.440989:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd9ba94a800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1789263780.441012:0:15407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789263780.441017:0:15407:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1789263780.441025:0:15407:0:(genops.c:885:class_export_put()) final put ffff9dd9ba939000/lustre-MDT0001_UUID 00000020:00000080:0.0:1789263780.441028:0:15407:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd9ba939000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1789263780.441036:0:15407:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1789263780.441069:0:15407:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1789263780.441073:0:15407:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1789263780.441102:0:15407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789263780.441107:0:15407:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789263780.441115:0:15407:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9dd9c1ba2800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789263780.441121:0:15407:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff9dd9c1bacd28) has exports, disconnecting them 00000020:00080000:0.0:1789263780.441126:0:15407:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9dd9c1ba2800), last request at 1789263670 00000020:00000080:0.0:1789263780.441130:0:15407:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1d5ed 00000020:00080000:0.0:1789263780.441144:0:15407:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dd9c1ba2800): rc 0 00000020:00000080:0.0:1789263780.441148:0:15407:0:(genops.c:885:class_export_put()) final put ffff9dd9c1ba2800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1789263780.441168:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd9c1ba2800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:1.0:1789263780.444047:0:15407:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:1.0:1789263780.444055:0:15407:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789263780.444059:0:15407:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789263780.444066:0:15407:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789263780.444114:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd9c1ba3800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1789263780.444313:0:15407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789263780.444321:0:15407:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:1.0:1789263780.444327:0:15407:0:(genops.c:885:class_export_put()) final put ffff9dd9c1ba7800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1789263780.444331:0:15407:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd9c1ba7800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:1.0:1789263780.444336:0:15407:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:1.0:1789263780.444405:0:15407:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dd9c0889800 1 00000020:00000080:1.0:1789263780.444411:0:15407:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1d529 00000020:00000080:1.0:1789263780.444417:0:15407:0:(genops.c:885:class_export_put()) final put ffff9dd9c0a4c800/lustre-MDT0001-osd_UUID 00000020:01000000:1.0:1789263780.444427:0:15407:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:1.0:1789263780.444431:0:15407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789263780.444435:0:15407:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00000080:0.0:1789263780.444437:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd9c0a4c800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00080000:1.0:1789263780.444442:0:15407:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9dd99f9c0000) has no exports 00000020:00000080:2.0:1789263780.462865:0:15407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789263780.462875:0:15407:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:2.0:1789263780.462880:0:15407:0:(genops.c:885:class_export_put()) final put ffff9dd9c0bdd800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1789263780.462883:0:15407:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd9c0bdd800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:2.0:1789263780.462891:0:15407:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:2.0:1789263780.463008:0:15407:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9dd988509800 00000020:01000000:2.0:1789263780.463029:0:15407:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1789263780.463033:0:15407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789263780.463037:0:15407:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789263780.463041:0:15407:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9dd9890e99b8) has no exports 00000100:00100000:1.0:1789263780.463321:0:6489:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9dd990765a00:6489] 2 exiting: rc = 0 00000100:00100000:0.0:1789263780.463407:0:7434:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9dd9ba920800:7434] 3 exiting: rc = 0 00000100:00100000:2.0:1789263780.463446:0:8417:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9dd9c0a9d800:8417] 4 exiting: rc = 0 00000100:00100000:2.0:1789263780.463539:0:6487:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9dd982b87400:6487] 0 exiting: rc = 1 00000100:00100000:3.0:1789263780.463644:0:6488:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9dd99152c000:6488] 1 exiting: rc = 0 00000100:00100000:1.0:1789263780.463851:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.463858:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.463864:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.463870:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.463875:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.463880:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.463886:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.463891:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.463899:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.463905:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.463910:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.463913:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.463917:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.463920:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.463924:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.463927:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.463931:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.463934:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.463937:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.463941:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.463944:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.463947:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.463950:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.463953:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.463957:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.463960:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.463963:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.463966:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.463969:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.463972:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.463975:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.463978:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.463981:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.463984:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.463988:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.464001:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.464006:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.464011:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.464016:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.464021:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.464027:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.464033:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.464038:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.464043:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.464048:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.464054:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.464059:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.464064:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.464070:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.464095:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.464104:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.464111:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.464118:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.464123:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.464129:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.464134:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.464139:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.464144:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.464150:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.464156:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.464162:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.464167:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.464173:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.464179:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263780.467657:0:6491:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9dd98a60d000:6491] 1 exiting: rc = 0 00000100:00100000:0.0:1789263780.467670:0:14127:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_002: service thread [ffff9dd9bf9fb600:14127] 2 exiting: rc = 0 00000100:00100000:2.0:1789263780.467672:0:6490:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9dd98956e600:6490] 0 exiting: rc = 1 00000100:00100000:1.0:1789263780.467737:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.467751:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.467761:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.467770:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.467775:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.467781:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.467798:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.467804:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.467810:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.467815:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.467821:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.467827:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.467832:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.467837:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.467842:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.467848:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.467853:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.467859:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.467864:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.467869:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.467874:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.467879:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.467884:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.467890:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.467895:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.467900:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.467906:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.467911:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.467916:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.467921:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.467926:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.467931:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.467936:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.467942:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.467947:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.467952:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.467958:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.467963:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.467969:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.467974:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.467980:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.467993:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.467998:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.468003:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.468009:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.468015:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.468020:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.468025:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.468031:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.468036:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.468041:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.468046:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.468052:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.468057:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.468062:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.468068:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.468073:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.468112:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.468120:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.468129:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.468138:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.468145:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.468151:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.468158:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263780.468930:0:6492:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9dd9908cfa00:6492] 0 exiting: rc = 1 00000100:00100000:0.0:1789263780.468933:0:8499:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff9dd881f6ba00:8499] 2 exiting: rc = 0 00000100:00100000:2.0:1789263780.469172:0:6493:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9dd9908cf800:6493] 1 exiting: rc = 0 00000100:00100000:3.0:1789263780.469237:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263780.469254:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263780.469279:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263780.469417:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263780.469429:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263780.469441:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263780.469472:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263780.469486:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263780.469498:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263780.469510:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263780.469522:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263780.469533:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263780.469546:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263780.469557:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263780.469575:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263780.469585:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263780.469592:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263780.469603:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263780.469660:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263780.469675:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263780.469688:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263780.469701:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263780.469714:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263780.469729:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263780.469740:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263780.469751:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263780.469763:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263780.469790:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263780.469800:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263780.469810:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263780.469846:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263780.469859:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263780.469870:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263780.469883:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263780.469900:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263780.469909:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263780.469918:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263780.469928:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263780.469939:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263780.469950:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263780.469963:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263780.469977:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263780.470018:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263780.470031:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263780.470043:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263780.470055:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263780.470067:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263780.470109:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263780.470121:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263780.470147:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263780.470161:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263780.470175:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263780.470188:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263780.470201:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263780.470250:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263780.470263:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263780.470279:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263780.470291:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263780.470302:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263780.470314:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263780.470326:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263780.470338:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263780.470351:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263780.470416:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.476156:0:6494:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9dd9acb87800:6494] 0 exiting: rc = 1 00000100:00100000:0.0:1789263780.476158:0:6495:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9dd9acb86c00:6495] 1 exiting: rc = 0 00000100:00100000:1.0:1789263780.476295:0:9679:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0002: service thread [ffff9dd882a3d600:9679] 2 exiting: rc = 0 00000100:00100000:2.0:1789263780.476416:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.476423:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.476428:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.476432:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.476437:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.476442:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.476462:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.476467:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.476472:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.476475:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.476479:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.476482:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.476486:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.476489:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.476492:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.476495:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.476498:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.476501:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.476504:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.476506:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.476509:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.476512:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.476514:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.476518:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.476523:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.476527:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.476532:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.476537:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.476542:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.476546:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.476549:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.476552:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.476555:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.476558:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.476561:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.476564:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.476567:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.476570:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.476573:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.476576:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.476579:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.476587:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.476591:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.476594:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.476599:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.476604:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.476609:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.476614:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.476626:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.476632:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.476637:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.476642:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.476647:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.476651:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.476655:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.476657:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.476661:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.476664:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.476668:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.476670:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.476673:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.476676:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.476680:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.476684:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263780.476970:0:6497:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9dd9acb86400:6497] 1 exiting: rc = 0 00000100:00100000:0.0:1789263780.476980:0:6496:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9dd9acb87200:6496] 0 exiting: rc = 1 00000100:00100000:2.0:1789263780.477017:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.477027:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.477036:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.477044:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.477048:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.477053:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.477058:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.477063:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.477068:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.477072:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.477131:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.477138:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.477152:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.477160:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.477169:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.477176:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.477186:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.477198:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.477210:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.477222:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.477234:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.477245:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.477252:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.477261:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.477268:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.477275:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.477282:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.477287:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.477294:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.477305:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.477311:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.477317:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.477326:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.477332:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.477340:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.477350:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.477358:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.477367:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.477375:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.477382:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.477391:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.477398:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.477405:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.477416:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.477421:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.477428:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.477434:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.477449:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.477454:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.477459:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.477469:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.477474:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.477479:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.477483:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.477488:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.477493:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.477497:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.477502:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.477507:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.477512:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.477517:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.477521:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.477526:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.477531:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263780.477947:0:6498:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9dd98fc49a00:6498] 0 exiting: rc = 1 00000100:00100000:1.0:1789263780.477962:0:6499:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9dd9b7953e00:6499] 1 exiting: rc = 0 00000100:00100000:2.0:1789263780.478012:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.478022:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.478027:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.478032:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.478036:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.478042:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.478047:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.478052:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.478057:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.478062:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.478067:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.478072:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.478101:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.478108:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.478114:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.478120:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.478125:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.478129:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.478142:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.478148:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.478153:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.478158:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.478163:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.478168:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.478172:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.478177:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.478181:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.478186:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.478190:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.478194:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.478199:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.478204:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.478208:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.478212:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.478216:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.478220:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.478225:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.478229:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.478234:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.478239:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.478242:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.478245:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.478248:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.478252:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.478255:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.478258:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.478261:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.478263:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.478266:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.478269:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.478272:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.478274:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.478277:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.478285:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.478288:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.478291:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.478294:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.478297:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.478301:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.478304:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.478307:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.478309:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.478312:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263780.478314:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.479104:0:6500:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9dd9b7952400:6500] 0 exiting: rc = 1 00000100:00100000:0.0:1789263780.479166:0:6502:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9dd9b7952000:6502] 2 exiting: rc = 0 00000100:00100000:3.0:1789263780.479223:0:6501:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9dd9b7952c00:6501] 1 exiting: rc = 0 00000100:00100000:1.0:1789263780.479278:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.479288:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.479307:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.479314:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.479328:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.479335:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.479340:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.479344:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.479350:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.479364:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.479370:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.479374:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.479379:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.479383:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.479387:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.479390:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.479395:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.479400:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.479405:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.479410:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.479416:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.479431:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.479450:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.479454:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.479459:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.479463:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.479469:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.479474:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.479480:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.479486:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.479492:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.479498:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.479503:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.479509:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.479513:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.479519:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.479524:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.479530:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.479535:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.479540:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.479544:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.479550:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.479555:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.479559:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.479571:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.479588:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.479594:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.479599:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.479604:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.479609:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.479614:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.479631:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.479637:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.479642:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.479648:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.479653:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.479658:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.479663:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.479669:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.479673:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.479678:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.479683:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.479688:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263780.479693:0:15407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1789263780.483004:0:15407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789263780.483015:0:15407:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1789263780.483020:0:15407:0:(genops.c:885:class_export_put()) final put ffff9dd9838c5800/MDS_uuid 00000020:00000080:1.0:1789263780.483025:0:15407:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd9838c5800/MDS_uuid for MDS 00000020:01000000:1.0:1789263780.483030:0:15407:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1789263780.483245:0:15407:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00000100:00080000:2.0:1789263780.909235:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 66a76ccf-c64c-4b18-8369-a2861ec3956c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789263780.909242:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 66a76ccf-c64c-4b18-8369-a2861ec3956c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789263780.909246:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789263780.909249:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789263780.909253:0:8:0:(import.c:65:import_set_state_nolock()) ffff9dd88269f000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789263780.909260:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 218 00000100:00080000:2.0:1789263780.909265:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789263780.909272:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9dd88269f000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:2.0:1789263780.909308:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd884acc000 x1876178898106368/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789263780.909360:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789263780.909365:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789263780.909367:0:8:0:(import.c:65:import_set_state_nolock()) ffff9dd883880800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1789263780.909370:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd884acc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3617:1876178898106368:0@lo:38:kworker.0 00000100:00080000:2.0:1789263780.909373:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 218 00000100:00080000:2.0:1789263780.909380:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789263780.909384:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9dd883880800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:2.0:1789263780.909399:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd884acc700 x1876178898106624/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000400:00000100:3.0:1789263780.909448:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876178898106368 offset 0 length 520: 4 00000100:00100000:2.0:1789263780.909453:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd884acf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1876178898106752:0@lo:400:kworker.0 00000100:00100000:1.0:1789263780.909479:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd884acd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1876178898106496:0@lo:400:kworker.0 00000400:00000100:2.0:1789263780.909485:0:3619:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876178898106752 offset 0 length 224: 4 00000400:00000100:1.0:1789263780.909512:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876178898106496 offset 0 length 224: 4 00000100:00100000:3.0:1789263780.909514:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd884acc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3617:1876178898106624:0@lo:38:kworker.0 00000400:00000100:3.0:1789263780.909539:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876178898106624 offset 0 length 520: 4 00010000:00010000:0.0:1789263781.293270:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789263781.894899:0:15607:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1789263781.902004:0:15607:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1789263781.902053:0:15607:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22200/0xce1582440fb1d943 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d94a expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263781.902064:0:15607:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22200/0xce1582440fb1d943 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1d94a expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263781.902098:0:15607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22200/0xce1582440fb1d943 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xce1582440fb1d94a expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263781.902107:0:15607:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22200/0xce1582440fb1d943 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xce1582440fb1d94a expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263781.902134:0:15607:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789263781.902140:0:15607:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1789263781.902170:0:15607:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789263781.902183:0:15607:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dd884acc000 x1876178898106368/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789263795 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1789263781.902190:0:13689:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789263781.902199:0:13689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22200/0xce1582440fb1d943 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xce1582440fb1d94a expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263781.902208:0:13689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bfa22200 already unused, calling callback (ffffffffc12b1c20) 00000100:00100000:1.0:1789263781.902211:0:15607:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 10000000:00010000:3.0:1789263781.902213:0:13689:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22200/0xce1582440fb1d943 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xce1582440fb1d94a expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789263781.902221:0:15607:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00010000:00010000:3.0:1789263781.902225:0:13689:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22200/0xce1582440fb1d943 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xce1582440fb1d94a expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789263781.902228:0:15607:0:(import.c:65:import_set_state_nolock()) ffff9dd88269f000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1789263781.902237:0:15607:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789263781.902243:0:15607:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dd884acc000 x1876178898106368/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789263795 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789263781.902254:0:15607:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789263781.902257:0:15607:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 18s for inflight to error out 10000000:00010000:3.0:1789263781.902269:0:13689:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22200/0xce1582440fb1d943 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xce1582440fb1d94a expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789263781.902276:0:13689:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789263781.902279:0:13689:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789263781.902281:0:13689:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789263781.902296:0:13689:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9dd985683800 00000100:00100000:0.0:1789263781.902296:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd884acc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3617:1876178898106368:0@lo:38:kworker.0 00010000:00010000:3.0:1789263781.902303:0:13689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22200/0xce1582440fb1d943 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xce1582440fb1d94a expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263781.902312:0:13689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22200/0xce1582440fb1d943 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xce1582440fb1d94a expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263781.902324:0:13689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263781.902326:0:13689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263781.902329:0:13689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789263781.903169:0:15607:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789263781.903178:0:15607:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dd884acd880 x1876178898106496/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263796 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789263781.903196:0:15607:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789263781.903201:0:15607:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1789263781.903221:0:15607:0:(import.c:65:import_set_state_nolock()) ffff9dd88269d000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789263781.903235:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd884acd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1876178898106496:0@lo:400:kworker.0 00000100:00100000:0.0:1789263781.903415:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3617:1876178898106880:0@lo:39:umount.0 00000400:00000100:0.0:1789263781.903458:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876178898106880 offset 0 length 224: 4 00010000:00010000:3.0:1789263782.317226:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263783.341230:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263784.365199:0:13146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789263784.941310:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 66a76ccf-c64c-4b18-8369-a2861ec3956c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789263784.941331:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 66a76ccf-c64c-4b18-8369-a2861ec3956c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789263784.941335:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789263784.941338:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789263784.941419:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789263784.941437:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3621:1876178898107008:0@lo:400:kworker.0 00000400:00000100:1.0:1789263784.941483:0:3621:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876178898107008 offset 0 length 224: 4 00010000:00010000:0.0:1789263785.389339:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789263785.519011:0:9479:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789263785.519020:0:9479:0:(genops.c:885:class_export_put()) final put ffff9dd883897000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789263785.519107:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd883897000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000001:00100000:0.0:1789263785.519151:0:8388:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789263785.519157:0:8388:0:(genops.c:885:class_export_put()) final put ffff9dd881f8e800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789263785.519191:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd883896800 for lustre-OST0001 00000020:00000080:2.0:1789263785.519201:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd881f8e800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1789263785.519229:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd881f8d800 for lustre-OST0000 00000100:00080000:3.0:1789263785.965285:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 66a76ccf-c64c-4b18-8369-a2861ec3956c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789263785.965295:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 66a76ccf-c64c-4b18-8369-a2861ec3956c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789263785.965298:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789263785.965302:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789263785.965562:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789263785.965589:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1876178898107136:0@lo:400:kworker.0 00000400:00000100:2.0:1789263785.965640:0:3620:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876178898107136 offset 0 length 224: 4 00010000:00010000:3.0:1789263786.413256:0:13689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263787.437257:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263788.461265:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263789.485594:0:13146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789263790.061353:0:3617:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789263780/real 1789263780] req@ffff9dd98ff7c700 x1876178898106240/t0(0) o250->MGC192.168.203.120@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789263790 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789263790.061386:0:3617:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9dd98ff7c700 x1876178898106240/t0(0) o250->MGC192.168.203.120@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789263790 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789263790.061405:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd985683800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789263790.061427:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1789263790.061431:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:66a76ccf-c64c-4b18-8369-a2861ec3956c:3617:1876178898106240:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:3.0:1789263790.061463:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 66a76ccf-c64c-4b18-8369-a2861ec3956c->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789263790.061469:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1789263790.061472:0:38:0:(import.c:65:import_set_state_nolock()) ffff9dd985683800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789263790.061477:0:38:0:(import.c:510:import_select_connection()) MGC192.168.203.120@tcp: connect to NID 0@lo last attempt 222 00000100:00080000:3.0:1789263790.061482:0:38:0:(import.c:589:import_select_connection()) MGC192.168.203.120@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789263790.061488:0:38:0:(import.c:624:import_select_connection()) MGC192.168.203.120@tcp: import ffff9dd985683800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:3.0:1789263790.061518:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd98ff7ce00 x1876178898107264/t0(0) o250->MGC192.168.203.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789263790.061538:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789263790.061542:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789263790.061599:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:66a76ccf-c64c-4b18-8369-a2861ec3956c:3617:1876178898107264:0@lo:250:kworker.0 00000100:00100000:0.0:1789263790.061634:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1876178898107392:0@lo:400:kworker.0 00000400:00000100:1.0:1789263790.061648:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876178898107264 offset 0 length 520: 4 00000400:00000100:0.0:1789263790.061670:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876178898107392 offset 0 length 224: 4 00010000:00010000:0.0:1789263790.509262:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789263791.085193:0:3617:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789263781/real 1789263781] req@ffff9dd9bfa65c00 x1876178898106880/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789263791 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789263791.085224:0:3617:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9dd9bfa65c00 x1876178898106880/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789263791 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789263791.085243:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd88269d000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1789263791.085258:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3617:1876178898106880:0@lo:39:umount.0 00000100:00080000:3.0:1789263791.085283:0:15607:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789263791.085288:0:15607:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789263791.085292:0:15607:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789263791.086092:0:15607:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9813fd400/0xce1582440fb1d951 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d958 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263791.086101:0:15607:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9813fd400/0xce1582440fb1d951 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1d958 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263791.086106:0:15607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9813fd400/0xce1582440fb1d951 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xce1582440fb1d958 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263791.086111:0:15607:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff9dd9813fd400/0xce1582440fb1d951 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xce1582440fb1d958 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263791.086142:0:15607:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789263791.086151:0:15607:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883e73c00/0xce1582440fb1dbab lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1dbb2 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263791.086158:0:15607:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883e73c00/0xce1582440fb1dbab lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1dbb2 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263791.086165:0:15607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883e73c00/0xce1582440fb1dbab lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xce1582440fb1dbb2 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263791.086172:0:15607:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff9dd883e73c00/0xce1582440fb1dbab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xce1582440fb1dbb2 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263791.086175:0:13689:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789263791.086187:0:13689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd9813fd400/0xce1582440fb1d951 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xce1582440fb1d958 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263791.086192:0:15607:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789263791.086197:0:15607:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00010000:00010000:0.0:1789263791.086200:0:13689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9813fd400 already unused, calling callback (ffffffffc12b1c20) 10000000:00010000:0.0:1789263791.086206:0:13689:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd9813fd400/0xce1582440fb1d951 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xce1582440fb1d958 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263791.086216:0:13689:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd9813fd400/0xce1582440fb1d951 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xce1582440fb1d958 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789263791.086220:0:15607:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1789263791.086224:0:15607:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 10000000:00010000:0.0:1789263791.086227:0:13689:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd9813fd400/0xce1582440fb1d951 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xce1582440fb1d958 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1789263791.086228:0:15607:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789263791.086233:0:15607:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00010000:00010000:2.0:1789263791.086236:0:7427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:0.0:1789263791.086237:0:13689:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000020:00080000:3.0:1789263791.086238:0:15607:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9dd9c09c4d28) has no exports 10000000:01000000:0.0:1789263791.086245:0:13689:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:2.0:1789263791.086247:0:7427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd883e73c00/0xce1582440fb1dbab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xce1582440fb1dbb2 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789263791.086248:0:13689:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1789263791.086259:0:7427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883e73c00 already unused, calling callback (ffffffffc12b1c20) 00000020:00080000:3.0:1789263791.086262:0:15607:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9dd9c09c4d28) has no exports 10000000:00010000:2.0:1789263791.086264:0:7427:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd883e73c00/0xce1582440fb1dbab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xce1582440fb1dbb2 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263791.086267:0:13689:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9dd985683800 00010000:00010000:0.0:1789263791.086274:0:13689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd9813fd400/0xce1582440fb1d951 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xce1582440fb1d958 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263791.086276:0:7427:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd883e73c00/0xce1582440fb1dbab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xce1582440fb1dbb2 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789263791.086289:0:7427:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd883e73c00/0xce1582440fb1dbab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xce1582440fb1dbb2 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263791.086296:0:13689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd9813fd400/0xce1582440fb1d951 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xce1582440fb1d958 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789263791.086297:0:7427:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789263791.086304:0:7427:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1789263791.086308:0:7427:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1789263791.086318:0:7427:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9dd985683800 00010000:00010000:0.0:1789263791.086319:0:13689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263791.086322:0:13689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263791.086324:0:13689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789263791.086330:0:7427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd883e73c00/0xce1582440fb1dbab lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xce1582440fb1dbb2 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263791.086337:0:7427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd883e73c00/0xce1582440fb1dbab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xce1582440fb1dbb2 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263791.086354:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789263791.086356:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789263791.086358:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1789263791.087724:0:15607:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9dd883b02720 - data ffff9dd8820ce0d8/ffff9dd883f16400 00000020:01000000:3.0:1789263791.087838:0:15607:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9dd9880efea0 - data ffff9dd9b3e64e58/ffff9dd881f9a400 00100000:10000000:3.0:1789263791.097610:0:15607:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1789263791.102260:0:15607:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1d648 00000020:00000080:2.0:1789263791.102273:0:15607:0:(genops.c:885:class_export_put()) final put ffff9dd881fef800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1789263791.102292:0:15607:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dd9c1b57000 from lustre-OST0000, refs=2 00000020:01000004:2.0:1789263791.102296:0:15607:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dd9c1b57000 2 00000020:00000080:1.0:1789263791.102297:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd881fef800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000004:2.0:1789263791.102300:0:15607:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9dd9c1b57000 from lustre-OST0000 00000020:00000080:2.0:1789263791.102329:0:15607:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789263791.102337:0:15607:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1789263791.102340:0:15607:0:(genops.c:885:class_export_put()) final put ffff9dd881fee800/lustre-OST0000_UUID 00000020:00000080:2.0:1789263791.102342:0:15607:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd881fee800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1789263791.102349:0:15607:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1789263791.102398:0:15607:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1789263791.102403:0:15607:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1789263791.102406:0:15607:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789263791.102411:0:15607:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789263791.102417:0:15607:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9dd882699000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789263791.102422:0:15607:0:(genops.c:1553:class_disconnect_exports()) OBD device 18 (ffff9dd9c1bab370) has exports, disconnecting them 00000020:00080000:2.0:1789263791.102427:0:15607:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9dd882699000), last request at 1789263678 00000020:00000080:2.0:1789263791.102431:0:15607:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1d672 00000020:00080000:2.0:1789263791.102441:0:15607:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dd882699000): rc 0 00000020:00000080:2.0:1789263791.102446:0:15607:0:(genops.c:885:class_export_put()) final put ffff9dd882699000/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1789263791.102467:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd882699000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1789263791.103123:0:15607:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1789263791.103134:0:15607:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789263791.103138:0:15607:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789263791.103143:0:15607:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789263791.103176:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd88269f000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1789263791.103350:0:15607:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789263791.103357:0:15607:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1789263791.103367:0:15607:0:(genops.c:885:class_export_put()) final put ffff9dd882698800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1789263791.103370:0:15607:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd882698800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1789263791.103379:0:15607:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:3.0:1789263791.103424:0:15607:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1789263791.103433:0:15607:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789263791.103438:0:15607:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789263791.103443:0:15607:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9dd88269d800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789263791.103448:0:15607:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff9dd9c1ba8000) has exports, disconnecting them 00000020:00080000:3.0:1789263791.103453:0:15607:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9dd88269d800), last request at 1789263678 00000020:00000080:3.0:1789263791.103456:0:15607:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1d687 00000020:00080000:3.0:1789263791.103468:0:15607:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dd88269d800): rc 0 00000020:00000080:3.0:1789263791.103476:0:15607:0:(genops.c:885:class_export_put()) final put ffff9dd88269d800/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1789263791.103504:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd88269d800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:3.0:1789263791.104358:0:15607:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:3.0:1789263791.104362:0:15607:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789263791.104365:0:15607:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789263791.104369:0:15607:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789263791.104408:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd88269d000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1789263791.104532:0:15607:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789263791.104540:0:15607:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:3.0:1789263791.104543:0:15607:0:(genops.c:885:class_export_put()) final put ffff9dd88269c000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:3.0:1789263791.104557:0:15607:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd88269c000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:3.0:1789263791.104563:0:15607:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:3.0:1789263791.104592:0:15607:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dd9c1b57000 1 00000020:00000080:3.0:1789263791.104596:0:15607:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1d610 00000020:00000080:3.0:1789263791.104600:0:15607:0:(genops.c:885:class_export_put()) final put ffff9dd9c1ba2000/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1789263791.104608:0:15607:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1789263791.104611:0:15607:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789263791.104614:0:15607:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789263791.104623:0:15607:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9dd9b7980000) has no exports 00000020:00000080:1.0:1789263791.104624:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd9c1ba2000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1789263791.117748:0:15607:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789263791.117758:0:15607:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1789263791.117762:0:15607:0:(genops.c:885:class_export_put()) final put ffff9dd9c1b56800/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1789263791.117766:0:15607:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd9c1b56800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1789263791.117774:0:15607:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1789263791.117871:0:15607:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9dd9c1b57800 00000020:02000400:0.0:1789263791.117909:0:15607:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1789263791.533235:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789263792.454881:0:15809:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1789263792.462534:0:15809:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1789263792.462619:0:15809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd990432400/0xce1582440fb1d919 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d920 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263792.462632:0:15809:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd990432400/0xce1582440fb1d919 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1d920 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263792.462639:0:15809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd990432400/0xce1582440fb1d919 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xce1582440fb1d920 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263792.462645:0:15809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff9dd990432400/0xce1582440fb1d919 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xce1582440fb1d920 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263792.462665:0:15809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789263792.462670:0:15809:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789263792.462694:0:15809:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:3.0:1789263792.462700:0:13146:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1789263792.462706:0:15809:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dd884acc700 x1876178898106624/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789263795 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1789263792.462710:0:13146:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd990432400/0xce1582440fb1d919 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xce1582440fb1d920 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263792.462727:0:13146:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd990432400 already unused, calling callback (ffffffffc12b1c20) 10000000:00010000:3.0:1789263792.462731:0:13146:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd990432400/0xce1582440fb1d919 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xce1582440fb1d920 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263792.462736:0:15809:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00010000:00010000:3.0:1789263792.462742:0:13146:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd990432400/0xce1582440fb1d919 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xce1582440fb1d920 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789263792.462744:0:15809:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789263792.462752:0:15809:0:(import.c:65:import_set_state_nolock()) ffff9dd883880800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 10000000:00010000:3.0:1789263792.462756:0:13146:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd990432400/0xce1582440fb1d919 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xce1582440fb1d920 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789263792.462758:0:15809:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789263792.462766:0:15809:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dd884acc700 x1876178898106624/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789263795 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1789263792.462768:0:13146:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789263792.462774:0:13146:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789263792.462778:0:13146:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00100000:2.0:1789263792.462784:0:15809:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789263792.462788:0:15809:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 4s for inflight to error out 00010000:00010000:3.0:1789263792.462797:0:13146:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9dd985683800 00010000:00010000:3.0:1789263792.462802:0:13146:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd990432400/0xce1582440fb1d919 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xce1582440fb1d920 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263792.462808:0:13146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd990432400/0xce1582440fb1d919 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xce1582440fb1d920 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263792.462810:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd884acc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3617:1876178898106624:0@lo:38:kworker.0 00010000:00010000:3.0:1789263792.462817:0:13146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263792.462820:0:13146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263792.462821:0:13146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789263792.463699:0:15809:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789263792.463706:0:15809:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dd884acf800 x1876178898106752/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263796 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789263792.463726:0:15809:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dd883f5d180 x1876178898107008/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263800 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789263792.463763:0:15809:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dd98ff7d880 x1876178898107136/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263801 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263792.463766:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd884acf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1876178898106752:0@lo:400:kworker.0 00000100:00100000:1.0:1789263792.463830:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3621:1876178898107008:0@lo:400:kworker.0 00000100:00100000:2.0:1789263792.463859:0:15809:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dd98ff7ca80 x1876178898107392/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263806 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263792.463868:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1876178898107136:0@lo:400:kworker.0 00000100:00100000:2.0:1789263792.463875:0:15809:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789263792.463880:0:15809:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1789263792.463911:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1876178898107392:0@lo:400:kworker.0 00000100:00080000:2.0:1789263792.463959:0:15809:0:(import.c:65:import_set_state_nolock()) ffff9dd883886000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1789263792.464003:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd884acce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3617:1876178898107520:0@lo:39:umount.0 00000400:00000100:0.0:1789263792.464047:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876178898107520 offset 0 length 224: 4 00010000:00010000:0.0:1789263792.557713:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263793.581336:0:13689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789263794.605328:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789263795.245274:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 66a76ccf-c64c-4b18-8369-a2861ec3956c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789263795.245284:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 66a76ccf-c64c-4b18-8369-a2861ec3956c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1789263795.629218:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263796.653226:0:13146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263797.677315:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263798.701324:0:13689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789263799.725586:0:7427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789263800.366324:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 66a76ccf-c64c-4b18-8369-a2861ec3956c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789263800.366334:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 66a76ccf-c64c-4b18-8369-a2861ec3956c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1789263800.750272:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263801.773262:0:13146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789263802.669190:0:3617:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789263792/real 1789263792] req@ffff9dd884acce00 x1876178898107520/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789263802 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263802.669222:0:3617:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9dd884acce00 x1876178898107520/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789263802 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789263802.669255:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd883886000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789263802.669273:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd884acce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3617:1876178898107520:0@lo:39:umount.0 00000100:00080000:2.0:1789263802.669318:0:15809:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789263802.669323:0:15809:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789263802.669329:0:15809:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789263802.670048:0:15809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd981683a00/0xce1582440fb1d927 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1d92e expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263802.670061:0:15809:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd981683a00/0xce1582440fb1d927 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1d92e expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263802.670068:0:15809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd981683a00/0xce1582440fb1d927 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xce1582440fb1d92e expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263802.670101:0:15809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff9dd981683a00/0xce1582440fb1d927 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xce1582440fb1d92e expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263802.670123:0:15809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789263802.670130:0:15809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9bb804600/0xce1582440fb1db9d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1dba4 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263802.670144:0:15809:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9bb804600/0xce1582440fb1db9d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1dba4 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263802.670151:0:15809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9bb804600/0xce1582440fb1db9d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xce1582440fb1dba4 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263802.670156:0:15809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff9dd9bb804600/0xce1582440fb1db9d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xce1582440fb1dba4 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263802.670182:0:15809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1789263802.670187:0:15809:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00010000:00010000:0.0:1789263802.670204:0:6475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000020:01000004:2.0:1789263802.670210:0:15809:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00010000:00010000:0.0:1789263802.670213:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd981683a00/0xce1582440fb1d927 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xce1582440fb1d92e expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:2.0:1789263802.670216:0:15809:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1789263802.670222:0:15809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00010000:00010000:0.0:1789263802.670225:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981683a00 already unused, calling callback (ffffffffc12b1c20) 00000020:00000080:2.0:1789263802.670229:0:15809:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 10000000:00010000:0.0:1789263802.670231:0:6475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd981683a00/0xce1582440fb1d927 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xce1582440fb1d92e expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1789263802.670235:0:15809:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff9dd883898000) has no exports 00010000:00010000:0.0:1789263802.670245:0:6475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd981683a00/0xce1582440fb1d927 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xce1582440fb1d92e expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789263802.670253:0:6475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd981683a00/0xce1582440fb1d927 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xce1582440fb1d92e expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789263802.670259:0:6475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000020:00080000:2.0:1789263802.670260:0:15809:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff9dd883898000) has no exports 10000000:01000000:0.0:1789263802.670262:0:6475:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1789263802.670266:0:6475:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1789263802.670280:0:6475:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9dd985683800 00010000:00010000:0.0:1789263802.670284:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd981683a00/0xce1582440fb1d927 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xce1582440fb1d92e expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263802.670291:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd981683a00/0xce1582440fb1d927 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xce1582440fb1d92e expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263802.670304:0:6475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789263802.670308:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd9bb804600/0xce1582440fb1db9d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xce1582440fb1dba4 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263802.670320:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bb804600 already unused, calling callback (ffffffffc12b1c20) 10000000:00010000:0.0:1789263802.670324:0:6475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd9bb804600/0xce1582440fb1db9d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xce1582440fb1dba4 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263802.670330:0:6475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd9bb804600/0xce1582440fb1db9d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xce1582440fb1dba4 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789263802.670336:0:6475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd9bb804600/0xce1582440fb1db9d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xce1582440fb1dba4 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789263802.670341:0:6475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789263802.670342:0:6475:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789263802.670344:0:6475:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1789263802.670349:0:6475:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9dd985683800 00010000:00010000:0.0:1789263802.670352:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd9bb804600/0xce1582440fb1db9d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xce1582440fb1dba4 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263802.670357:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd9bb804600/0xce1582440fb1db9d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xce1582440fb1dba4 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263802.670370:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263802.670371:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263802.670373:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263802.670675:0:13689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1789263802.671893:0:15809:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9dd98e776900 - data ffff9dd9b3f03438/ffff9dd9bb646000 00000020:01000000:2.0:1789263802.672021:0:15809:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9dd883b02000 - data ffff9dd9b3e70510/ffff9dd883b96800 00100000:10000000:2.0:1789263802.680635:0:15809:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1789263802.686457:0:15809:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1d7a6 00000020:00000080:2.0:1789263802.686480:0:15809:0:(genops.c:885:class_export_put()) final put ffff9dd883896000/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1789263802.686498:0:15809:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dd882a29800 from lustre-OST0001, refs=2 00000020:01000004:2.0:1789263802.686501:0:15809:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dd882a29800 2 00000020:01000004:2.0:1789263802.686504:0:15809:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9dd882a29800 from lustre-OST0001 00000020:00000080:2.0:1789263802.686530:0:15809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789263802.686539:0:15809:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1789263802.686543:0:15809:0:(genops.c:885:class_export_put()) final put ffff9dd883890800/lustre-OST0001_UUID 00000020:00000080:2.0:1789263802.686546:0:15809:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd883890800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1789263802.686560:0:15809:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000020:00000080:1.0:1789263802.686585:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd883896000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:2.0:1789263802.686703:0:15809:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 66a76ccf-c64c-4b18-8369-a2861ec3956c->MGS 00010000:00010000:2.0:1789263802.686718:0:15809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd981683000/0xce1582440fb1d545 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xce1582440fb1d54c expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789263802.686730:0:15809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd981683000/0xce1582440fb1d545 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xce1582440fb1d54c expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789263802.686745:0:15809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1789263802.686748:0:15809:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1789263802.686752:0:15809:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1789263802.686766:0:15809:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9dd985683800 00010000:00010000:2.0:1789263802.686770:0:15809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd981683000/0xce1582440fb1d545 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xce1582440fb1d54c expref: -99 pid: 7415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263802.686786:0:15809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd883f59c00/0xce1582440fb1d9c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xce1582440fb1d9c8 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789263802.686792:0:15809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd883f59c00/0xce1582440fb1d9c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xce1582440fb1d9c8 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789263802.686797:0:15809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789263802.686800:0:15809:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1789263802.686801:0:15809:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1789263802.686811:0:15809:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9dd985683800 00010000:00010000:2.0:1789263802.686814:0:15809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd883f59c00/0xce1582440fb1d9c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xce1582440fb1d9c8 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789263802.686829:0:15809:0:(import.c:65:import_set_state_nolock()) ffff9dd985683800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1789263802.686832:0:15809:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1789263802.686834:0:15809:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1789263802.686842:0:15809:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1789263802.686846:0:15809:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1789263802.686857:0:15809:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dd98ff7ce00 x1876178898107264/t0(0) o250->MGC192.168.203.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789263805 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1789263802.686875:0:15809:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1789263802.686878:0:15809:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 4s for inflight to error out 00000100:00100000:0.0:1789263802.686925:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:66a76ccf-c64c-4b18-8369-a2861ec3956c:3617:1876178898107264:0@lo:250:kworker.0 10000000:01000000:3.0:1789263802.686976:0:15809:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1789263802.686986:0:15809:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1d442 00000020:00000080:3.0:1789263802.686992:0:15809:0:(genops.c:885:class_export_put()) final put ffff9dd9838c7000/66a76ccf-c64c-4b18-8369-a2861ec3956c 00000020:01000000:3.0:1789263802.687005:0:15809:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.120@tcp (flags='') 00000020:00000080:3.0:1789263802.687011:0:15809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789263802.687015:0:15809:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.120@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789263802.687019:0:15809:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9dd9b7983370) has no exports 00000020:00000080:1.0:1789263802.687028:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd9838c7000/66a76ccf-c64c-4b18-8369-a2861ec3956c for MGC192.168.203.120@tcp 10000000:01000000:0.0:1789263802.687066:0:6484:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1789263802.687104:0:15809:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.203.120@tcp: client import never connected 00000100:00080000:3.0:1789263802.687107:0:15809:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1789263802.687110:0:15809:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1789263802.687113:0:15809:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1789263802.687116:0:15809:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1789263802.687154:0:15809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789263802.687158:0:15809:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.120@tcp (uuid 66a76ccf-c64c-4b18-8369-a2861ec3956c) 00000020:00000080:2.0:1789263802.687159:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd985683800 for MGC192.168.203.120@tcp 00000020:01000000:3.0:1789263802.687162:0:15809:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1789263802.687166:0:15809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789263802.687168:0:38:0:(genops.c:885:class_export_put()) final put ffff9dd985686800/66a76ccf-c64c-4b18-8369-a2861ec3956c 00000020:00000080:3.0:1789263802.687169:0:15809:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00000080:2.0:1789263802.687173:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd985686800/66a76ccf-c64c-4b18-8369-a2861ec3956c for MGC192.168.203.120@tcp 00000020:00080000:3.0:1789263802.687176:0:15809:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9dd883884000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789263802.687181:0:15809:0:(genops.c:1553:class_disconnect_exports()) OBD device 25 (ffff9dd9bf8f3370) has exports, disconnecting them 00000020:01000000:2.0:1789263802.687182:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.120@tcp (66a76ccf-c64c-4b18-8369-a2861ec3956c) 00000020:00080000:3.0:1789263802.687186:0:15809:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9dd883884000), last request at 1789263686 00000020:00000080:3.0:1789263802.687190:0:15809:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1d7d0 00000020:00080000:3.0:1789263802.687199:0:15809:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dd883884000): rc 0 00000020:00000080:3.0:1789263802.687203:0:15809:0:(genops.c:885:class_export_put()) final put ffff9dd883884000/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1789263802.687547:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd883884000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1789263802.689116:0:15809:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1789263802.689121:0:15809:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789263802.689124:0:15809:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789263802.689128:0:15809:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789263802.689160:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd883880800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1789263802.689339:0:15809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789263802.689347:0:15809:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1789263802.689358:0:15809:0:(genops.c:885:class_export_put()) final put ffff9dd883885800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1789263802.689362:0:15809:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd883885800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1789263802.689368:0:15809:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:2.0:1789263802.689432:0:15809:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1789263802.689436:0:15809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789263802.689439:0:15809:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789263802.689443:0:15809:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9dd883887800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789263802.689448:0:15809:0:(genops.c:1553:class_disconnect_exports()) OBD device 26 (ffff9dd9bf8f0000) has exports, disconnecting them 00000020:00080000:2.0:1789263802.689453:0:15809:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9dd883887800), last request at 1789263686 00000020:00000080:2.0:1789263802.689456:0:15809:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1d7e5 00000020:00080000:2.0:1789263802.689489:0:15809:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dd883887800): rc 0 00000020:00000080:2.0:1789263802.689492:0:15809:0:(genops.c:885:class_export_put()) final put ffff9dd883887800/lustre-MDT0001-lwp-OST0001 00000020:00000080:1.0:1789263802.689519:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd883887800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:2.0:1789263802.691227:0:15809:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:2.0:1789263802.691232:0:15809:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789263802.691235:0:15809:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789263802.691240:0:15809:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789263802.691283:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd883886000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:0.0:1789263802.691411:0:7427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1789263802.691577:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1789263802.691657:0:13146:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:0.0:1789263802.691713:0:6475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00010000:00010000:1.0:1789263802.691796:0:13689:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-5 blwis in pool) 00000100:00100000:3.0:1789263802.691893:0:6471:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9dd9915aca00:6471] 1 exiting: rc = 0 00000100:00100000:0.0:1789263802.691894:0:9488:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff9dd88397bc00:9488] 2 exiting: rc = 0 00000100:00100000:2.0:1789263802.691899:0:13688:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_003: service thread [ffff9dd88386ae00:13688] 3 exiting: rc = 0 00000100:00100000:1.0:1789263802.691932:0:6470:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9dd9acb1ee00:6470] 0 exiting: rc = 1 00000100:00100000:2.0:1789263802.691988:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263802.692348:0:6472:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9dd9acb14800:6472] 0 exiting: rc = 1 00000100:00100000:1.0:1789263802.692351:0:7428:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9dd99f948000:7428] 3 exiting: rc = 0 00000100:00100000:3.0:1789263802.692352:0:8409:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff9dd881f6d200:8409] 4 exiting: rc = 0 00000100:00100000:0.0:1789263802.692435:0:6474:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9dd9acb3d400:6474] 2 exiting: rc = 0 00000100:00100000:3.0:1789263802.692475:0:6473:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9dd9b7a54800:6473] 1 exiting: rc = 0 00000100:00100000:1.0:1789263802.692501:0:10303:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_005: service thread [ffff9dd883979200:10303] 5 exiting: rc = 0 00000100:00100000:2.0:1789263802.692562:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263802.692573:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263802.692579:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263802.692585:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263802.692590:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263802.692597:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263802.692607:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263802.692613:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263802.692618:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263802.692623:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263802.692627:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263802.692632:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263802.692638:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263802.692649:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263802.692654:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263802.692659:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263802.692664:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263802.692669:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263802.692675:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263802.692681:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263802.692686:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263802.692695:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263802.692700:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263802.692705:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263802.692710:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263802.692715:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263802.692720:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263802.692724:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263802.692735:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263802.692747:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263802.692753:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263802.692757:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263802.692762:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263802.692766:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263802.692771:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263802.692775:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263802.692780:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263802.692786:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263802.692796:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263802.692801:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263802.692805:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263802.692810:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263802.692814:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263802.692819:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263802.692824:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263802.692828:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263802.692833:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263802.692837:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263802.692841:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263802.692845:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263802.692850:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263802.692855:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263802.692863:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263802.692868:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263802.692874:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263802.692880:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263802.692885:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263802.692890:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263802.692896:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263802.692901:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263802.692906:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263802.692909:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263802.692913:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263802.692921:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1789263802.693695:0:15809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789263802.693704:0:15809:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:2.0:1789263802.693709:0:15809:0:(genops.c:885:class_export_put()) final put ffff9dd883884800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:2.0:1789263802.693713:0:15809:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd883884800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:2.0:1789263802.693718:0:15809:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:2.0:1789263802.693759:0:15809:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dd882a29800 1 00000020:00000080:2.0:1789263802.693764:0:15809:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1d775 00000020:00000080:2.0:1789263802.693770:0:15809:0:(genops.c:885:class_export_put()) final put ffff9dd882a2b000/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1789263802.693812:0:15809:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1789263802.693816:0:15809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789263802.693821:0:15809:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789263802.693824:0:15809:0:(genops.c:1558:class_disconnect_exports()) OBD device 23 (ffff9dd9b79819b8) has no exports 00000020:00000080:1.0:1789263802.694531:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd882a2b000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1789263802.711878:0:15809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789263802.711899:0:15809:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1789263802.711905:0:15809:0:(genops.c:885:class_export_put()) final put ffff9dd882a2e000/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1789263802.711909:0:15809:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd882a2e000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1789263802.711915:0:15809:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1789263802.712220:0:15809:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9dd882a2a800 00000020:01000000:3.0:1789263802.712241:0:15809:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1789263802.712243:0:15809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789263802.712246:0:15809:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789263802.712249:0:15809:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff9dd9c1ba99b8) has no exports 00000020:00000080:3.0:1789263802.712267:0:15809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789263802.712271:0:15809:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1789263802.712274:0:15809:0:(genops.c:885:class_export_put()) final put ffff9dd9c1ba4800/OSS_uuid 00000020:00000080:3.0:1789263802.712275:0:15809:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd9c1ba4800/OSS_uuid for OSS 00000020:01000000:3.0:1789263802.712278:0:15809:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:2.0:1789263802.712325:0:6483:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1789263802.712370:0:8395:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9dd9c1bb8200:8395] 2 exiting: rc = 0 00000100:00100000:0.0:1789263802.712387:0:8394:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9dd9bb52bc00:8394] 1 exiting: rc = 0 00000100:00100000:1.0:1789263802.712491:0:13766:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff9dd8842df800:13766] 4 exiting: rc = 0 00000100:00100000:0.0:1789263802.712516:0:8511:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9dd9bf9a4e00:8511] 3 exiting: rc = 0 00000100:00100000:2.0:1789263802.712523:0:8392:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9dd9915ada00:8392] 0 exiting: rc = 1 00000100:00100000:3.0:1789263802.712580:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.712589:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.712595:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.712601:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.712606:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.712611:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.712617:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.712622:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.712628:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.712634:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.712640:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.712645:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.712648:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.712652:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.712655:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.712659:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.712662:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.712665:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.712668:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.712672:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.712683:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.712688:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.712693:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.712698:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.712703:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.712708:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.712713:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.712719:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.712723:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.712727:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.712730:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.712733:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.712738:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.712743:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.712748:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.712753:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.712758:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.712763:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.712767:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.712772:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.712777:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.712782:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.712787:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.712792:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.712796:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.712801:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.712806:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.712811:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.712816:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.712820:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.712826:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.712832:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.712838:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.712843:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.712849:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.712861:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.712866:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.712872:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.712877:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.712882:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.712887:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.712893:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.712898:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.712908:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263802.713946:0:8396:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9dd9c0a62a00:8396] 0 exiting: rc = 1 00000100:00100000:0.0:1789263802.713952:0:8397:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9dd9c0a62200:8397] 1 exiting: rc = 0 00000100:00100000:2.0:1789263802.714043:0:8512:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9dd9c0ad8000:8512] 2 exiting: rc = 0 00000100:00100000:3.0:1789263802.714124:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.714132:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.714139:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.714144:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.714151:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.714159:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.714167:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.714174:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.714180:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.714186:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.714191:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.714196:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.714200:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.714204:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.714208:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.714217:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.714223:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.714227:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.714232:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.714237:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.714242:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.714246:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.714252:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.714260:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.714268:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.714275:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.714288:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.714293:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.714298:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.714302:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.714307:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.714312:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.714317:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.714322:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.714326:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.714330:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.714334:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.714338:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.714342:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.714347:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.714351:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.714356:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.714359:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.714363:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.714367:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.714371:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.714375:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.714379:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.714385:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.714390:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.714394:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.714399:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.714404:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.714408:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.714413:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.714417:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.714422:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.714427:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.714431:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.714435:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.714439:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.714449:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.714454:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.714458:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263802.715526:0:8399:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9dd9ba827800:8399] 1 exiting: rc = 0 00000100:00100000:2.0:1789263802.715616:0:8400:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9dd9ba86ec00:8400] 2 exiting: rc = 0 00000100:00100000:0.0:1789263802.715765:0:8398:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9dd989881400:8398] 0 exiting: rc = 1 00000100:00100000:3.0:1789263802.715879:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.715888:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.715893:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.715899:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.715920:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.715927:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.715932:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.715938:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.715944:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.715950:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.715955:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.715961:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.715968:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.715973:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.715978:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.715983:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.715989:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.715996:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.716001:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.716007:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.716013:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.716019:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.716024:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.716034:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.716041:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.716046:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.716052:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.716058:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.716101:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.716111:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.716117:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.716122:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.716137:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.716144:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.716151:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.716158:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.716164:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.716170:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.716175:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.716181:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.716189:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.716196:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.716205:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.716214:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.716221:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.716232:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.716239:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.716245:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.716250:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.716256:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.716261:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.716267:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.716273:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.716289:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.716297:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.716312:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.716324:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.716331:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.716336:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.716342:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.716348:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.716353:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.716358:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.716364:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263802.720258:0:8402:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9dd9ba878000:8402] 1 exiting: rc = 0 00000100:00100000:1.0:1789263802.720278:0:8401:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9dd9c1b06000:8401] 0 exiting: rc = 1 00000100:00100000:2.0:1789263802.720536:0:8500:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_002: service thread [ffff9dd881f6b800:8500] 2 exiting: rc = 0 00000100:00100000:3.0:1789263802.721018:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.721026:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.721031:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.721048:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.721053:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.721058:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.721064:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.721069:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.721332:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.721343:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.721350:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.721356:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.721361:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.721366:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.721371:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.721382:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.721387:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.721392:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.721401:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.721414:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.721426:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.721436:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.721443:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.721448:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.721508:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.721515:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.721520:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.721524:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.721529:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.721533:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.721538:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.721543:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.721556:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.721562:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.721567:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.721572:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.721577:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.721583:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.721596:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.721601:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.721606:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.721611:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.721615:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.721620:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.721625:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.721630:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.721634:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.721639:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.721643:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.721648:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.721653:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.721657:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.721662:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.721668:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.721672:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.721677:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.721682:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.721686:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.721697:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.721710:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.721717:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.721722:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.721726:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.721731:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263802.722416:0:8404:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9dd9bb51e200:8404] 1 exiting: rc = 0 00000100:00100000:0.0:1789263802.722429:0:8403:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9dd99f94b200:8403] 0 exiting: rc = 1 00000100:00100000:3.0:1789263802.722502:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.722513:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.722520:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.722526:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.722532:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.722538:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.722544:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.722550:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.722557:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.722570:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.722576:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.722581:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.722599:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.722606:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.722612:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.722617:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.722623:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.722629:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.722635:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.722641:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.722644:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.722648:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.722653:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.722659:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.722680:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.722688:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.722694:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.722700:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.722706:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.722711:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.722716:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.722720:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.722724:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.722727:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.722731:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.722735:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.722749:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.722753:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.722757:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.722762:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.722769:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.722776:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.722782:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.722787:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.722801:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.722807:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.722812:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.722818:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.722838:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.722845:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.722851:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.722857:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.722863:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.722868:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.722875:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.722881:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.722888:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.722894:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.722900:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.722905:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.722925:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.722932:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.722937:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263802.722943:0:15809:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1789263802.727889:0:15809:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1789263809.789094:0:16572:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg320-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1789263813.818521:0:17171:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789263813.818538:0:17171:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1789263813.818540:0:17171:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1789263813.818659:0:17171:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9dd882a35000 00000020:01000004:0.0:1789263813.818673:0:17171:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1789263813.818679:0:17171:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789263813.818693:0:17171:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9dd9c09c0000) 00000020:00000080:0.0:1789263813.818705:0:17171:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1789263813.852261:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1789263813.854070:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1789263813.855101:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1789263813.855780:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1789263813.856157:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:0.0:1789263813.856336:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1789263813.856685:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:0.0:1789263813.856874:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1789263813.857096:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1789263813.857331:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:0.0:1789263813.857492:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:0.0:1789263813.857709:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1789263813.857902:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1789263813.858095:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:0.0:1789263813.860721:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:0.0:1789263813.862255:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1789263813.862423:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1789263813.862557:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:0.0:1789263813.862706:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1789263813.862869:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1789263813.863055:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1789263813.863316:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1789263813.863556:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1789263813.863735:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:0.0:1789263813.863904:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1789263813.864059:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:0.0:1789263813.864307:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1789263813.864470:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1789263813.865064:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1789263813.865373:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:0.0:1789263813.865665:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:0.0:1789263813.865819:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:0.0:1789263813.865999:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1789263813.866218:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1789263813.866439:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:0.0:1789263813.866601:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1789263813.866767:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1789263813.866899:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1789263813.867105:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:0.0:1789263813.867460:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1789263813.867680:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:0.0:1789263813.868347:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:0.0:1789263813.868555:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:0.0:1789263813.868752:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:0.0:1789263813.868926:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1789263813.869407:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1789263813.869544:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1789263813.870099:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:0.0:1789263813.870539:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:0.0:1789263813.870899:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:0.0:1789263813.871243:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:0.0:1789263813.871424:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:0.0:1789263813.871611:0:17171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:01000000:0.0:1789263813.872006:0:17171:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1789263813.872216:0:17171:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1789263813.872222:0:17171:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789263813.872234:0:17171:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xce1582440fb1e981 00000020:01000004:0.0:1789263813.872240:0:17171:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1789263813.872245:0:17171:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1789263813.872250:0:17171:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9dd882a35000 from MGS 00000020:01000004:0.0:1789263813.872253:0:17171:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1789263813.872264:0:17171:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9dd9c09c4d28) 00000020:00000080:0.0:1789263813.872273:0:17171:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1789263813.872321:0:17171:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dd882a35000 from MGS, refs=2 00080000:01000000:0.0:1789263813.872325:0:17171:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789263813.872328:0:17171:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xce1582440fb1e98f 00000100:00100000:0.0:1789263813.872425:0:17171:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1789263813.872583:0:17171:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1789263813.872597:0:17171:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1789263813.872870:0:17171:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1789263813.872877:0:17171:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1789263813.873427:0:17171:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789263813.873560:0:17171:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1789263813.873564:0:17171:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1789263813.873869:0:17171:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1789263813.873876:0:17171:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1789263813.874059:0:17171:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1789263813.874066:0:17171:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1789263813.874663:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263813.874667:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263813.874669:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263813.875092:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263813.875095:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263813.875097:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263813.875667:0:17171:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1789263813.877154:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1789263813.880531:0:17171:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1789263813.881135:0:17183:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1789263813.881157:0:17171:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1789263813.881198:0:17171:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789263813.881741:0:17171:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1789263813.882206:0:17171:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789263813.882405:0:17171:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1789263813.882417:0:17171:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1789263813.882851:0:17171:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1789263813.882858:0:17171:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1789263813.883160:0:17171:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1789263813.883168:0:17171:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:0.0:1789263813.883481:0:17188:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:1.0:1789263813.883666:0:17171:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1789263813.883680:0:17171:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.120@tcp' 00000020:01000004:1.0:1789263813.883682:0:17171:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1789263813.883702:0:17171:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.120@tcp (typ=mgc) 00000020:00000080:1.0:1789263813.883712:0:17171:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.120@tcp (ffff9dd9bf8f19b8) 00000020:00000080:1.0:1789263813.883723:0:17171:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1789263813.883798:0:17171:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dd9838d1800@MGC192.168.203.120@tcp: add connection 192.168.203.120@tcp at head 00010000:00010000:1.0:1789263813.883925:0:17171:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.120@tcp-0 is initialized 00000040:01000000:1.0:1789263813.883929:0:17171:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.120@tcp ctxt 1 is initialized 10000000:01000000:1.0:1789263813.884185:0:17189:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1789263813.884229:0:17171:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.120@tcp (uuid de026c8f-6636-4fc7-8061-42c8092f00f0) 00000020:00000080:0.0:1789263813.884256:0:17171:0:(genops.c:1385:class_connect()) connect: client de026c8f-6636-4fc7-8061-42c8092f00f0, cookie 0xce1582440fb1e99d 00000100:00080000:0.0:1789263813.884266:0:17171:0:(import.c:510:import_select_connection()) MGC192.168.203.120@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789263813.884272:0:17171:0:(import.c:624:import_select_connection()) MGC192.168.203.120@tcp: import ffff9dd9838d1800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:0.0:1789263813.884306:0:17171:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd883f5e680 x1876178898107648/t0(0) o250->MGC192.168.203.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789263813.884333:0:17171:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import de026c8f-6636-4fc7-8061-42c8092f00f0->MGS 00000020:01000004:0.0:1789263813.884355:0:17171:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1789263813.884359:0:17171:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000100:00100000:1.0:1789263813.884374:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:de026c8f-6636-4fc7-8061-42c8092f00f0:3617:1876178898107648:0@lo:250:mount.lustre.0 00000020:00000080:0.0:1789263813.884377:0:17171:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9dd9c09c19b8) 00000020:00000080:0.0:1789263813.884407:0:17171:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1789263813.884452:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263813.884527:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898107648 00000100:00100000:1.0:1789263813.884535:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898107648 00000100:00100000:1.0:1789263813.884567:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789263813.884574:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98fe86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3617:x1876178898107648:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1789263813.884596:0:17185:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from de026c8f-6636-4fc7-8061-42c8092f00f0@0@lo t0 exp 0000000000000000 cur 256 last 0 00000020:00000080:1.0:1789263813.884622:0:17185:0:(genops.c:1385:class_connect()) connect: client de026c8f-6636-4fc7-8061-42c8092f00f0, cookie 0xce1582440fb1e9ab 00000100:00080000:1.0:1789263813.884787:0:17185:0:(import.c:65:import_set_state_nolock()) ffff9dd9838d4000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789263813.884844:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98fe86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+5:3617:x1876178898107648:12345-0@lo:250:mount.lustre.0 Request processed in 268us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263813.884852:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789263813.884875:0:3617:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.120@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1789263813.884886:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.120@tcp: connect to target with instance 0 00000100:00080000:2.0:1789263813.884893:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.120@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1789263813.884897:0:3617:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1789263813.884901:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd9838d1800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1789263813.884903:0:3617:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1789263813.884916:0:3617:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1789263813.884922:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:de026c8f-6636-4fc7-8061-42c8092f00f0:3617:1876178898107648:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1789263813.890064:0:17171:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789263813.890297:0:17171:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1789263813.890304:0:17171:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1789263813.890884:0:17171:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1789263813.890889:0:17171:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1789263813.891175:0:17171:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1789263813.891182:0:17171:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1789263813.891821:0:17171:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789263813.891971:0:17171:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1789263813.891978:0:17171:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1789263813.892618:0:17171:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1789263813.892624:0:17171:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1789263813.913257:0:17171:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789263813.913422:0:17171:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1789263813.913427:0:17171:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1789263813.914541:0:17171:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1789263813.914549:0:17171:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1789263813.915066:0:17171:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789263813.915304:0:17171:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789263813.915310:0:17171:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1789263813.915755:0:17171:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789263813.915762:0:17171:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1789263813.916335:0:17171:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789263813.916554:0:17171:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789263813.916560:0:17171:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1789263813.917007:0:17171:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789263813.917018:0:17171:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1789263813.917570:0:17171:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789263813.917738:0:17171:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789263813.917744:0:17171:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1789263813.918184:0:17171:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789263813.918194:0:17171:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1789263813.930429:0:17171:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789263813.930649:0:17171:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789263813.930655:0:17171:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1789263813.931631:0:17171:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789263813.931640:0:17171:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1789263813.932249:0:17171:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789263813.932257:0:17171:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1789263813.932797:0:17171:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1789263813.932824:0:17171:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1789263813.932830:0:17171:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.120@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1789263813.932945:0:17171:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.120@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789263813.932976:0:17171:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.120@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1789263813.932981:0:17171:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789263813.932983:0:17171:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789263813.932984:0:17171:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789263813.932985:0:17171:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789263813.932987:0:17171:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789263813.932988:0:17171:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789263813.932989:0:17171:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789263813.932991:0:17171:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789263813.932992:0:17171:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789263813.932993:0:17171:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789263813.932996:0:17171:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1789263813.932998:0:17171:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789263813.933003:0:17171:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789263813.933005:0:17171:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789263813.933005:0:17171:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789263813.933006:0:17171:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789263813.933007:0:17171:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789263813.933008:0:17171:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789263813.933009:0:17171:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789263813.933010:0:17171:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789263813.933011:0:17171:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789263813.933032:0:17171:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789263813.933046:0:17171:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa65c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:17171:1876178898107776:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789263813.933128:0:17171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263813.933159:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898107776 00000100:00100000:0.0:1789263813.933167:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898107776 00000100:00100000:1.0:1789263813.933178:0:17171:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9ba82e540 going to sleep for 11 seconds 00000100:00100000:0.0:1789263813.933214:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789263813.933224:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98fe87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de026c8f-6636-4fc7-8061-42c8092f00f0+5:17171:x1876178898107776:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789263813.933268:0:17187:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789263813.933271:0:17187:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789263813.933274:0:17187:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1789263813.933579:0:17207:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1789263813.934092:0:17187:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:1.0:1789263813.935198:0:17208:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1789263813.935203:0:17208:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1789263813.935206:0:17208:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1789263813.935208:0:17208:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1789263813.935401:0:17208:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1789263813.935487:0:17187:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789263813.935495:0:17187:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1789263813.936415:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98fe87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de026c8f-6636-4fc7-8061-42c8092f00f0+5:17171:x1876178898107776:12345-0@lo:253:mount.lustre.0 Request processed in 3190us (3282us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263813.936425:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789263813.936434:0:17171:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa65c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:17171:1876178898107776:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789263813.936447:0:17171:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789263813.936450:0:17171:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789263813.936451:0:17171:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789263813.936452:0:17171:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789263813.936453:0:17171:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789263813.936454:0:17171:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789263813.936455:0:17171:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789263813.936456:0:17171:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789263813.936457:0:17171:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789263813.936458:0:17171:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789263813.936459:0:17171:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789263813.936476:0:17171:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9dd882a35000 from lustre-MDT0000 10000000:01000000:1.0:1789263813.936495:0:17171:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1789263813.936507:0:17171:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789263813.936511:0:17171:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9dd9bf8f19b8 10000000:01000000:1.0:1789263813.936516:0:17171:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789263813.936528:0:17171:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9dd9bf8f19b8 from 1 10000000:01000000:1.0:1789263813.936532:0:17171:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789263813.936560:0:17171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883f59a00/0xce1582440fb1e9b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263813.936568:0:17171:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd883f59a00/0xce1582440fb1e9b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263813.936575:0:17171:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd883f59a00/0xce1582440fb1e9b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263813.936589:0:17171:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa65c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:17171:1876178898107904:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789263813.936619:0:17171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263813.936657:0:17171:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9ba82e480 going to sleep for 11 seconds 00000100:00100000:2.0:1789263813.936684:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898107904 00000100:00100000:2.0:1789263813.936690:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898107904 00000100:00100000:2.0:1789263813.936729:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789263813.936745:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98fe87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+5:17171:x1876178898107904:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789263813.936758:0:17185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263813.936771:0:17185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd9bb805400/0xce1582440fb1e9b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1e9b2 expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263813.936793:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd9bb805400/0xce1582440fb1e9b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1e9b2 expref: 6 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263813.936804:0:17185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd9bb805400/0xce1582440fb1e9b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1e9b2 expref: 6 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263813.936814:0:17185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bb805400, rc 0) 00000100:00100000:2.0:1789263813.936841:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98fe87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+6:17171:x1876178898107904:12345-0@lo:101:mount.lustre.0 Request processed in 100us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263813.936847:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789263813.936856:0:17171:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa65c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:17171:1876178898107904:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789263813.936869:0:17171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd883f59a00/0xce1582440fb1e9b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1e9b9 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263813.936875:0:17171:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd883f59a00/0xce1582440fb1e9b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1e9b9 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263813.936908:0:17171:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa65c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:17171:1876178898108032:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789263813.936924:0:17171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263813.936939:0:17171:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9ba82e480 going to sleep for 11 seconds 00000100:00100000:0.0:1789263813.936958:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898108032 00000100:00100000:0.0:1789263813.936962:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898108032 00000100:00100000:0.0:1789263813.936984:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789263813.936989:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98fe85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de026c8f-6636-4fc7-8061-42c8092f00f0+6:17171:x1876178898108032:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789263813.937039:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98fe85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de026c8f-6636-4fc7-8061-42c8092f00f0+6:17171:x1876178898108032:12345-0@lo:501:mount.lustre.0 Request processed in 50us (113us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789263813.937050:0:17171:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa65c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:17171:1876178898108032:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789263813.937054:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 10000000:01000000:1.0:1789263813.937071:0:17171:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789263813.937097:0:17171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883f59a00/0xce1582440fb1e9b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1e9b9 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263813.937112:0:17171:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd883f59a00/0xce1582440fb1e9b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1e9b9 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789263813.937117:0:17171:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9dd882a35000 10000000:01000000:1.0:1789263813.937119:0:17171:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789263813.937122:0:17171:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9dd882a35000 10000000:01000000:1.0:1789263813.937123:0:17171:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1789263813.937125:0:17171:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9dd882a35000 from 1 10000000:01000000:1.0:1789263813.937126:0:17171:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1789263813.937136:0:17171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883f59800/0xce1582440fb1e9c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263813.937140:0:17171:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd883f59800/0xce1582440fb1e9c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263813.937145:0:17171:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd883f59800/0xce1582440fb1e9c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263813.937152:0:17171:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa65c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:17171:1876178898108160:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789263813.937169:0:17171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263813.937186:0:17171:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9ba82e480 going to sleep for 11 seconds 00000100:00100000:2.0:1789263813.937213:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898108160 00000100:00100000:2.0:1789263813.937218:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898108160 00000100:00100000:2.0:1789263813.937255:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789263813.937264:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98fe86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+6:17171:x1876178898108160:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789263813.937272:0:17185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263813.937282:0:17185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd9bb805600/0xce1582440fb1e9c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1e9c0 expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263813.937296:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd9bb805600/0xce1582440fb1e9c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1e9c0 expref: 7 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263813.937302:0:17185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd9bb805600/0xce1582440fb1e9c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1e9c0 expref: 7 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263813.937315:0:17185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bb805600, rc 0) 00000100:00100000:2.0:1789263813.937340:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98fe86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+7:17171:x1876178898108160:12345-0@lo:101:mount.lustre.0 Request processed in 79us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263813.937352:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789263813.937359:0:17171:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa65c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:17171:1876178898108160:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789263813.937374:0:17171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd883f59800/0xce1582440fb1e9c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1e9c7 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263813.937382:0:17171:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd883f59800/0xce1582440fb1e9c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1e9c7 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789263813.937411:0:17171:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1789263813.937422:0:17171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883f59800/0xce1582440fb1e9c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1e9c7 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263813.937427:0:17171:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd883f59800/0xce1582440fb1e9c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1e9c7 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789263813.937432:0:17171:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789263813.937436:0:17171:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789263813.937440:0:17171:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9dd882a35000 10000000:01000000:1.0:1789263813.937443:0:17171:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1789263813.937447:0:17171:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1789263813.937449:0:17171:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789263813.937463:0:17171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883f58c00/0xce1582440fb1e9ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263813.937469:0:17171:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd883f58c00/0xce1582440fb1e9ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263813.937477:0:17171:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd883f58c00/0xce1582440fb1e9ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263813.937490:0:17171:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa65c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:17171:1876178898108288:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789263813.937513:0:17171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263813.937528:0:17171:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9ba82e480 going to sleep for 11 seconds 00000100:00100000:0.0:1789263813.937544:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898108288 00000100:00100000:0.0:1789263813.937550:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898108288 00000100:00100000:0.0:1789263813.937577:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789263813.937582:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98fe87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de026c8f-6636-4fc7-8061-42c8092f00f0+7:17171:x1876178898108288:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789263813.937587:0:17187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263813.937596:0:17187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd883e73200/0xce1582440fb1e9d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1e9ce expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263813.937622:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd883e73200/0xce1582440fb1e9d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1e9ce expref: 8 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263813.937631:0:17187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd883e73200/0xce1582440fb1e9d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1e9ce expref: 8 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263813.937638:0:17187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd883e73200, rc 0) 00000100:00100000:0.0:1789263813.937671:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98fe87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de026c8f-6636-4fc7-8061-42c8092f00f0+8:17171:x1876178898108288:12345-0@lo:101:mount.lustre.0 Request processed in 88us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263813.937676:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789263813.937715:0:17171:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa65c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:17171:1876178898108288:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789263813.937728:0:17171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd883f58c00/0xce1582440fb1e9ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1e9d5 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263813.937750:0:17171:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd883f58c00/0xce1582440fb1e9ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1e9d5 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263813.937793:0:17171:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa65c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:17171:1876178898108416:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789263813.937821:0:17171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263813.937840:0:17171:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9ba82e480 going to sleep for 11 seconds 00000100:00100000:2.0:1789263813.937867:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898108416 00000100:00100000:2.0:1789263813.937872:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898108416 00000100:00100000:2.0:1789263813.937898:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789263813.937904:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882aae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+8:17171:x1876178898108416:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789263813.938004:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882aae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+9:17171:x1876178898108416:12345-0@lo:501:mount.lustre.0 Request processed in 100us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263813.938012:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789263813.938020:0:17171:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa65c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:17171:1876178898108416:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789263813.938049:0:17171:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa65c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:17171:1876178898108544:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789263813.938101:0:17171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263813.938121:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898108544 00000100:00100000:1.0:1789263813.938125:0:17171:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9ba82e480 going to sleep for 11 seconds 00000100:00100000:0.0:1789263813.938126:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898108544 00000100:00100000:0.0:1789263813.938158:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789263813.938165:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882aac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de026c8f-6636-4fc7-8061-42c8092f00f0+9:17171:x1876178898108544:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789263813.938592:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882aac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de026c8f-6636-4fc7-8061-42c8092f00f0+9:17171:x1876178898108544:12345-0@lo:503:mount.lustre.0 Request processed in 426us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263813.938601:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789263813.938615:0:17171:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa65c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:17171:1876178898108544:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789263813.938894:0:17209:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd884acdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de026c8f-6636-4fc7-8061-42c8092f00f0:17209:1876178898108672:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789263813.938934:0:17209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263813.938957:0:17209:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd8841cf240 going to sleep for 11 seconds 00000100:00100000:1.0:1789263813.938981:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898108672 00000100:00100000:1.0:1789263813.938988:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898108672 00000100:00100000:1.0:1789263813.939036:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789263813.939043:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882aad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+9:17209:x1876178898108672:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789263813.939559:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882aad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+9:17209:x1876178898108672:12345-0@lo:502:llog_process_th.0 Request processed in 516us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263813.939567:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789263813.939594:0:17209:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd884acdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de026c8f-6636-4fc7-8061-42c8092f00f0:17209:1876178898108672:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789263813.939616:0:17209:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789263813.939624:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263813.939625:0:17209:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789263813.939629:0:17209:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1789263813.939631:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789263813.939642:0:17209:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9dd9890e99b8) 00000020:00000080:2.0:1789263813.939652:0:17209:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1789263813.939656:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1789263813.939731:0:17209:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:2.0:1789263813.939738:0:17209:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xce1582440fb1e9e3 00000020:00000080:2.0:1789263813.939895:0:17209:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1789263813.939903:0:17209:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789263813.939906:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263813.939907:0:17209:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789263813.939909:0:17209:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789263813.939912:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263813.939913:0:17209:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1789263813.939916:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789263813.939923:0:17209:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9dd9890e8000) 00000020:00000080:2.0:1789263813.939932:0:17209:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1789263813.939936:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1789263813.939938:0:17209:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1789263813.939941:0:17209:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1789263813.939946:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789263813.939998:0:17209:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dd882a35000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1789263813.940011:0:17209:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9dd9890ecd28) 00000020:00000080:2.0:1789263813.940018:0:17209:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1789263813.940119:0:17209:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1789263813.940127:0:17209:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xce1582440fb1e9f8 00000020:00000080:2.0:1789263813.940218:0:17209:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1789263813.940231:0:17209:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1789263813.940235:0:17209:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xce1582440fb1e9ff 00080000:01000000:2.0:1789263813.940240:0:17209:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:2.0:1789263813.940243:0:17209:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xce1582440fb1ea06 00010000:00010000:3.0:1789263813.977647:0:17209:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1789263813.978036:0:17209:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967516 00000001:00080000:3.0:1789263813.978404:0:17209:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789263813.978853:0:17209:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9dd8838999b8) 00000020:00000080:3.0:1789263813.978873:0:17209:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1789263813.978979:0:17209:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789263813.978988:0:17209:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xce1582440fb1ea14 00000020:00000080:1.0:1789263813.979537:0:17209:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1789263813.982168:0:17209:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xce1582440fb1ea1b 00000020:00000080:2.0:1789263813.982579:0:17209:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1789263813.982596:0:17209:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789263813.982604:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263813.982606:0:17209:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1789263813.982610:0:17209:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789263813.982614:0:17209:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1789263813.982615:0:17209:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789263813.982617:0:17209:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789263813.982618:0:17209:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789263813.982622:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263813.982623:0:17209:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789263813.982633:0:17209:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789263813.982639:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263813.982641:0:17209:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1789263813.982647:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1789263813.982707:0:17209:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1789263813.982725:0:17209:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789263813.982728:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263813.982730:0:17209:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1789263813.982732:0:17209:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789263813.982735:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263813.982737:0:17209:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1789263813.982741:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789263813.982747:0:17209:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.120@tcp to nid 0x20000c0a8cb78 (192.168.203.120@tcp) 00000020:00000080:2.0:1789263813.982782:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789263813.982800:0:17209:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9dd9890eb370) 00000020:00000080:2.0:1789263813.982819:0:17209:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1789263813.982824:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789263813.982912:0:17209:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1789263813.982918:0:17209:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:2.0:1789263813.982926:0:17209:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xce1582440fb1ea29 00010000:00080000:2.0:1789263813.982963:0:17209:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dd882698000@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.120@tcp at head 00010000:00010000:2.0:1789263813.985324:0:17209:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:2.0:1789263813.986283:0:17209:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789263813.986300:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1789263813.986337:0:17209:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789263813.986359:0:17209:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xce1582440fb1ea30 00000100:00080000:2.0:1789263813.986371:0:17209:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789263813.986378:0:17209:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9dd882698000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:2.0:1789263813.986431:0:17209:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd884acdf80 x1876178898108800/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789263813.986462:0:17209:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1789263813.986539:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd884acdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1876178898108800:0@lo:38:llog_process_th.0 00000020:01000000:2.0:1789263813.986562:0:17209:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789263813.986569:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263813.986571:0:17209:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1789263813.986575:0:17209:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789263813.986579:0:17209:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:2.0:1789263813.986581:0:17209:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789263813.986582:0:17209:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789263813.986584:0:17209:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789263813.986588:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263813.986590:0:17209:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789263813.986593:0:17209:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789263813.986598:0:17209:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1789263813.986602:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263813.986604:0:17209:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1789263813.986608:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789263813.986613:0:17209:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.120@tcp to nid 0x20000c0a8cb78 (192.168.203.120@tcp) 00000100:00100000:1.0:1789263813.986625:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1789263813.986650:0:17209:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789263813.986653:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789263813.986669:0:17209:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9dd98731b370) 00000020:00000080:2.0:1789263813.986683:0:17209:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1789263813.986688:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00100000:0.0:1789263813.986717:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898108800 00000100:00100000:0.0:1789263813.986736:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898108800 00000004:00080000:2.0:1789263813.986769:0:17209:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1789263813.986775:0:17209:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:2.0:1789263813.986785:0:17209:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xce1582440fb1ea3e 00000100:00100000:0.0:1789263813.986791:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789263813.986800:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3617:x1876178898108800:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789263813.986817:0:17209:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dd9c088f800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.120@tcp at head 00010000:00020000:0.0:1789263813.986821:0:17196:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789263813.986877:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3617:x1876178898108800:12345-0@lo:38:llog_process_th.0 Request processed in 77us (261us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789263813.986886:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1789263813.986921:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd882698000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789263813.986927:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789263813.986943:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd884acdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1876178898108800:0@lo:38:llog_process_th.0 00010000:00010000:2.0:1789263813.988172:0:17209:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1789263813.988929:0:17209:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789263813.989063:0:17209:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1789263813.989644:0:17209:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 0, last_idx 1 00000040:00080000:2.0:1789263813.990664:0:17209:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789263813.990889:0:17209:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1789263813.993698:0:17209:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1789263813.994364:0:17215:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 2 synced_idx: 0 lgh_last_idx: 2 00000040:00080000:0.0:1789263813.994370:0:17215:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1789263813.994978:0:17209:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789263813.994990:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789263813.995022:0:17209:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789263813.995039:0:17209:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xce1582440fb1ea45 00000100:00080000:2.0:1789263813.995047:0:17209:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789263813.995052:0:17209:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9dd9c088f800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:2.0:1789263813.995113:0:17209:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd884acd180 x1876178898108928/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789263813.995144:0:17209:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1789263813.995218:0:17209:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789263813.995222:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263813.995224:0:17209:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1789263813.995227:0:17209:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789263813.995230:0:17209:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:2.0:1789263813.995232:0:17209:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789263813.995233:0:17209:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789263813.995235:0:17209:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789263813.995237:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263813.995239:0:17209:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789263813.995241:0:17209:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789263813.995245:0:17209:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1789263813.995248:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263813.995249:0:17209:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1789263813.995252:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789263813.995256:0:17209:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.120@tcp to nid 0x20000c0a8cb78 (192.168.203.120@tcp) 00000020:01000000:2.0:1789263813.995277:0:17209:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789263813.995279:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789263813.995290:0:17209:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9dd987318000) 00000020:00000080:2.0:1789263813.995300:0:17209:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:2.0:1789263813.995304:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789263813.995354:0:17209:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1789263813.995360:0:17209:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:2.0:1789263813.995375:0:17209:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xce1582440fb1ea53 00000100:00100000:3.0:1789263813.995377:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd884acd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1876178898108928:0@lo:8:llog_process_th.0 00010000:00080000:2.0:1789263813.995417:0:17209:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dd9bf998000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.120@tcp at head 00000400:00000100:3.0:1789263813.995439:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876178898108928 offset 0 length 520: 4 00010000:00010000:2.0:1789263813.995631:0:17209:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1789263813.995731:0:17209:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789263813.995742:0:17209:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1789263813.996950:0:17209:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789263813.997348:0:17209:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1789263813.997471:0:17209:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1789263813.997835:0:17217:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789263813.997839:0:17217:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1789263813.998468:0:17209:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789263813.998480:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789263813.998522:0:17209:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789263813.998541:0:17209:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xce1582440fb1ea5a 00000100:00080000:1.0:1789263813.998549:0:17209:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789263813.998555:0:17209:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9dd9bf998000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:1.0:1789263813.998585:0:17209:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd9bfa66d80 x1876178898109056/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789263813.998614:0:17209:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1789263813.998660:0:17209:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789263813.998663:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789263813.998665:0:17209:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1789263813.998669:0:17209:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789263813.998673:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789263813.998675:0:17209:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789263813.998678:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789263813.998680:0:17209:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789263813.998682:0:17209:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789263813.998684:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789263813.998685:0:17209:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789263813.998688:0:17209:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789263813.998690:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789263813.998691:0:17209:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789263813.998694:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789263813.998722:0:17209:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa65500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de026c8f-6636-4fc7-8061-42c8092f00f0:17209:1876178898109184:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789263813.998781:0:17209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263813.998808:0:17209:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd8838eab40 going to sleep for 11 seconds 00000100:00100000:0.0:1789263813.998817:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898109184 00000100:00100000:0.0:1789263813.998824:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898109184 00000100:00100000:3.0:1789263813.998856:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1876178898109056:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1789263813.998869:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789263813.998881:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882aadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de026c8f-6636-4fc7-8061-42c8092f00f0+9:17209:x1876178898109184:12345-0@lo:502:llog_process_th.0 00000400:00000100:3.0:1789263813.998888:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876178898109056 offset 0 length 520: 4 00000100:00100000:0.0:1789263813.998988:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882aadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de026c8f-6636-4fc7-8061-42c8092f00f0+9:17209:x1876178898109184:12345-0@lo:502:llog_process_th.0 Request processed in 110us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263813.998995:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789263813.999053:0:17209:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa65500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de026c8f-6636-4fc7-8061-42c8092f00f0:17209:1876178898109184:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789263813.999117:0:17209:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789263813.999121:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789263813.999123:0:17209:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789263813.999126:0:17209:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1789263813.999299:0:17171:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1789263813.999319:0:17171:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789263813.999340:0:17171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883f58c00/0xce1582440fb1e9ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1e9d5 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263813.999351:0:17171:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd883f58c00/0xce1582440fb1e9ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1e9d5 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789263813.999359:0:17171:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9dd882a35000 from 1 10000000:01000000:0.0:1789263813.999362:0:17171:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789263813.999406:0:17171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883e73400/0xce1582440fb1ea61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263813.999415:0:17171:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd883e73400/0xce1582440fb1ea61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263813.999425:0:17171:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd883e73400/0xce1582440fb1ea61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263813.999437:0:17171:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:17171:1876178898109312:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789263813.999462:0:17171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263813.999483:0:17171:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9856a5540 going to sleep for 11 seconds 00000100:00100000:1.0:1789263813.999528:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898109312 00000100:00100000:1.0:1789263813.999532:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898109312 00000100:00100000:1.0:1789263813.999554:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789263813.999558:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882aac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+9:17171:x1876178898109312:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789263813.999565:0:17185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263813.999577:0:17185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd883f59200/0xce1582440fb1ea68 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1ea61 expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263813.999592:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd883f59200/0xce1582440fb1ea68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1ea61 expref: 10 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263813.999599:0:17185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd883f59200/0xce1582440fb1ea68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1ea61 expref: 10 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263813.999605:0:17185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd883f59200, rc 0) 00000100:00100000:1.0:1789263813.999630:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882aac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+10:17171:x1876178898109312:12345-0@lo:101:mount.lustre.0 Request processed in 72us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263813.999636:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789263813.999725:0:17171:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:17171:1876178898109312:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789263813.999737:0:17171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd883e73400/0xce1582440fb1ea61 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1ea68 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263813.999747:0:17171:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd883e73400/0xce1582440fb1ea61 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1ea68 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263814.000227:0:17171:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:17171:1876178898109440:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1789263814.000256:0:17171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263814.000346:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898109440 00000100:00100000:1.0:1789263814.000351:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898109440 00000100:00100000:0.0:1789263814.000355:0:17171:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9856a5540 going to sleep for 11 seconds 00000100:00100000:1.0:1789263814.000385:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789263814.000405:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882aaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de026c8f-6636-4fc7-8061-42c8092f00f0+10:17171:x1876178898109440:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1789263814.000419:0:17187:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1789263814.000425:0:17187:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1789263814.000508:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882aaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de026c8f-6636-4fc7-8061-42c8092f00f0+10:17171:x1876178898109440:12345-0@lo:256:mount.lustre.0 Request processed in 103us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263814.000518:0:17171:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:17171:1876178898109440:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1789263814.000527:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 10000000:01000000:0.0:1789263814.001027:0:17171:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789263814.001039:0:17171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883e73400/0xce1582440fb1ea61 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1ea68 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263814.001048:0:17171:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd883e73400/0xce1582440fb1ea61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1ea68 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789263814.001061:0:17171:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dd882a35000 from 1 10000000:01000000:0.0:1789263814.001063:0:17171:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789263814.001117:0:17171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883e73600/0xce1582440fb1ea6f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263814.001126:0:17171:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd883e73600/0xce1582440fb1ea6f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263814.001134:0:17171:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd883e73600/0xce1582440fb1ea6f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263814.001147:0:17171:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:17171:1876178898109568:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789263814.001171:0:17171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263814.001197:0:17171:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9856a5540 going to sleep for 11 seconds 00000100:00100000:1.0:1789263814.001245:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898109568 00000100:00100000:1.0:1789263814.001249:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898109568 00000100:00100000:1.0:1789263814.001272:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789263814.001278:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882aaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+10:17171:x1876178898109568:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789263814.001286:0:17185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263814.001296:0:17185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd883f59600/0xce1582440fb1ea76 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1ea6f expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263814.001311:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd883f59600/0xce1582440fb1ea76 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1ea6f expref: 11 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263814.001320:0:17185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd883f59600/0xce1582440fb1ea76 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1ea6f expref: 11 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263814.001328:0:17185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd883f59600, rc 0) 00000100:00100000:1.0:1789263814.001402:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882aaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+11:17171:x1876178898109568:12345-0@lo:101:mount.lustre.0 Request processed in 123us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263814.001408:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789263814.001451:0:17171:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:17171:1876178898109568:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789263814.001461:0:17171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd883e73600/0xce1582440fb1ea6f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1ea76 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263814.001469:0:17171:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd883e73600/0xce1582440fb1ea6f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1ea76 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263814.001510:0:17171:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:17171:1876178898109696:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789263814.001531:0:17171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263814.001575:0:17171:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9856a5540 going to sleep for 11 seconds 00000100:00100000:1.0:1789263814.001604:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898109696 00000100:00100000:1.0:1789263814.001608:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898109696 00000100:00100000:1.0:1789263814.001634:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789263814.001639:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882aaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de026c8f-6636-4fc7-8061-42c8092f00f0+11:17171:x1876178898109696:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789263814.001747:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882aaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de026c8f-6636-4fc7-8061-42c8092f00f0+11:17171:x1876178898109696:12345-0@lo:501:mount.lustre.0 Request processed in 103us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263814.001754:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789263814.001788:0:17171:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:17171:1876178898109696:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789263814.001817:0:17171:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:17171:1876178898109824:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789263814.001865:0:17171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263814.001881:0:17171:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9856a5540 going to sleep for 11 seconds 00000100:00100000:1.0:1789263814.001884:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898109824 00000100:00100000:1.0:1789263814.001896:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898109824 00000100:00100000:1.0:1789263814.001922:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789263814.001928:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882aafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+11:17171:x1876178898109824:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789263814.002002:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882aafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+11:17171:x1876178898109824:12345-0@lo:503:mount.lustre.0 Request processed in 73us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263814.002009:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789263814.002027:0:17171:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:17171:1876178898109824:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789263814.002313:0:17219:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de026c8f-6636-4fc7-8061-42c8092f00f0:17219:1876178898109952:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789263814.002360:0:17219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263814.002383:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898109952 00000100:00100000:0.0:1789263814.002386:0:17219:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9856a5cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789263814.002400:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898109952 00000100:00100000:1.0:1789263814.002436:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789263814.002443:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882aac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de026c8f-6636-4fc7-8061-42c8092f00f0+11:17219:x1876178898109952:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789263814.002876:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882aac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de026c8f-6636-4fc7-8061-42c8092f00f0+11:17219:x1876178898109952:12345-0@lo:502:llog_process_th.0 Request processed in 432us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263814.002883:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789263814.002956:0:17219:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de026c8f-6636-4fc7-8061-42c8092f00f0:17219:1876178898109952:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789263814.002977:0:17219:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789263814.002985:0:17219:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789263814.002987:0:17219:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789263814.002994:0:17219:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dd882a35000 00000020:00000080:0.0:1789263814.002996:0:17219:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789263814.003004:0:17219:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789263814.003007:0:17219:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789263814.003009:0:17219:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789263814.003011:0:17219:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789263814.003014:0:17219:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789263814.003015:0:17219:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789263814.003019:0:17219:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dd882a35000 00000020:00000080:0.0:1789263814.003021:0:17219:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789263814.003172:0:17219:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789263814.003177:0:17219:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789263814.003179:0:17219:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789263814.003182:0:17219:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789263814.003184:0:17219:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789263814.003186:0:17219:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789263814.003189:0:17219:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9dd882a35000 00000020:00000080:0.0:1789263814.003192:0:17219:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789263814.003213:0:17219:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789263814.003216:0:17219:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789263814.003224:0:17219:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789263814.003227:0:17219:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789263814.003231:0:17219:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789263814.003232:0:17219:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789263814.003236:0:17219:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9dd882a35000 00000020:00000080:0.0:1789263814.003238:0:17219:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789263814.003275:0:17219:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de026c8f-6636-4fc7-8061-42c8092f00f0:17219:1876178898110080:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789263814.003311:0:17219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263814.003345:0:17219:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9856a5cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789263814.003354:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898110080 00000100:00100000:1.0:1789263814.003360:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898110080 00000100:00100000:1.0:1789263814.003405:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789263814.003414:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882aae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+11:17219:x1876178898110080:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789263814.003511:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882aae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+11:17219:x1876178898110080:12345-0@lo:502:llog_process_th.0 Request processed in 99us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263814.003518:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789263814.003625:0:17219:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de026c8f-6636-4fc7-8061-42c8092f00f0:17219:1876178898110080:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789263814.003644:0:17219:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789263814.003649:0:17219:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789263814.003651:0:17219:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789263814.003654:0:17219:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1789263814.003737:0:17171:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1789263814.003762:0:17171:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789263814.003778:0:17171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883e73600/0xce1582440fb1ea6f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1ea76 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263814.003787:0:17171:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd883e73600/0xce1582440fb1ea6f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1ea76 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789263814.003849:0:17171:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789263814.003852:0:17171:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9dd882a35000 10000000:01000000:1.0:1789263814.003855:0:17171:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9dd882a35000 10000000:01000000:1.0:1789263814.003860:0:17171:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789263814.003864:0:17171:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9dd882a35000 from 1 10000000:01000000:1.0:1789263814.003867:0:17171:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789263814.003889:0:17171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883f58200/0xce1582440fb1ea7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263814.003897:0:17171:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd883f58200/0xce1582440fb1ea7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263814.003984:0:17171:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd883f58200/0xce1582440fb1ea7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263814.004001:0:17171:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa65500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:17171:1876178898110208:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789263814.004034:0:17171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263814.004054:0:17171:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd8838ea840 going to sleep for 11 seconds 00000100:00100000:0.0:1789263814.004102:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898110208 00000100:00100000:0.0:1789263814.004108:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898110208 00000100:00100000:0.0:1789263814.004141:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789263814.004149:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882aae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de026c8f-6636-4fc7-8061-42c8092f00f0+11:17171:x1876178898110208:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789263814.004158:0:17187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263814.004170:0:17187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd883e72400/0xce1582440fb1ea84 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1ea7d expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263814.004191:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd883e72400/0xce1582440fb1ea84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1ea7d expref: 12 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263814.004202:0:17187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd883e72400/0xce1582440fb1ea84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1ea7d expref: 12 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263814.004210:0:17187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd883e72400, rc 0) 00000100:00100000:0.0:1789263814.004257:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882aae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de026c8f-6636-4fc7-8061-42c8092f00f0+12:17171:x1876178898110208:12345-0@lo:101:mount.lustre.0 Request processed in 109us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263814.004264:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789263814.004269:0:17171:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa65500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:17171:1876178898110208:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789263814.004282:0:17171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd883f58200/0xce1582440fb1ea7d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1ea84 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263814.004288:0:17171:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd883f58200/0xce1582440fb1ea7d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1ea84 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263814.004342:0:17171:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa65500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:17171:1876178898110336:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789263814.004375:0:17171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263814.004423:0:17171:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd8838ea840 going to sleep for 11 seconds 00000100:00100000:2.0:1789263814.004479:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898110336 00000100:00100000:2.0:1789263814.004484:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898110336 00000100:00100000:2.0:1789263814.004517:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789263814.004525:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882aad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+12:17171:x1876178898110336:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789263814.004620:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882aad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+12:17171:x1876178898110336:12345-0@lo:501:mount.lustre.0 Request processed in 97us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263814.004626:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789263814.004673:0:17171:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa65500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:17171:1876178898110336:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789263814.004698:0:17171:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa65500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:17171:1876178898110464:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789263814.004729:0:17171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263814.004747:0:17171:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd8838ea840 going to sleep for 11 seconds 00000100:00100000:0.0:1789263814.004790:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898110464 00000100:00100000:0.0:1789263814.004795:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898110464 00000100:00100000:0.0:1789263814.004820:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789263814.004827:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882aad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de026c8f-6636-4fc7-8061-42c8092f00f0+12:17171:x1876178898110464:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789263814.004938:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882aad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de026c8f-6636-4fc7-8061-42c8092f00f0+12:17171:x1876178898110464:12345-0@lo:503:mount.lustre.0 Request processed in 110us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263814.004946:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789263814.004951:0:17171:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa65500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:17171:1876178898110464:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789263814.006824:0:17221:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de026c8f-6636-4fc7-8061-42c8092f00f0:17221:1876178898110592:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789263814.006899:0:17221:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263814.007461:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898110592 00000100:00100000:2.0:1789263814.007468:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898110592 00000100:00100000:0.0:1789263814.007471:0:17221:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9856a5b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789263814.007512:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789263814.007597:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd990736450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+12:17221:x1876178898110592:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789263814.007716:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd990736450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+12:17221:x1876178898110592:12345-0@lo:502:llog_process_th.0 Request processed in 194us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263814.007724:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789263814.007774:0:17221:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de026c8f-6636-4fc7-8061-42c8092f00f0:17221:1876178898110592:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1789263814.007831:0:17221:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1789263814.007844:0:17221:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9dd9873199b8) 00000020:00000080:2.0:1789263814.007862:0:17221:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:2.0:1789263814.007942:0:17221:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dd882a35000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789263814.007947:0:17221:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dd882a35000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789263814.007954:0:17221:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dd882a35000 4 00010000:00080000:2.0:1789263814.007994:0:17221:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dd9bf99c800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.120@tcp at head 00010000:00010000:2.0:1789263814.012585:0:17221:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:2.0:1789263814.012826:0:17221:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1789263814.012871:0:17221:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789263814.012887:0:17221:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xce1582440fb1ea92 00000100:00080000:2.0:1789263814.012897:0:17221:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789263814.012903:0:17221:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9dd9bf99c800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:2.0:1789263814.012935:0:17221:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd884acf480 x1876178898110720/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789263814.012974:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd884acf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876178898110720:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789263814.013045:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263814.013139:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898110720 00000100:00100000:2.0:1789263814.013146:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898110720 00000100:00100000:2.0:1789263814.013177:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789263814.013184:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd884ace300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3617:x1876178898110720:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789263814.013232:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd884ace300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3617:x1876178898110720:12345-0@lo:38:llog_process_th.0 Request processed in 46us (186us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789263814.013239:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789263814.013271:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789263814.013277:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd9bf99c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789263814.013291:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789263814.013294:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd884acf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876178898110720:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1789263814.013323:0:17221:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789263814.013512:0:17221:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd884acf480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de026c8f-6636-4fc7-8061-42c8092f00f0:17221:1876178898110848:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789263814.013562:0:17221:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263814.013604:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898110848 00000100:00100000:2.0:1789263814.013609:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898110848 00000100:00100000:2.0:1789263814.013646:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789263814.013653:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd990736c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de026c8f-6636-4fc7-8061-42c8092f00f0+12:17221:x1876178898110848:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789263814.013756:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd990736c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de026c8f-6636-4fc7-8061-42c8092f00f0+12:17221:x1876178898110848:12345-0@lo:502:llog_process_th.0 Request processed in 101us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263814.013764:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789263814.013806:0:17221:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9869c3480 going to sleep for 11 seconds 00000100:00100000:2.0:1789263814.013820:0:17221:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd884acf480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de026c8f-6636-4fc7-8061-42c8092f00f0:17221:1876178898110848:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789263814.013854:0:17221:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd884acf480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de026c8f-6636-4fc7-8061-42c8092f00f0:17221:1876178898110976:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789263814.013889:0:17221:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263814.013909:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898110976 00000100:00100000:2.0:1789263814.013913:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898110976 00000100:00100000:2.0:1789263814.013936:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789263814.013942:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd990736050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+12:17221:x1876178898110976:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789263814.014007:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd990736050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+12:17221:x1876178898110976:12345-0@lo:502:llog_process_th.0 Request processed in 64us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263814.014013:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789263814.014043:0:17221:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9869c3480 going to sleep for 11 seconds 00000100:00100000:2.0:1789263814.014056:0:17221:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd884acf480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de026c8f-6636-4fc7-8061-42c8092f00f0:17221:1876178898110976:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789263814.014104:0:17221:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1789263814.014162:0:17171:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1789263814.014184:0:17171:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789263814.014201:0:17171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883f58200/0xce1582440fb1ea7d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1ea84 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263814.014224:0:17171:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd883f58200/0xce1582440fb1ea7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1ea84 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789263814.014272:0:17171:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789263814.014275:0:17171:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789263814.014276:0:17171:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789263814.014277:0:17171:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789263814.014279:0:17171:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789263814.014281:0:17171:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789263814.014282:0:17171:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789263814.014284:0:17171:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789263814.014285:0:17171:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789263814.014287:0:17171:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789263814.014290:0:17171:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1789263814.014292:0:17171:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789263814.014294:0:17171:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789263814.014295:0:17171:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789263814.014296:0:17171:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789263814.014297:0:17171:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789263814.014298:0:17171:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789263814.014299:0:17171:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789263814.014300:0:17171:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789263814.014301:0:17171:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789263814.014303:0:17171:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789263814.014316:0:17171:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789263814.014326:0:17171:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd884acf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:17171:1876178898111104:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789263814.014364:0:17171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263814.014386:0:17171:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9869c3480 going to sleep for 11 seconds 00000100:00100000:2.0:1789263814.014421:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898111104 00000100:00100000:2.0:1789263814.014424:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898111104 00000100:00100000:2.0:1789263814.014453:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789263814.014460:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd990735050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de026c8f-6636-4fc7-8061-42c8092f00f0+12:17171:x1876178898111104:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789263814.014484:0:17187:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789263814.014505:0:17187:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789263814.015924:0:17187:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789263814.015939:0:17187:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1789263814.016002:0:17207:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789263814.016006:0:17207:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789263814.016026:0:17207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dd9bb804400/0xce1582440fb1ea99 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263814.016041:0:17207:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd883f59200/0xce1582440fb1ea68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1ea61 expref: 12 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263814.016049:0:17207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dd9bb804400/0xce1582440fb1ea99 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263814.016110:0:17207:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd883f59200/0xce1582440fb1ea68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce1582440fb1ea61 expref: 12 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263814.016126:0:17207:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dd883f59200/0xce1582440fb1ea68 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce1582440fb1ea61 expref: 12 pid: 17185 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263814.016138:0:17207:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd884acdc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17207:1876178898111232:0@lo:104: 00000100:00100000:2.0:1789263814.016192:0:17207:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263814.016228:0:17207:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9869c3f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789263814.016269:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898111232 00000100:00100000:2.0:1789263814.016274:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898111232 00000100:00100000:2.0:1789263814.016311:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789263814.016318:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd884acf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de026c8f-6636-4fc7-8061-42c8092f00f0+3:17207:x1876178898111232:12345-0@lo:104: 00010000:00010000:2.0:1789263814.016329:0:17175:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff9dd883e73400/0xce1582440fb1ea61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1ea68 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263814.016376:0:17175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789263814.016406:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd884acf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de026c8f-6636-4fc7-8061-42c8092f00f0+3:17207:x1876178898111232:12345-0@lo:104: Request processed in 87us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263814.016413:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1789263814.016438:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789263814.016444:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd883e73400/0xce1582440fb1ea61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1ea68 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263814.016452:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883e73400 already unused, calling callback (ffffffffc12b1c20) 10000000:00010000:2.0:1789263814.016455:0:17181:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd883e73400/0xce1582440fb1ea61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xce1582440fb1ea68 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263814.016463:0:17181:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd883e73400/0xce1582440fb1ea61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xce1582440fb1ea68 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789263814.016472:0:17181:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd883e73400/0xce1582440fb1ea61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xce1582440fb1ea68 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789263814.016478:0:17181:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789263814.016504:0:17181:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff9dd883e73400/0xce1582440fb1ea61 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1ea68 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263814.016511:0:17181:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789263814.016536:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd883e73400/0xce1582440fb1ea61 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1ea68 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263814.016545:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd883e73400/0xce1582440fb1ea61 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1ea68 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263814.016560:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789263814.016563:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789263814.016566:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789263814.016622:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd884acdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:de026c8f-6636-4fc7-8061-42c8092f00f0:3619:1876178898111360:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789263814.016652:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263814.016711:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898111360 00000100:00100000:3.0:1789263814.016716:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898111360 00000100:00100000:2.0:1789263814.016735:0:17207:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd884acdc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17207:1876178898111232:0@lo:104: 00010000:00010000:3.0:1789263814.016737:0:17177:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd883f59200/0xce1582440fb1ea68 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1ea61 expref: 13 pid: 17185 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263814.016754:0:17207:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dd9bb804400/0xce1582440fb1ea99 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263814.016759:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789263814.016768:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd884acfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de026c8f-6636-4fc7-8061-42c8092f00f0+13:3619:x1876178898111360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789263814.016779:0:17177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789263814.016784:0:17177:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd883f59200/0xce1582440fb1ea68 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1ea61 expref: 13 pid: 17185 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263814.016797:0:17177:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd883f59200/0xce1582440fb1ea68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce1582440fb1ea61 expref: 13 pid: 17185 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263814.016810:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd883f59200/0xce1582440fb1ea68 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce1582440fb1ea61 expref: 13 pid: 17185 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263814.016826:0:17177:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dd9bb804400/0xce1582440fb1ea99 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263814.016834:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd9bb804400/0xce1582440fb1ea99 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789263814.016847:0:17177:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000841188s 00010000:00010000:3.0:1789263814.016859:0:17177:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd9bb804400/0xce1582440fb1ea99 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263814.016867:0:17177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd9bb804400/0xce1582440fb1ea99 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263814.016875:0:17177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dd9bb804400/0xce1582440fb1ea99 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263814.016882:0:17177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dd9bb804400/0xce1582440fb1ea99 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263814.016887:0:17177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bb804400 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:3.0:1789263814.016891:0:17177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dd9bb804400/0xce1582440fb1ea99 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263814.016900:0:17177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dd9bb804400/0xce1582440fb1ea99 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263814.016916:0:17177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dd9bb804400/0xce1582440fb1ea99 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263814.016927:0:17177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789263814.016950:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd990735050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de026c8f-6636-4fc7-8061-42c8092f00f0+12:17171:x1876178898111104:12345-0@lo:253:mount.lustre.0 Request processed in 2489us (2584us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263814.016958:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789263814.016972:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd884acfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de026c8f-6636-4fc7-8061-42c8092f00f0+11:3619:x1876178898111360:12345-0@lo:103:ldlm_bl.0 Request processed in 207us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263814.016979:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789263814.017000:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd884acdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:de026c8f-6636-4fc7-8061-42c8092f00f0:3619:1876178898111360:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789263814.017025:0:17207:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dd9bb804400/0xce1582440fb1ea99 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263814.017033:0:17207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dd9bb804400/0xce1582440fb1ea99 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263814.017040:0:17207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd9bb804400/0xce1582440fb1ea99 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263814.017105:0:17171:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd884acf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:17171:1876178898111104:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789263814.017114:0:17171:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789263814.017118:0:17171:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789263814.017120:0:17171:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789263814.017121:0:17171:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789263814.017124:0:17171:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789263814.017125:0:17171:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789263814.017127:0:17171:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789263814.017128:0:17171:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789263814.017130:0:17171:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789263814.017131:0:17171:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789263814.017140:0:17171:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789263814.017163:0:17171:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000020:00080000:2.0:1789263814.024133:0:17171:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1789263814.024346:0:17171:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1789263814.024347:0:17231:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1789263814.024353:0:17231:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:3.0:1789263814.024513:0:17232:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789263814.024527:0:17171:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:2.0:1789263814.024781:0:17232:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:3.0:1789263814.024867:0:17233:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9dd98ff7f100 x1876178898111488/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263814.024879:0:17233:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9872a5900 going to sleep for 0 seconds 00000040:01000000:1.0:1789263814.025367:0:17171:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1789263814.025420:0:17171:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1789263814.030711:0:17171:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1789263814.030809:0:17171:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1789263814.030899:0:17171:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789263814.036910:0:17232:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789263814.036990:0:17232:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:1.0:1789263814.037547:0:17171:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1789263814.038167:0:17171:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1789263814.038217:0:17171:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1789263814.038820:0:17171:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:1.0:1789263814.039453:0:17171:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:1.0:1789263814.041419:0:17171:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1789263814.042808:0:17171:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1789263814.042835:0:17171:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb38e41953988 00100000:10000000:1.0:1789263814.042841:0:17171:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1789263814.043287:0:17171:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789263814.043303:0:17171:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.120@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789263814.043322:0:17171:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=45 00000080:00000004:2.0:1789263814.043335:0:17171:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1789263814.044256:0:17171:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789263814.044471:0:17171:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789263814.893311:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789263815.021794:0:17227:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789263815.021802:0:17227:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789263815.022756:0:17227:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1789263815.022769:0:17227:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789263815.085141:0:17233:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9872a5900 going to sleep for 0 seconds 00000001:02000400:1.0:1789263815.561257:0:17475:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg320-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:3.0:1789263815.597620:0:17189:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789263815.597625:0:17189:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9dd882a35000 from 7 10000000:01000000:3.0:1789263815.597628:0:17189:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789263815.597667:0:17189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd981531c00/0xce1582440fb1eaa0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263815.597676:0:17189:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd981531c00/0xce1582440fb1eaa0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263815.597684:0:17189:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd981531c00/0xce1582440fb1eaa0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263815.597704:0:17189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de026c8f-6636-4fc7-8061-42c8092f00f0:17189:1876178898111616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789263815.597761:0:17189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263815.597802:0:17189:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd882616480 going to sleep for 11 seconds 00000100:00100000:2.0:1789263815.597856:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898111616 00000100:00100000:2.0:1789263815.597864:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898111616 00000100:00100000:2.0:1789263815.597928:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789263815.597941:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd990734c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de026c8f-6636-4fc7-8061-42c8092f00f0+11:17189:x1876178898111616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789263815.597959:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263815.597976:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd9bb805a00/0xce1582440fb1eaa7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1eaa0 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263815.597999:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd9bb805a00/0xce1582440fb1eaa7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1eaa0 expref: 12 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263815.598011:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd9bb805a00/0xce1582440fb1eaa7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1eaa0 expref: 12 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263815.598020:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bb805a00, rc 0) 00000100:00100000:2.0:1789263815.598098:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd990734c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de026c8f-6636-4fc7-8061-42c8092f00f0+12:17189:x1876178898111616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263815.598112:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789263815.598137:0:17189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de026c8f-6636-4fc7-8061-42c8092f00f0:17189:1876178898111616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789263815.598153:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd981531c00/0xce1582440fb1eaa0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1eaa7 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263815.598162:0:17189:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd981531c00/0xce1582440fb1eaa0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1eaa7 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263815.598210:0:17189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de026c8f-6636-4fc7-8061-42c8092f00f0:17189:1876178898111744:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789263815.598249:0:17189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263815.598275:0:17189:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd882616480 going to sleep for 11 seconds 00000100:00100000:2.0:1789263815.598296:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898111744 00000100:00100000:2.0:1789263815.598302:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898111744 00000100:00100000:2.0:1789263815.598339:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789263815.598350:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd990735c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de026c8f-6636-4fc7-8061-42c8092f00f0+12:17189:x1876178898111744:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789263815.598366:0:17187:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789263815.598397:0:17187:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789263815.598400:0:17187:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1789263815.598520:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd990735c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de026c8f-6636-4fc7-8061-42c8092f00f0+12:17189:x1876178898111744:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 172us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263815.598525:0:17189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de026c8f-6636-4fc7-8061-42c8092f00f0:17189:1876178898111744:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789263815.598534:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 10000000:01000000:3.0:1789263815.598568:0:17189:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789263815.598575:0:17189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd981531c00/0xce1582440fb1eaa0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1eaa7 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263815.598583:0:17189:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd981531c00/0xce1582440fb1eaa0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1eaa7 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263815.918192:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789263815.924557:0:17527:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789263815.924711:0:17527:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:3.0:1789263816.045434:0:17227:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789263816.045445:0:17227:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789263816.045468:0:17227:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1789263816.045477:0:17227:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789263816.109179:0:17233:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9872a5900 going to sleep for 0 seconds 00000020:00000004:0.0:1789263816.267999:0:17577:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789263816.268217:0:17577:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789263816.941477:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789263817.133354:0:17233:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9872a5900 going to sleep for 0 seconds 00010000:00010000:2.0:1789263817.965312:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789263818.157145:0:17233:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9872a5900 going to sleep for 0 seconds 00000020:01000004:2.0:1789263818.853960:0:17922:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789263818.853963:0:17922:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1789263818.853964:0:17922:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1789263818.854098:0:17922:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9dd9b7a92000 00000020:01000004:2.0:1789263818.854114:0:17922:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:2.0:1789263818.854127:0:17922:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789263818.854138:0:17922:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9dd98731cd28) 00000020:00000080:2.0:1789263818.854155:0:17922:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1789263818.883329:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1789263818.884004:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:0.0:1789263818.886002:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:0.0:1789263818.886271:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1789263818.886810:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1789263818.887073:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:0.0:1789263818.887508:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1789263818.887768:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1789263818.888000:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1789263818.888193:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:0.0:1789263818.888377:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1789263818.889193:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1789263818.889555:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1789263818.889751:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1789263818.890185:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:0.0:1789263818.890351:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1789263818.890593:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1789263818.891022:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1789263818.891226:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:0.0:1789263818.891465:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1789263818.891739:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:0.0:1789263818.891894:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:0.0:1789263818.892204:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1789263818.892656:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:0.0:1789263818.892928:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1789263818.893188:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1789263818.893379:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1789263818.893521:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:0.0:1789263818.893675:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:0.0:1789263818.893831:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1789263818.894006:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1789263818.894196:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1789263818.894352:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1789263818.894556:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1789263818.894739:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1789263818.894899:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:0.0:1789263818.895070:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:0.0:1789263818.895273:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1789263818.895510:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:0.0:1789263818.895700:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:0.0:1789263818.896333:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1789263818.896565:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1789263818.896820:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1789263818.896973:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1789263818.897348:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1789263818.897515:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00080000:01000000:0.0:1789263818.898029:0:17922:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1789263818.898286:0:17922:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1789263818.898295:0:17922:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789263818.898304:0:17922:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xce1582440fb1eab5 00000020:01000004:0.0:1789263818.898309:0:17922:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1789263818.898329:0:17922:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.120@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789263818.898333:0:17922:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.120@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789263818.898338:0:17922:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1789263818.898381:0:17922:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1789263818.898387:0:17922:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.120@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1789263818.901158:0:17922:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.120@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789263818.901187:0:17922:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.120@tcp, index=0001, flags=0x20001 00000020:01000004:0.0:1789263818.901190:0:17922:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789263818.901191:0:17922:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789263818.901192:0:17922:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789263818.901193:0:17922:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789263818.901194:0:17922:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789263818.901194:0:17922:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789263818.901195:0:17922:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789263818.901196:0:17922:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789263818.901197:0:17922:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789263818.901199:0:17922:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:0.0:1789263818.901200:0:17922:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789263818.901204:0:17922:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789263818.901204:0:17922:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789263818.901205:0:17922:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789263818.901206:0:17922:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789263818.901206:0:17922:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789263818.901207:0:17922:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789263818.901207:0:17922:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789263818.901208:0:17922:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789263818.901233:0:17922:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1789263818.901252:0:17922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:17922:1876178898111872:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789263818.901313:0:17922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263818.901377:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898111872 00000100:00100000:0.0:1789263818.901380:0:17922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd989ac43c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789263818.901385:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898111872 00000100:00100000:2.0:1789263818.901442:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789263818.901452:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd990737c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de026c8f-6636-4fc7-8061-42c8092f00f0+12:17922:x1876178898111872:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789263818.901482:0:17186:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1789263818.901485:0:17186:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:2.0:1789263818.901533:0:17186:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1789263818.901777:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd990737c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de026c8f-6636-4fc7-8061-42c8092f00f0+12:17922:x1876178898111872:12345-0@lo:253:mount.lustre.0 Request processed in 325us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263818.901785:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789263818.901819:0:17922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:17922:1876178898111872:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789263818.901839:0:17922:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1789263818.901842:0:17922:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789263818.901843:0:17922:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789263818.901844:0:17922:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789263818.901845:0:17922:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789263818.901846:0:17922:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789263818.901847:0:17922:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789263818.901848:0:17922:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789263818.901850:0:17922:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789263818.901851:0:17922:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789263818.901867:0:17922:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9dd9b7a92000 from lustre-MDT0001 10000000:01000000:0.0:1789263818.901889:0:17922:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1789263818.901891:0:17922:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1789263818.901897:0:17922:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9dd9bf8f19b8 local copy 00010000:00010000:0.0:1789263818.901907:0:17922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883f59a00/0xce1582440fb1e9b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1e9b9 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263818.901966:0:17922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:17922:1876178898112000:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789263818.901991:0:17922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263818.902009:0:17922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd989ac43c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789263818.902036:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898112000 00000100:00100000:2.0:1789263818.902042:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898112000 00000100:00100000:2.0:1789263818.902069:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789263818.902105:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd990734450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de026c8f-6636-4fc7-8061-42c8092f00f0+12:17922:x1876178898112000:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789263818.902176:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd990734450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de026c8f-6636-4fc7-8061-42c8092f00f0+12:17922:x1876178898112000:12345-0@lo:501:mount.lustre.0 Request processed in 99us (182us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789263818.902184:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789263818.902190:0:17922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:17922:1876178898112000:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789263818.902215:0:17922:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.120@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789263818.902233:0:17922:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.120@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789263818.902240:0:17922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883f59a00/0xce1582440fb1e9b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1e9b9 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263818.902249:0:17922:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd883f59a00/0xce1582440fb1e9b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1e9b9 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789263818.902270:0:17922:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9dd9b7a92000 10000000:01000000:0.0:1789263818.902275:0:17922:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789263818.902279:0:17922:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9dd9bf8f19b8 10000000:01000000:0.0:1789263818.902281:0:17922:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1789263818.902285:0:17922:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9dd9bf8f19b8 from 1 10000000:01000000:0.0:1789263818.902288:0:17922:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789263818.902308:0:17922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883e73a00/0xce1582440fb1eabc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263818.902317:0:17922:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd883e73a00/0xce1582440fb1eabc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263818.902326:0:17922:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd883e73a00/0xce1582440fb1eabc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263818.902339:0:17922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:17922:1876178898112128:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789263818.902379:0:17922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263818.902404:0:17922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd989ac43c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789263818.902428:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898112128 00000100:00100000:2.0:1789263818.902433:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898112128 00000100:00100000:2.0:1789263818.902460:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789263818.902467:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd990736850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de026c8f-6636-4fc7-8061-42c8092f00f0+12:17922:x1876178898112128:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789263818.902476:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263818.902490:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd9bb804a00/0xce1582440fb1eac3 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1eabc expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263818.902509:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd9bb804a00/0xce1582440fb1eac3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1eabc expref: 13 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263818.902518:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd9bb804a00/0xce1582440fb1eac3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1eabc expref: 13 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263818.902524:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bb804a00, rc 0) 00000100:00100000:2.0:1789263818.902549:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd990736850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de026c8f-6636-4fc7-8061-42c8092f00f0+13:17922:x1876178898112128:12345-0@lo:101:mount.lustre.0 Request processed in 84us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263818.902561:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789263818.902580:0:17922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:17922:1876178898112128:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789263818.902600:0:17922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd883e73a00/0xce1582440fb1eabc lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1eac3 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263818.902616:0:17922:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd883e73a00/0xce1582440fb1eabc lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1eac3 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789263818.902632:0:17922:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789263818.902644:0:17922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883e73a00/0xce1582440fb1eabc lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1eac3 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263818.902651:0:17922:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd883e73a00/0xce1582440fb1eabc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1eac3 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789263818.902664:0:17922:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9dd9b7a92000 10000000:01000000:0.0:1789263818.902668:0:17922:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1789263818.902673:0:17922:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9dd9b7a92000 from 1 10000000:01000000:0.0:1789263818.902676:0:17922:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1789263818.902690:0:17922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883e72c00/0xce1582440fb1eaca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263818.902697:0:17922:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd883e72c00/0xce1582440fb1eaca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263818.902704:0:17922:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd883e72c00/0xce1582440fb1eaca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263818.902716:0:17922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:17922:1876178898112256:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789263818.902741:0:17922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263818.902757:0:17922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd989ac43c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789263818.902787:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898112256 00000100:00100000:2.0:1789263818.902792:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898112256 00000100:00100000:2.0:1789263818.902816:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789263818.902821:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd990734850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de026c8f-6636-4fc7-8061-42c8092f00f0+13:17922:x1876178898112256:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789263818.902826:0:17187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263818.902834:0:17187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd9bb804600/0xce1582440fb1ead1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1eaca expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263818.902848:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd9bb804600/0xce1582440fb1ead1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1eaca expref: 14 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263818.902856:0:17187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd9bb804600/0xce1582440fb1ead1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1eaca expref: 14 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263818.902863:0:17187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bb804600, rc 0) 00000100:00100000:2.0:1789263818.902892:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd990734850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de026c8f-6636-4fc7-8061-42c8092f00f0+14:17922:x1876178898112256:12345-0@lo:101:mount.lustre.0 Request processed in 70us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263818.902897:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789263818.902912:0:17922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:17922:1876178898112256:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789263818.902923:0:17922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd883e72c00/0xce1582440fb1eaca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1ead1 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263818.902935:0:17922:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd883e72c00/0xce1582440fb1eaca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1ead1 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789263818.902944:0:17922:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1789263818.902956:0:17922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883e72c00/0xce1582440fb1eaca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1ead1 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263818.902963:0:17922:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd883e72c00/0xce1582440fb1eaca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1ead1 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789263818.902969:0:17922:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1789263818.902973:0:17922:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789263818.902977:0:17922:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9dd9b7a92000 10000000:01000000:0.0:1789263818.902980:0:17922:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1789263818.902983:0:17922:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1789263818.902986:0:17922:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1789263818.902999:0:17922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883e72600/0xce1582440fb1ead8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263818.903005:0:17922:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd883e72600/0xce1582440fb1ead8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263818.903012:0:17922:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd883e72600/0xce1582440fb1ead8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263818.903023:0:17922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:17922:1876178898112384:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789263818.903048:0:17922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263818.903069:0:17922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd989ac43c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789263818.903109:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898112384 00000100:00100000:2.0:1789263818.903113:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898112384 00000100:00100000:2.0:1789263818.903136:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789263818.903140:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd990734050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de026c8f-6636-4fc7-8061-42c8092f00f0+14:17922:x1876178898112384:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789263818.903145:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263818.903151:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd9bb804e00/0xce1582440fb1eadf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1ead8 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263818.903161:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd9bb804e00/0xce1582440fb1eadf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1ead8 expref: 15 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263818.903173:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd9bb804e00/0xce1582440fb1eadf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1ead8 expref: 15 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263818.903178:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bb804e00, rc 0) 00000100:00100000:2.0:1789263818.903207:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd990734050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de026c8f-6636-4fc7-8061-42c8092f00f0+15:17922:x1876178898112384:12345-0@lo:101:mount.lustre.0 Request processed in 65us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263818.903214:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789263818.903238:0:17922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:17922:1876178898112384:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789263818.903250:0:17922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd883e72600/0xce1582440fb1ead8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1eadf expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263818.903258:0:17922:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd883e72600/0xce1582440fb1ead8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1eadf expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789263818.904041:0:17922:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:0.0:1789263818.904555:0:17922:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789263818.907383:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1789263818.907428:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:0.0:1789263818.907442:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:0.0:1789263818.907455:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:0.0:1789263818.907467:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:0.0:1789263818.907483:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:0.0:1789263818.907500:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:0.0:1789263818.907513:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:0.0:1789263818.907526:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:0.0:1789263818.907540:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:0.0:1789263818.907551:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:0.0:1789263818.907563:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:0.0:1789263818.907574:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:0.0:1789263818.907592:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:0.0:1789263818.907606:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:0.0:1789263818.907623:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:0.0:1789263818.907639:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:0.0:1789263818.907651:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:0.0:1789263818.907662:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:0.0:1789263818.907674:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:0.0:1789263818.907685:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:0.0:1789263818.907697:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:0.0:1789263818.907707:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:0.0:1789263818.907743:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:0.0:1789263818.907748:0:17922:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:0.0:1789263818.907837:0:17922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:17922:1876178898112512:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789263818.907891:0:17922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263818.907937:0:17922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd986325f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789263818.907947:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898112512 00000100:00100000:2.0:1789263818.907953:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898112512 00000100:00100000:2.0:1789263818.907990:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789263818.907996:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd990737850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de026c8f-6636-4fc7-8061-42c8092f00f0+15:17922:x1876178898112512:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789263818.908142:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd990737850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de026c8f-6636-4fc7-8061-42c8092f00f0+15:17922:x1876178898112512:12345-0@lo:501:mount.lustre.0 Request processed in 144us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263818.908150:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789263818.908163:0:17922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:17922:1876178898112512:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789263818.908198:0:17922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:17922:1876178898112640:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789263818.908237:0:17922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263818.908265:0:17922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd986325f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789263818.908279:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898112640 00000100:00100000:2.0:1789263818.908282:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898112640 00000100:00100000:2.0:1789263818.908312:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789263818.908319:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd990735850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de026c8f-6636-4fc7-8061-42c8092f00f0+15:17922:x1876178898112640:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789263818.908864:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd990735850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de026c8f-6636-4fc7-8061-42c8092f00f0+15:17922:x1876178898112640:12345-0@lo:503:mount.lustre.0 Request processed in 544us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263818.908871:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789263818.908894:0:17922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:17922:1876178898112640:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789263818.909237:0:17922:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789263818.909297:0:17922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:17922:1876178898112768:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789263818.909331:0:17922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263818.909369:0:17922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd986325f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789263818.909392:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898112768 00000100:00100000:2.0:1789263818.909398:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898112768 00000100:00100000:2.0:1789263818.909430:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789263818.909437:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd990737050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de026c8f-6636-4fc7-8061-42c8092f00f0+15:17922:x1876178898112768:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789263818.909983:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd990737050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de026c8f-6636-4fc7-8061-42c8092f00f0+15:17922:x1876178898112768:12345-0@lo:502:mount.lustre.0 Request processed in 546us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263818.909995:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789263818.910021:0:17922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:17922:1876178898112768:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789263818.910259:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1789263818.910288:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:0.0:1789263818.910304:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:0.0:1789263818.910319:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:0.0:1789263818.910333:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:0.0:1789263818.910347:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:0.0:1789263818.910378:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:0.0:1789263818.910395:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:0.0:1789263818.910409:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:0.0:1789263818.910423:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:0.0:1789263818.910440:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:0.0:1789263818.910455:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:0.0:1789263818.910481:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:0.0:1789263818.910496:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:0.0:1789263818.910510:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:0.0:1789263818.910524:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:0.0:1789263818.910537:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:0.0:1789263818.910552:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:0.0:1789263818.910567:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:0.0:1789263818.910581:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:0.0:1789263818.910596:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:0.0:1789263818.910609:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:0.0:1789263818.910623:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:0.0:1789263818.910637:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:0.0:1789263818.910651:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:0.0:1789263818.910667:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:0.0:1789263818.910682:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:0.0:1789263818.910695:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:0.0:1789263818.910710:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:0.0:1789263818.910725:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:0.0:1789263818.910739:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:0.0:1789263818.910753:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:0.0:1789263818.910767:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:0.0:1789263818.910783:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:0.0:1789263818.910797:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:0.0:1789263818.910810:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:0.0:1789263818.910823:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:0.0:1789263818.910836:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:0.0:1789263818.910849:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:0.0:1789263818.910860:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:0.0:1789263818.910867:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:0.0:1789263818.910875:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:0.0:1789263818.910882:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:0.0:1789263818.910889:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:0.0:1789263818.910912:0:17922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:17922:1876178898112896:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789263818.910945:0:17922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263818.910975:0:17922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd986325f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789263818.911031:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898112896 00000100:00100000:2.0:1789263818.911037:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898112896 00000100:00100000:2.0:1789263818.911113:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789263818.911122:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd990737450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de026c8f-6636-4fc7-8061-42c8092f00f0+15:17922:x1876178898112896:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789263818.911230:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd990737450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de026c8f-6636-4fc7-8061-42c8092f00f0+15:17922:x1876178898112896:12345-0@lo:502:mount.lustre.0 Request processed in 109us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263818.911239:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789263818.911268:0:17922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:17922:1876178898112896:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789263818.911319:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:1.0:1789263818.911329:0:17922:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:1.0:1789263818.911892:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789263818.911908:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789263818.911911:0:17926:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1789263818.911916:0:17926:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1789263818.911919:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789263818.911932:0:17926:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9dd9bf8f4d28) 00000020:00000080:1.0:1789263818.911949:0:17926:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:1.0:1789263818.911954:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1789263818.912019:0:17926:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789263818.912031:0:17926:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xce1582440fb1eaed 00000020:00000080:1.0:1789263818.912308:0:17926:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1789263818.912313:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789263818.912316:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789263818.912317:0:17926:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1789263818.912320:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789263818.912323:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789263818.912324:0:17926:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1789263818.912328:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789263818.912334:0:17926:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9dd9bf8f0000) 00000020:00000080:1.0:1789263818.912345:0:17926:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:1.0:1789263818.912348:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1789263818.912350:0:17926:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1789263818.912352:0:17926:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1789263818.912369:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789263818.912413:0:17926:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dd9b7a92000 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1789263818.912423:0:17926:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9dd9bf8f3370) 00000020:00000080:1.0:1789263818.912430:0:17926:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:1.0:1789263818.912502:0:17926:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1789263818.912508:0:17926:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xce1582440fb1eb02 00000020:00000080:1.0:1789263818.912595:0:17926:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1789263818.912601:0:17926:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1789263818.912605:0:17926:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xce1582440fb1eb09 00080000:01000000:1.0:1789263818.912610:0:17926:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:1.0:1789263818.912613:0:17926:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xce1582440fb1eb10 00010000:00010000:1.0:1789263818.949112:0:17926:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:1.0:1789263818.949476:0:17926:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:1.0:1789263818.949870:0:17926:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1789263818.950603:0:17926:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1789263818.950614:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789263818.950620:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789263818.950623:0:17926:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1789263818.950628:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789263818.950632:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789263818.950634:0:17926:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1789263818.950637:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789263818.950643:0:17926:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.120@tcp to nid 0x20000c0a8cb78 (192.168.203.120@tcp) 00000020:00000080:1.0:1789263818.950673:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789263818.950690:0:17926:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9dd9c1ba99b8) 00000020:00000080:1.0:1789263818.950714:0:17926:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:1.0:1789263818.950722:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789263818.950791:0:17926:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1789263818.950798:0:17926:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:1.0:1789263818.950806:0:17926:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xce1582440fb1eb1e 00010000:00080000:1.0:1789263818.950843:0:17926:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dd988506800@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.120@tcp at head 00010000:00010000:1.0:1789263818.952602:0:17926:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:2.0:1789263818.953608:0:17926:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789263818.953618:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1789263818.953656:0:17926:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789263818.953677:0:17926:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xce1582440fb1eb25 00000100:00080000:2.0:1789263818.953686:0:17926:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789263818.953692:0:17926:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9dd988506800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:2.0:1789263818.953725:0:17926:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd884acf480 x1876178898113024/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789263818.953756:0:17926:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789263818.953805:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000020:01000000:2.0:1789263818.953811:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00080000:1.0:1789263818.953812:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1789263818.953816:0:8:0:(import.c:65:import_set_state_nolock()) ffff9dd882698000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000020:00000080:2.0:1789263818.953818:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263818.953822:0:17926:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000100:00080000:1.0:1789263818.953824:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 256 00000020:01000000:2.0:1789263818.953826:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789263818.953830:0:17926:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000100:00080000:1.0:1789263818.953831:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000020:01000000:2.0:1789263818.953832:0:17926:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789263818.953836:0:17926:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789263818.953838:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000100:00080000:1.0:1789263818.953839:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9dd882698000 using connection 192.168.203.120@tcp/0@lo 00000020:00000080:2.0:1789263818.953841:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263818.953844:0:17926:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789263818.953848:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789263818.953853:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263818.953861:0:17926:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000100:00100000:1.0:1789263818.953863:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd9bfa65500 x1876178898113152/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000080:2.0:1789263818.953867:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00080000:1.0:1789263818.953877:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789263818.953887:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789263818.953890:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789263818.953894:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789263818.953896:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789263818.953900:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789263818.953904:0:8:0:(import.c:65:import_set_state_nolock()) ffff9dd9bf99c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1789263818.953904:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd884acf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1876178898113024:0@lo:38:llog_process_th.0 00000004:01000000:2.0:1789263818.953905:0:17926:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00080000:1.0:1789263818.953914:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9dd9bf99c800 using connection 192.168.203.120@tcp/0@lo 00000020:01000000:2.0:1789263818.953925:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789263818.953930:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000100:00100000:1.0:1789263818.953931:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd9bfa64380 x1876178898113280/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000080:2.0:1789263818.953932:0:17926:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1789263818.953938:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789263818.953942:0:17926:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:2.0:1789263818.953945:0:17926:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789263818.953948:0:17926:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789263818.953950:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789263818.953954:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263818.953956:0:17926:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789263818.953958:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789263818.953961:0:17926:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1789263818.953966:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263818.953968:0:17926:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1789263818.953972:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789263818.953976:0:17926:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.120@tcp to nid 0x20000c0a8cb78 (192.168.203.120@tcp) 00000020:01000000:2.0:1789263818.953998:0:17926:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1789263818.954002:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000100:00100000:0.0:1789263818.954014:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:2.0:1789263818.954015:0:17926:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9dd9b79819b8) 00000020:00000080:2.0:1789263818.954029:0:17926:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1789263818.954035:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00100000:0.0:1789263818.954096:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1876178898113152:0@lo:38:kworker.0 00000004:00080000:2.0:1789263818.954127:0:17926:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00000100:00100000:3.0:1789263818.954132:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898113024 00000100:00100000:0.0:1789263818.954134:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00080000:01000000:2.0:1789263818.954135:0:17926:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000100:00100000:3.0:1789263818.954144:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898113024 00000020:00000080:2.0:1789263818.954144:0:17926:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xce1582440fb1eb33 00000100:00100000:0.0:1789263818.954165:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876178898113280:0@lo:38:kworker.0 00000100:00100000:3.0:1789263818.954173:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898113152 00000100:00100000:3.0:1789263818.954177:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898113152 00010000:00080000:2.0:1789263818.954192:0:17926:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dd9bf999000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.120@tcp at head 00000100:00100000:3.0:1789263818.954198:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789263818.954205:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263818.954211:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883f5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3617:x1876178898113024:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789263818.954234:0:17197:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 261 last 0 00000100:00100000:0.0:1789263818.954272:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898113280 00000100:00100000:0.0:1789263818.954278:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898113280 00000020:00000080:3.0:1789263818.954290:0:17197:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xce1582440fb1eb3a 00000004:00100000:3.0:1789263818.954308:0:17197:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:0.0:1789263818.954312:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000001:00000004:3.0:1789263818.954316:0:17197:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:0.0:1789263818.954322:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883f5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3617:x1876178898113280:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1789263818.954339:0:17193:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 261 last 0 00000020:00000080:0.0:1789263818.954401:0:17193:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xce1582440fb1eb41 00000004:00100000:0.0:1789263818.954411:0:17193:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00010000:00010000:2.0:1789263818.954488:0:17926:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00080000:0.0:1789263818.954609:0:17193:0:(import.c:65:import_set_state_nolock()) ffff9dd985680000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789263818.954675:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883f5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1876178898113280:12345-0@lo:38:kworker.0 Request processed in 354us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263818.954688:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789263818.954724:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9dd9bfa64380 x1876178898113280/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789263828 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789263818.954740:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1789263818.954748:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1789263818.954753:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789263818.954756:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd9bf99c800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789263818.954763:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876178898113280:0@lo:38:kworker.0 00000040:01000000:2.0:1789263818.955212:0:17926:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789263818.955380:0:17926:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:0.0:1789263818.956483:0:17197:0:(import.c:65:import_set_state_nolock()) ffff9dd985680800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789263818.956546:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883f5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3617:x1876178898113024:12345-0@lo:38:llog_process_th.0 Request processed in 2337us (2533us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263818.956555:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789263818.956574:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789263818.956579:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883f5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3617:x1876178898113152:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1789263818.956592:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789263818.956600:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1789263818.956606:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1789263818.956611:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789263818.956614:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd988506800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789263818.956624:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883f5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3617:x1876178898113152:12345-0@lo:38:kworker.0 Request processed in 43us (2491us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789263818.956638:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd884acf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1876178898113024:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789263818.956642:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789263818.956661:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789263818.956674:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd882698000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789263818.956678:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789263818.956682:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1876178898113152:0@lo:38:kworker.0 00000040:00080000:2.0:1789263818.956750:0:17926:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789263818.956793:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898113408:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789263818.956826:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263818.956847:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898113408 00000100:00100000:2.0:1789263818.956854:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898113408 00000100:00100000:2.0:1789263818.956893:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789263818.956901:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883f5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3620:x1876178898113408:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789263818.956948:0:17196:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446289408 avail 1300049920 00000100:00100000:2.0:1789263818.956995:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883f5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3620:x1876178898113408:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263818.957001:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789263818.957031:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898113408:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1789263818.957148:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1789263818.957412:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:1.0:1789263818.957843:0:17931:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789263818.957849:0:17931:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1789263818.958252:0:17926:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789263818.958260:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789263818.958287:0:17926:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789263818.958302:0:17926:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xce1582440fb1eb48 00000100:00080000:1.0:1789263818.958308:0:17926:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789263818.958312:0:17926:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9dd9bf999000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:1.0:1789263818.958332:0:17926:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd9bfa65500 x1876178898113536/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789263818.958378:0:17926:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1789263818.958417:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1876178898113536:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1789263818.958424:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789263818.958430:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:1.0:1789263818.958431:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00080000:2.0:1789263818.958434:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000020:00000080:1.0:1789263818.958436:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789263818.958439:0:17926:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000100:00080000:2.0:1789263818.958440:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:1.0:1789263818.958443:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789263818.958446:0:17926:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:1.0:1789263818.958447:0:17926:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789263818.958449:0:17926:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789263818.958450:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789263818.958452:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789263818.958454:0:17926:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789263818.958456:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789263818.958458:0:17926:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1789263818.958461:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789263818.958463:0:17926:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000400:00000100:0.0:1789263818.958472:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876178898113536 offset 0 length 520: 4 00000020:00000080:1.0:1789263818.958482:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789263818.958488:0:17926:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.120@tcp to nid 0x20000c0a8cb78 (192.168.203.120@tcp) 00000020:01000000:1.0:1789263818.958512:0:17926:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1789263818.958515:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789263818.958527:0:17926:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9dd9c1ba8000) 00000020:00000080:1.0:1789263818.958539:0:17926:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:1.0:1789263818.958544:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789263818.958594:0:17926:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1789263818.958601:0:17926:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:1.0:1789263818.958606:0:17926:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xce1582440fb1eb56 00010000:00080000:1.0:1789263818.958650:0:17926:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dd9862e7800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.120@tcp at head 00010000:00010000:1.0:1789263818.958818:0:17926:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1789263818.958908:0:17926:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789263818.958920:0:17926:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1789263818.960573:0:17926:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789263818.960721:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1789263818.960831:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1789263818.961173:0:17933:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789263818.961177:0:17933:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1789263818.961843:0:17926:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789263818.961852:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789263818.961881:0:17926:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789263818.961897:0:17926:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xce1582440fb1eb5d 00000100:00080000:1.0:1789263818.961906:0:17926:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789263818.961911:0:17926:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9dd9862e7800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:1.0:1789263818.961943:0:17926:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd9bfa64380 x1876178898113664/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789263818.961966:0:17926:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1789263818.962005:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1876178898113664:0@lo:8:llog_process_th.0 00000020:01000000:1.0:1789263818.962027:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789263818.962034:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000100:00080000:2.0:1789263818.962035:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000020:00000080:1.0:1789263818.962036:0:17926:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000100:00080000:2.0:1789263818.962043:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:1.0:1789263818.962043:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000100:00080000:2.0:1789263818.962046:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789263818.962050:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:00000080:1.0:1789263818.962055:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789263818.962059:0:17926:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000400:00000100:0.0:1789263818.962063:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876178898113664 offset 0 length 520: 4 00000020:00000080:1.0:1789263818.962066:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789263818.962071:0:17926:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789263818.962073:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789263818.962096:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789263818.962098:0:17926:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789263818.962101:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789263818.962103:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789263818.962104:0:17926:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789263818.962107:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1789263818.962126:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789263818.962128:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789263818.962129:0:17926:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789263818.962132:0:17926:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:0.0:1789263818.962193:0:17922:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:0.0:1789263818.962228:0:17922:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1789263818.962248:0:17922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883e72600/0xce1582440fb1ead8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1eadf expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263818.962261:0:17922:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd883e72600/0xce1582440fb1ead8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1eadf expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789263818.962270:0:17922:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9dd9b7a92000 from 1 10000000:01000000:0.0:1789263818.962273:0:17922:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789263818.962297:0:17922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883e72800/0xce1582440fb1eb64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263818.962305:0:17922:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd883e72800/0xce1582440fb1eb64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263818.962316:0:17922:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd883e72800/0xce1582440fb1eb64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263818.962342:0:17922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:17922:1876178898113792:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789263818.962389:0:17922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263818.962410:0:17922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9863253c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789263818.962445:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898113792 00000100:00100000:2.0:1789263818.962454:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898113792 00000100:00100000:2.0:1789263818.962496:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789263818.962507:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd990735450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de026c8f-6636-4fc7-8061-42c8092f00f0+15:17922:x1876178898113792:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789263818.962520:0:17187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263818.962533:0:17187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd9bb805000/0xce1582440fb1eb6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1eb64 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263818.962568:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd9bb805000/0xce1582440fb1eb6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1eb64 expref: 16 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263818.962579:0:17187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd9bb805000/0xce1582440fb1eb6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1eb64 expref: 16 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263818.962588:0:17187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bb805000, rc 0) 00000100:00100000:2.0:1789263818.962635:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd990735450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de026c8f-6636-4fc7-8061-42c8092f00f0+16:17922:x1876178898113792:12345-0@lo:101:mount.lustre.0 Request processed in 130us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263818.962642:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789263818.962699:0:17922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:17922:1876178898113792:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789263818.962713:0:17922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd883e72800/0xce1582440fb1eb64 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1eb6b expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263818.962723:0:17922:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd883e72800/0xce1582440fb1eb64 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1eb6b expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263818.963261:0:17922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:17922:1876178898113920:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1789263818.963322:0:17922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263818.963352:0:17922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9863253c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789263818.963391:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898113920 00000100:00100000:2.0:1789263818.963397:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898113920 00000100:00100000:2.0:1789263818.963435:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789263818.963442:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd987389050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de026c8f-6636-4fc7-8061-42c8092f00f0+16:17922:x1876178898113920:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1789263818.963465:0:17186:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789263818.963481:0:17186:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789263818.963484:0:17186:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1789263818.963582:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd987389050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de026c8f-6636-4fc7-8061-42c8092f00f0+16:17922:x1876178898113920:12345-0@lo:256:mount.lustre.0 Request processed in 138us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263818.963590:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789263818.963603:0:17922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:17922:1876178898113920:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1789263818.964413:0:17922:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789263818.964431:0:17922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883e72800/0xce1582440fb1eb64 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1eb6b expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263818.964441:0:17922:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd883e72800/0xce1582440fb1eb64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1eb6b expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789263818.964449:0:17922:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dd9b7a92000 from 1 10000000:01000000:0.0:1789263818.964452:0:17922:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789263818.964472:0:17922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883e72200/0xce1582440fb1eb72 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263818.964490:0:17922:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd883e72200/0xce1582440fb1eb72 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263818.964498:0:17922:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd883e72200/0xce1582440fb1eb72 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263818.964512:0:17922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:17922:1876178898114048:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789263818.964542:0:17922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263818.964569:0:17922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9863253c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789263818.964647:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898114048 00000100:00100000:2.0:1789263818.964659:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898114048 00000100:00100000:2.0:1789263818.964733:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789263818.964745:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98738a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de026c8f-6636-4fc7-8061-42c8092f00f0+16:17922:x1876178898114048:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789263818.964762:0:17187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263818.964781:0:17187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd9bb805e00/0xce1582440fb1eb79 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1eb72 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263818.964847:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd9bb805e00/0xce1582440fb1eb79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1eb72 expref: 17 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263818.964860:0:17187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd9bb805e00/0xce1582440fb1eb79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1eb72 expref: 17 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263818.964869:0:17187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bb805e00, rc 0) 00000100:00100000:2.0:1789263818.964938:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98738a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de026c8f-6636-4fc7-8061-42c8092f00f0+17:17922:x1876178898114048:12345-0@lo:101:mount.lustre.0 Request processed in 195us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263818.964955:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789263818.964976:0:17922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:17922:1876178898114048:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789263818.964997:0:17922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd883e72200/0xce1582440fb1eb72 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1eb79 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263818.965008:0:17922:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd883e72200/0xce1582440fb1eb72 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1eb79 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789263818.965134:0:17922:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789263818.965160:0:17922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:17922:1876178898114176:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789263818.965188:0:17922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263818.965212:0:17922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd986325000 going to sleep for 11 seconds 00000100:00100000:2.0:1789263818.965240:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898114176 00000100:00100000:2.0:1789263818.965246:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898114176 00000100:00100000:2.0:1789263818.965280:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789263818.965289:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98738ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de026c8f-6636-4fc7-8061-42c8092f00f0+17:17922:x1876178898114176:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789263818.965390:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98738ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de026c8f-6636-4fc7-8061-42c8092f00f0+17:17922:x1876178898114176:12345-0@lo:501:mount.lustre.0 Request processed in 102us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263818.965399:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789263818.965406:0:17922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:17922:1876178898114176:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789263818.965431:0:17922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:17922:1876178898114304:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789263818.965465:0:17922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263818.965480:0:17922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd986325000 going to sleep for 11 seconds 00000100:00100000:2.0:1789263818.965506:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898114304 00000100:00100000:2.0:1789263818.965511:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898114304 00000100:00100000:2.0:1789263818.965537:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789263818.965545:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98738a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de026c8f-6636-4fc7-8061-42c8092f00f0+17:17922:x1876178898114304:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789263818.965622:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98738a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de026c8f-6636-4fc7-8061-42c8092f00f0+17:17922:x1876178898114304:12345-0@lo:503:mount.lustre.0 Request processed in 77us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263818.965630:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789263818.965635:0:17922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:17922:1876178898114304:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789263818.965919:0:17922:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789263818.965984:0:17922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:17922:1876178898114432:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789263818.966012:0:17922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263818.966031:0:17922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9863253c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789263818.966142:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898114432 00000100:00100000:2.0:1789263818.966147:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898114432 00000100:00100000:2.0:1789263818.966221:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789263818.966230:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd987389450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de026c8f-6636-4fc7-8061-42c8092f00f0+17:17922:x1876178898114432:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789263818.966396:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd987389450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de026c8f-6636-4fc7-8061-42c8092f00f0+17:17922:x1876178898114432:12345-0@lo:502:mount.lustre.0 Request processed in 155us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263818.966400:0:17922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:17922:1876178898114432:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789263818.966408:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000040:00080000:0.0:1789263818.966574:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1789263818.966600:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:0.0:1789263818.966615:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:0.0:1789263818.966628:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:0.0:1789263818.966642:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:0.0:1789263818.966655:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:0.0:1789263818.966669:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:0.0:1789263818.966682:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:0.0:1789263818.966711:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1789263818.966726:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:0.0:1789263818.966740:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:0.0:1789263818.966760:0:17922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:17922:1876178898114560:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789263818.966795:0:17922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263818.966825:0:17922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9863253c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789263818.966917:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898114560 00000100:00100000:2.0:1789263818.966922:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898114560 00000100:00100000:2.0:1789263818.966950:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789263818.966956:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98738b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de026c8f-6636-4fc7-8061-42c8092f00f0+17:17922:x1876178898114560:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789263818.967042:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98738b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de026c8f-6636-4fc7-8061-42c8092f00f0+17:17922:x1876178898114560:12345-0@lo:502:mount.lustre.0 Request processed in 85us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263818.967050:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789263818.967073:0:17922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:17922:1876178898114560:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789263818.967143:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:1.0:1789263818.967153:0:17922:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1789263818.967725:0:17935:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789263818.967734:0:17935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789263818.967737:0:17935:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789263818.967751:0:17935:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dd9b7a92000 00000020:00000080:3.0:1789263818.967754:0:17935:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789263818.967763:0:17935:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789263818.967765:0:17935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789263818.967767:0:17935:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789263818.967769:0:17935:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789263818.967772:0:17935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789263818.967773:0:17935:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789263818.967777:0:17935:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dd9b7a92000 00000020:00000080:3.0:1789263818.967779:0:17935:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789263818.967838:0:17935:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789263818.967841:0:17935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789263818.967842:0:17935:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789263818.967844:0:17935:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789263818.967845:0:17935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789263818.967846:0:17935:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789263818.967848:0:17935:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9dd9b7a92000 00000020:00000080:3.0:1789263818.967849:0:17935:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789263818.967860:0:17935:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789263818.967861:0:17935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789263818.967862:0:17935:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789263818.967864:0:17935:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789263818.967865:0:17935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789263818.967866:0:17935:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789263818.967868:0:17935:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9dd9b7a92000 00000020:00000080:3.0:1789263818.967869:0:17935:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789263818.967883:0:17935:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789263818.967886:0:17935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789263818.967887:0:17935:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789263818.967889:0:17935:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:0.0:1789263818.967950:0:17922:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1789263818.967979:0:17922:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789263818.967995:0:17922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883e72200/0xce1582440fb1eb72 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1eb79 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263818.968010:0:17922:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd883e72200/0xce1582440fb1eb72 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1eb79 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789263818.968048:0:17922:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789263818.968054:0:17922:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9dd9b7a92000 10000000:01000000:0.0:1789263818.968056:0:17922:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9dd9b7a92000 10000000:01000000:0.0:1789263818.968059:0:17922:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789263818.968062:0:17922:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9dd9b7a92000 from 1 10000000:01000000:0.0:1789263818.968064:0:17922:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789263818.968100:0:17922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883e73e00/0xce1582440fb1eb80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263818.968107:0:17922:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd883e73e00/0xce1582440fb1eb80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263818.968117:0:17922:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd883e73e00/0xce1582440fb1eb80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263818.968132:0:17922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:17922:1876178898114688:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789263818.968167:0:17922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263818.968200:0:17922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd986325a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789263818.968224:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898114688 00000100:00100000:2.0:1789263818.968230:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898114688 00000100:00100000:2.0:1789263818.968277:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789263818.968291:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98738b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de026c8f-6636-4fc7-8061-42c8092f00f0+17:17922:x1876178898114688:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789263818.968301:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263818.968314:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd9bb805200/0xce1582440fb1eb87 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1eb80 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263818.968335:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd9bb805200/0xce1582440fb1eb87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1eb80 expref: 18 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263818.968345:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd9bb805200/0xce1582440fb1eb87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1eb80 expref: 18 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263818.968363:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bb805200, rc 0) 00000100:00100000:2.0:1789263818.968406:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98738b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de026c8f-6636-4fc7-8061-42c8092f00f0+18:17922:x1876178898114688:12345-0@lo:101:mount.lustre.0 Request processed in 120us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263818.968428:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789263818.968428:0:17922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:17922:1876178898114688:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789263818.968451:0:17922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd883e73e00/0xce1582440fb1eb80 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1eb87 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263818.968461:0:17922:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd883e73e00/0xce1582440fb1eb80 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1eb87 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789263818.969537:0:17922:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1789263818.969800:0:17922:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789263818.970009:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1789263818.970051:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:0.0:1789263818.970072:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:0.0:1789263818.970123:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:0.0:1789263818.970152:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:0.0:1789263818.970164:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:0.0:1789263818.970174:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:0.0:1789263818.970184:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:0.0:1789263818.970192:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:0.0:1789263818.970201:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:0.0:1789263818.970211:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:0.0:1789263818.970222:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:0.0:1789263818.970230:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:0.0:1789263818.970239:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:0.0:1789263818.970248:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:0.0:1789263818.970257:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:0.0:1789263818.970265:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:0.0:1789263818.970290:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:0.0:1789263818.970300:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:0.0:1789263818.970308:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:0.0:1789263818.970318:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:0.0:1789263818.970341:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:0.0:1789263818.970370:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:0.0:1789263818.970390:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:0.0:1789263818.970412:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:0.0:1789263818.970429:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:0.0:1789263818.970445:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:0.0:1789263818.970464:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:0.0:1789263818.970491:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:0.0:1789263818.970496:0:17922:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1789263818.970556:0:17922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:17922:1876178898114816:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789263818.970607:0:17922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263818.970654:0:17922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9863253c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789263818.970662:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898114816 00000100:00100000:3.0:1789263818.970670:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898114816 00000100:00100000:3.0:1789263818.970716:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789263818.970727:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd987389850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+18:17922:x1876178898114816:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789263818.970854:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd987389850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+18:17922:x1876178898114816:12345-0@lo:501:mount.lustre.0 Request processed in 128us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263818.970864:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789263818.970872:0:17922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:17922:1876178898114816:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789263818.970901:0:17922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:17922:1876178898114944:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789263818.970949:0:17922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263818.970975:0:17922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9863253c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789263818.970992:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898114944 00000100:00100000:3.0:1789263818.970998:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898114944 00000100:00100000:3.0:1789263818.971050:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789263818.971062:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98738b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de026c8f-6636-4fc7-8061-42c8092f00f0+18:17922:x1876178898114944:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789263818.971197:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98738b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de026c8f-6636-4fc7-8061-42c8092f00f0+18:17922:x1876178898114944:12345-0@lo:503:mount.lustre.0 Request processed in 138us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263818.971206:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789263818.971209:0:17922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:17922:1876178898114944:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789263818.971611:0:17922:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789263818.971678:0:17922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:17922:1876178898115072:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789263818.971731:0:17922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263818.971769:0:17922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd986325a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789263818.971809:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898115072 00000100:00100000:3.0:1789263818.971812:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898115072 00000100:00100000:3.0:1789263818.971880:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789263818.971889:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd987388050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+18:17922:x1876178898115072:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789263818.971977:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd987388050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+18:17922:x1876178898115072:12345-0@lo:502:mount.lustre.0 Request processed in 89us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263818.971985:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789263818.972055:0:17922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:17922:1876178898115072:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789263818.972295:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:0.0:1789263818.972327:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:0.0:1789263818.972383:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:0.0:1789263818.972406:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:0.0:1789263818.972433:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:0.0:1789263818.972459:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:0.0:1789263818.972477:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:0.0:1789263818.972497:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:0.0:1789263818.972517:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:0.0:1789263818.972543:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:0.0:1789263818.972563:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:0.0:1789263818.972586:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:0.0:1789263818.972616:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:0.0:1789263818.972637:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:0.0:1789263818.972664:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:0.0:1789263818.972682:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:0.0:1789263818.972708:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:0.0:1789263818.972733:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:0.0:1789263818.972780:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:0.0:1789263818.972816:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:0.0:1789263818.972842:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:0.0:1789263818.972877:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:0.0:1789263818.972902:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:0.0:1789263818.972927:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:0.0:1789263818.972951:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:0.0:1789263818.972976:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:0.0:1789263818.973001:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:0.0:1789263818.973026:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:0.0:1789263818.973054:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:0.0:1789263818.973106:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:0.0:1789263818.973135:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:0.0:1789263818.973159:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:0.0:1789263818.973181:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:0.0:1789263818.973203:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:0.0:1789263818.973243:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:0.0:1789263818.973269:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:0.0:1789263818.973294:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:0.0:1789263818.973312:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:0.0:1789263818.973334:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:0.0:1789263818.973367:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:0.0:1789263818.973396:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:0.0:1789263818.973418:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:0.0:1789263818.973446:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:0.0:1789263818.973467:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:0.0:1789263818.973485:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:0.0:1789263818.973507:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:0.0:1789263818.973533:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:0.0:1789263818.973557:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:0.0:1789263818.973610:0:17922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:17922:1876178898115200:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789263818.973674:0:17922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263818.973714:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898115200 00000100:00100000:0.0:1789263818.973720:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898115200 00000100:00100000:0.0:1789263818.973773:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789263818.973789:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd987388850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de026c8f-6636-4fc7-8061-42c8092f00f0+18:17922:x1876178898115200:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789263818.973890:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd987388850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de026c8f-6636-4fc7-8061-42c8092f00f0+18:17922:x1876178898115200:12345-0@lo:502:mount.lustre.0 Request processed in 103us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263818.973898:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789263818.973961:0:17922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd986325a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789263818.973981:0:17922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:17922:1876178898115200:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789263818.974191:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:0.0:1789263818.974217:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:0.0:1789263818.974246:0:17922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:17922:1876178898115328:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789263818.974290:0:17922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263818.974320:0:17922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd986325a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789263818.974336:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898115328 00000100:00100000:2.0:1789263818.974342:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898115328 00000100:00100000:2.0:1789263818.974388:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789263818.974395:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98738a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+18:17922:x1876178898115328:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789263818.974470:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98738a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+18:17922:x1876178898115328:12345-0@lo:502:mount.lustre.0 Request processed in 75us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263818.974478:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789263818.974485:0:17922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:17922:1876178898115328:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789263818.974530:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:0.0:1789263818.974539:0:17922:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1789263818.975239:0:17939:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1789263818.975251:0:17939:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9dd9c09c3370) 00000020:00000080:0.0:1789263818.975270:0:17939:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1789263818.975382:0:17939:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dd9b7a92000 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1789263818.975385:0:17939:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dd9b7a92000 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1789263818.975387:0:17939:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dd9b7a92000 3 00010000:00080000:0.0:1789263818.975414:0:17939:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dd99f96d000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.120@tcp at head 00010000:00010000:0.0:1789263818.977462:0:17939:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:3.0:1789263818.978349:0:17939:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1789263818.978441:0:17939:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789263818.978456:0:17939:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xce1582440fb1eb95 00000100:00080000:3.0:1789263818.978466:0:17939:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789263818.978472:0:17939:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9dd99f96d000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:3.0:1789263818.978510:0:17939:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd98ff7d880 x1876178898115456/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789263818.978533:0:17939:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789263818.978561:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789263818.978571:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789263818.978575:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789263818.978578:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789263818.978704:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3617:1876178898115456:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789263818.978775:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263818.978861:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898115456 00000100:00100000:3.0:1789263818.978867:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898115456 00000100:00100000:3.0:1789263818.978907:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789263818.978917:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3617:x1876178898115456:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789263818.978940:0:17192:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 261 last 0 00000020:00000080:3.0:1789263818.979001:0:17192:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xce1582440fb1eb9c 00000004:00100000:3.0:1789263818.979024:0:17192:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789263818.979058:0:17192:0:(import.c:65:import_set_state_nolock()) ffff9dd99156e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789263818.979158:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1876178898115456:12345-0@lo:38:llog_process_th.0 Request processed in 241us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263818.979166:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789263818.979212:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9dd98ff7d880 x1876178898115456/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789263828 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263818.979223:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789263818.979232:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1789263818.979238:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1789263818.979243:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789263818.979245:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd99f96d000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789263818.979251:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3617:1876178898115456:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1789263818.979397:0:17939:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:3.0:1789263818.979687:0:17922:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1789263818.979718:0:17922:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789263818.979735:0:17922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883e73e00/0xce1582440fb1eb80 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1eb87 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263818.979745:0:17922:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd883e73e00/0xce1582440fb1eb80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1eb87 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789263818.979789:0:17922:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789263818.979792:0:17922:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789263818.979793:0:17922:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789263818.979795:0:17922:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789263818.979796:0:17922:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789263818.979797:0:17922:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789263818.979798:0:17922:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789263818.979800:0:17922:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789263818.979802:0:17922:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789263818.979805:0:17922:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:3.0:1789263818.979808:0:17922:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789263818.979809:0:17922:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789263818.979810:0:17922:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789263818.979812:0:17922:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789263818.979813:0:17922:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789263818.979814:0:17922:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789263818.979815:0:17922:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789263818.979816:0:17922:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789263818.979817:0:17922:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789263818.979831:0:17922:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1789263818.979843:0:17922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:17922:1876178898115584:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789263818.979913:0:17922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263818.979946:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898115584 00000100:00100000:3.0:1789263818.979948:0:17922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd8826843c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789263818.979953:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898115584 00000100:00100000:0.0:1789263818.979998:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789263818.980008:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd987388450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de026c8f-6636-4fc7-8061-42c8092f00f0+18:17922:x1876178898115584:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789263818.980031:0:17187:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1789263818.980051:0:17187:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:3.0:1789263818.981644:0:17172:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1789263818.981688:0:17187:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789263818.981706:0:17187:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1789263818.981869:0:17207:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789263818.981883:0:17207:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789263818.981906:0:17207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dd981530600/0xce1582440fb1eba3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263818.981923:0:17207:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd9bb805a00/0xce1582440fb1eaa7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1eaa0 expref: 18 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263818.981930:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd987388450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de026c8f-6636-4fc7-8061-42c8092f00f0+18:17922:x1876178898115584:12345-0@lo:253:mount.lustre.0 Request processed in 1917us (2009us total) trans 0 rc 0/0 00010000:00010000:3.0:1789263818.981937:0:17207:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd9bb805000/0xce1582440fb1eb6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1eb64 expref: 18 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263818.981945:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00010000:3.0:1789263818.981954:0:17207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dd981530600/0xce1582440fb1eba3 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263818.981992:0:17207:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd9bb805000/0xce1582440fb1eb6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce1582440fb1eb64 expref: 17 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263818.982010:0:17922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:17922:1876178898115584:0@lo:253:mount.lustre.0 00010000:00010000:3.0:1789263818.982025:0:17207:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dd9bb805000/0xce1582440fb1eb6b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce1582440fb1eb64 expref: 17 pid: 17187 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789263818.982030:0:17922:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1789263818.982035:0:17922:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789263818.982037:0:17922:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789263818.982040:0:17922:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789263818.982042:0:17922:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000100:00100000:3.0:1789263818.982043:0:17207:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7d500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17207:1876178898115712:0@lo:104: 00000020:01000004:0.0:1789263818.982045:0:17922:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789263818.982048:0:17922:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789263818.982051:0:17922:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789263818.982054:0:17922:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789263818.982055:0:17922:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789263818.982067:0:17922:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1789263818.982137:0:17207:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789263818.982200:0:17207:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd9bb805a00/0xce1582440fb1eaa7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce1582440fb1eaa0 expref: 17 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263818.982209:0:17207:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dd9bb805a00/0xce1582440fb1eaa7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce1582440fb1eaa0 expref: 17 pid: 17186 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263818.982220:0:17207:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7ca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17207:1876178898115840:0@lo:104: 00000100:00100000:3.0:1789263818.982253:0:17207:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263818.982275:0:17207:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd882684540 going to sleep for 11 seconds 00000100:00100000:3.0:1789263818.982301:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898115712 00000100:00100000:3.0:1789263818.982313:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898115712 00000100:00100000:3.0:1789263818.982349:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898115840 00000100:00100000:3.0:1789263818.982352:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898115840 00000100:00100000:3.0:1789263818.982393:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789263818.982403:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de026c8f-6636-4fc7-8061-42c8092f00f0+4:17207:x1876178898115712:12345-0@lo:104: 00010000:00010000:3.0:1789263818.982413:0:17175:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff9dd883e72800/0xce1582440fb1eb64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1eb6b expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263818.982507:0:17175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789263818.982514:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de026c8f-6636-4fc7-8061-42c8092f00f0+4:17207:x1876178898115712:12345-0@lo:104: Request processed in 114us (378us total) trans 0 rc 0/0 00010000:00010000:1.0:1789263818.982520:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1789263818.982523:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1789263818.982540:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd883e72800/0xce1582440fb1eb64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1eb6b expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263818.982553:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1789263818.982563:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883e72800 already unused, calling callback (ffffffffc12b1c20) 00000100:00100000:3.0:1789263818.982574:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de026c8f-6636-4fc7-8061-42c8092f00f0+3:17207:x1876178898115840:12345-0@lo:104: 10000000:00010000:1.0:1789263818.982575:0:17180:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd883e72800/0xce1582440fb1eb64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xce1582440fb1eb6b expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263818.982590:0:17175:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff9dd981531c00/0xce1582440fb1eaa0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1eaa7 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263818.982596:0:17180:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd883e72800/0xce1582440fb1eb64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xce1582440fb1eb6b expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789263818.982608:0:17180:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd883e72800/0xce1582440fb1eb64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xce1582440fb1eb6b expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789263818.982632:0:17180:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789263818.982639:0:17175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789263818.982647:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de026c8f-6636-4fc7-8061-42c8092f00f0+3:17207:x1876178898115840:12345-0@lo:104: Request processed in 84us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263818.982656:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1789263818.982683:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263818.982690:0:17180:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff9dd883e72800/0xce1582440fb1eb64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1eb6b expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263818.982696:0:17180:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789263818.982721:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd883e72800/0xce1582440fb1eb64 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1eb6b expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263818.982726:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd883e72800/0xce1582440fb1eb64 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1eb6b expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263818.982742:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263818.982747:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263818.982748:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789263818.982753:0:17207:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7d500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17207:1876178898115712:0@lo:104: 00000100:00100000:1.0:1789263818.982765:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:de026c8f-6636-4fc7-8061-42c8092f00f0:3621:1876178898115968:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789263818.982772:0:17207:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7ca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17207:1876178898115840:0@lo:104: 00010000:00010000:3.0:1789263818.982824:0:17207:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dd981530600/0xce1582440fb1eba3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263818.982837:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263818.982938:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898115968 00000100:00100000:1.0:1789263818.982944:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898115968 00010000:00010000:1.0:1789263818.982976:0:17179:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd9bb805000/0xce1582440fb1eb6b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1eb64 expref: 18 pid: 17187 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263818.983014:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789263818.983025:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa64700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de026c8f-6636-4fc7-8061-42c8092f00f0+18:3621:x1876178898115968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789263818.983040:0:17179:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789263818.983047:0:17179:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd9bb805000/0xce1582440fb1eb6b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1eb64 expref: 18 pid: 17187 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263818.983107:0:17179:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd9bb805000/0xce1582440fb1eb6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce1582440fb1eb64 expref: 18 pid: 17187 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263818.983138:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd9bb805000/0xce1582440fb1eb6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce1582440fb1eb64 expref: 18 pid: 17187 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263818.983158:0:17179:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789263818.983206:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa64700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de026c8f-6636-4fc7-8061-42c8092f00f0+17:3621:x1876178898115968:12345-0@lo:103:ldlm_bl.0 Request processed in 183us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263818.983214:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789263818.983292:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:de026c8f-6636-4fc7-8061-42c8092f00f0:3621:1876178898115968:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789263818.985023:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263818.985037:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd981531c00/0xce1582440fb1eaa0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1eaa7 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263818.985050:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981531c00 already unused, calling callback (ffffffffc12b1c20) 10000000:00010000:1.0:1789263818.985055:0:17181:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd981531c00/0xce1582440fb1eaa0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xce1582440fb1eaa7 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263818.985065:0:17181:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd981531c00/0xce1582440fb1eaa0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xce1582440fb1eaa7 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789263818.985073:0:17181:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd981531c00/0xce1582440fb1eaa0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xce1582440fb1eaa7 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789263818.985117:0:17181:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789263818.985166:0:17181:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff9dd981531c00/0xce1582440fb1eaa0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1eaa7 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263818.985176:0:17181:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789263818.985212:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd981531c00/0xce1582440fb1eaa0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1eaa7 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263818.985237:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd981531c00/0xce1582440fb1eaa0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1eaa7 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263818.985269:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263818.985272:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263818.985275:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789263818.985308:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:de026c8f-6636-4fc7-8061-42c8092f00f0:3618:1876178898116096:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789263818.985400:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263818.985526:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898116096 00000100:00100000:1.0:1789263818.985535:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898116096 00010000:00010000:1.0:1789263818.985564:0:17178:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd9bb805a00/0xce1582440fb1eaa7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1eaa0 expref: 17 pid: 17186 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263818.985611:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789263818.985623:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa66680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:de026c8f-6636-4fc7-8061-42c8092f00f0+17:3618:x1876178898116096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789263818.985637:0:17178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789263818.985643:0:17178:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd9bb805a00/0xce1582440fb1eaa7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1eaa0 expref: 17 pid: 17186 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263818.985674:0:17178:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd9bb805a00/0xce1582440fb1eaa7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce1582440fb1eaa0 expref: 17 pid: 17186 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263818.985692:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd9bb805a00/0xce1582440fb1eaa7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce1582440fb1eaa0 expref: 17 pid: 17186 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263818.985710:0:17178:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dd981530600/0xce1582440fb1eba3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263818.985732:0:17178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd981530600/0xce1582440fb1eba3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789263818.985753:0:17178:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003869632s 00010000:00010000:1.0:1789263818.985758:0:17178:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd981530600/0xce1582440fb1eba3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263818.985767:0:17178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd981530600/0xce1582440fb1eba3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263818.985775:0:17178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dd981530600/0xce1582440fb1eba3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263818.985783:0:17178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dd981530600/0xce1582440fb1eba3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263818.985790:0:17178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981530600 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263818.985796:0:17178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dd981530600/0xce1582440fb1eba3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263818.985805:0:17178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dd981530600/0xce1582440fb1eba3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263818.985828:0:17178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dd981530600/0xce1582440fb1eba3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263818.985846:0:17178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789263818.985908:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa66680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:de026c8f-6636-4fc7-8061-42c8092f00f0+16:3618:x1876178898116096:12345-0@lo:103:ldlm_bl.0 Request processed in 286us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263818.985918:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789263818.985970:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:de026c8f-6636-4fc7-8061-42c8092f00f0:3618:1876178898116096:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789263818.985976:0:17207:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dd981530600/0xce1582440fb1eba3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263818.985988:0:17207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dd981530600/0xce1582440fb1eba3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263818.985997:0:17207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd981530600/0xce1582440fb1eba3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263818.986024:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263818.986026:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1789263818.986457:0:17922:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:1.0:1789263818.986513:0:17946:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1789263818.986518:0:17946:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:1.0:1789263818.986732:0:17947:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789263818.986749:0:17922:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:1.0:1789263818.987111:0:17948:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa66300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17948:1876178898116224:0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1789263818.987116:0:17947:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789263818.987177:0:17948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:3.0:1789263818.987179:0:17922:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000100:00100000:1.0:1789263818.987212:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898116224 00000100:00100000:1.0:1789263818.987217:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898116224 00000040:00080000:3.0:1789263818.987246:0:17922:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789263818.987255:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789263818.987262:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17948:x1876178898116224:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789263818.987328:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17948:x1876178898116224:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 68us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263818.987333:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789263818.987349:0:17948:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd882b9a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789263818.987384:0:17948:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa66300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17948:1876178898116224:0@lo:1000:lod0001_rec0000.0 00000040:01000000:1.0:1789263818.987422:0:17948:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1789263818.987462:0:17948:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa66300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17948:1876178898116352:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789263818.987507:0:17948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263818.987537:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898116352 00000100:00100000:1.0:1789263818.987541:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898116352 00000100:00100000:1.0:1789263818.987566:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789263818.987573:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17948:x1876178898116352:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789263818.987672:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17948:x1876178898116352:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 100us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263818.987680:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789263818.987698:0:17948:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd882b9a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789263818.987709:0:17948:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa66300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17948:1876178898116352:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789263818.987747:0:17948:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa66300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17948:1876178898116480:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1789263818.987771:0:17948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263818.987788:0:17948:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd882b9a900 going to sleep for 11 seconds 00000100:00100000:1.0:1789263818.987833:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898116480 00000100:00100000:1.0:1789263818.987837:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898116480 00000100:00100000:1.0:1789263818.987865:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789263818.987872:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17948:x1876178898116480:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1789263818.987907:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17948:x1876178898116480:12345-0@lo:900:lod0001_rec0000.0 Request processed in 36us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263818.987913:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789263818.987941:0:17948:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9dd9bfa66300 x1876178898116480/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789263834 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789263818.987950:0:17948:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa66300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17948:1876178898116480:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1789263818.987994:0:17948:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa66300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17948:1876178898116608:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789263818.988017:0:17948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263818.988030:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898116608 00000100:00100000:1.0:1789263818.988038:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898116608 00000100:00100000:1.0:1789263818.988056:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789263818.988059:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17948:x1876178898116608:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789263818.988133:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17948:x1876178898116608:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 71us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263818.988139:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789263818.988155:0:17948:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd882b9a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789263818.988170:0:17948:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa66300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17948:1876178898116608:0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1789263818.988211:0:17948:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1789263818.999058:0:17922:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1789263818.999177:0:17922:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1789263818.999281:0:17922:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789263819.021394:0:17948:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789263819.021509:0:17948:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 1, retries 0 00000040:00080000:3.0:1789263819.025856:0:17922:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1789263819.026961:0:17947:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789263819.027035:0:17947:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 1, retries 0 00000004:00080000:0.0:1789263819.027041:0:17947:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:0.0:1789263819.027194:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789263819.027352:0:17922:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1789263819.027397:0:17922:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1789263819.027611:0:17922:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1789263819.028329:0:17922:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000001:00000004:0.0:1789263819.029962:0:17922:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1789263819.034107:0:17922:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1789263819.034154:0:17922:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb38e456fb988 00100000:10000000:0.0:1789263819.034163:0:17922:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:3.0:1789263819.034491:0:17922:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789263819.034518:0:17922:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.120@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789263819.034539:0:17922:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1789263819.034559:0:17922:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1789263819.035990:0:17922:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789263819.036455:0:17922:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1789263819.181281:0:17233:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9872a5900 going to sleep for 0 seconds 00010000:00010000:1.0:1789263820.077179:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789263820.077740:0:17950:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789263820.205190:0:17233:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9872a5900 going to sleep for 0 seconds 10000000:01000000:2.0:1789263820.398000:0:17189:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789263820.398006:0:17189:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9dd9b7a92000 from 8 10000000:01000000:2.0:1789263820.398009:0:17189:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789263820.398052:0:17189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9bb804000/0xce1582440fb1ebaa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263820.398063:0:17189:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd9bb804000/0xce1582440fb1ebaa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263820.398074:0:17189:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd9bb804000/0xce1582440fb1ebaa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263820.398123:0:17189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd884acdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de026c8f-6636-4fc7-8061-42c8092f00f0:17189:1876178898116736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789263820.398182:0:17189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263820.398210:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898116736 00000100:00100000:3.0:1789263820.398219:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898116736 00000100:00100000:2.0:1789263820.398226:0:17189:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd8838d1a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789263820.398269:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789263820.398279:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98738bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+16:17189:x1876178898116736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789263820.398292:0:17185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263820.398305:0:17185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd981530c00/0xce1582440fb1ebb1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1ebaa expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263820.398327:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd981530c00/0xce1582440fb1ebb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1ebaa expref: 17 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263820.398338:0:17185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd981530c00/0xce1582440fb1ebb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1ebaa expref: 17 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263820.398359:0:17185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981530c00, rc 0) 00000100:00100000:3.0:1789263820.398402:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98738bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+17:17189:x1876178898116736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263820.398418:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789263820.398450:0:17189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd884acdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de026c8f-6636-4fc7-8061-42c8092f00f0:17189:1876178898116736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789263820.398476:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd9bb804000/0xce1582440fb1ebaa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1ebb1 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263820.398485:0:17189:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd9bb804000/0xce1582440fb1ebaa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1ebb1 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263820.398534:0:17189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd884acdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de026c8f-6636-4fc7-8061-42c8092f00f0:17189:1876178898116864:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789263820.398565:0:17189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263820.398592:0:17189:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd8838d1a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789263820.398605:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898116864 00000100:00100000:3.0:1789263820.398611:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898116864 00000100:00100000:3.0:1789263820.398640:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789263820.398648:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd987389c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de026c8f-6636-4fc7-8061-42c8092f00f0+17:17189:x1876178898116864:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789263820.398672:0:17187:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789263820.398688:0:17187:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789263820.398692:0:17187:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1789263820.398761:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd987389c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de026c8f-6636-4fc7-8061-42c8092f00f0+17:17189:x1876178898116864:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 114us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263820.398768:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789263820.398794:0:17189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd884acdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de026c8f-6636-4fc7-8061-42c8092f00f0:17189:1876178898116864:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789263820.398836:0:17189:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789263820.398843:0:17189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9bb804000/0xce1582440fb1ebaa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1ebb1 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263820.398853:0:17189:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd9bb804000/0xce1582440fb1ebaa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1ebb1 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789263820.398862:0:17189:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789263820.398864:0:17189:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9dd882a35000 from 8 10000000:01000000:3.0:1789263820.398866:0:17189:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789263820.398880:0:17189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd981531e00/0xce1582440fb1ebb8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263820.398887:0:17189:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd981531e00/0xce1582440fb1ebb8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263820.398904:0:17189:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd981531e00/0xce1582440fb1ebb8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263820.398917:0:17189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de026c8f-6636-4fc7-8061-42c8092f00f0:17189:1876178898116992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789263820.398940:0:17189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263820.398958:0:17189:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9b7996e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789263820.398989:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898116992 00000100:00100000:2.0:1789263820.398995:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898116992 00000100:00100000:2.0:1789263820.399024:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789263820.399033:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd987388c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+17:17189:x1876178898116992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789263820.399041:0:17185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263820.399050:0:17185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd9bb804400/0xce1582440fb1ebbf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1ebb8 expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263820.399065:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd9bb804400/0xce1582440fb1ebbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1ebb8 expref: 18 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263820.399073:0:17185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd9bb804400/0xce1582440fb1ebbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1ebb8 expref: 18 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263820.399100:0:17185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bb804400, rc 0) 00000100:00100000:2.0:1789263820.399135:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd987388c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+18:17189:x1876178898116992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263820.399142:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789263820.399296:0:17189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de026c8f-6636-4fc7-8061-42c8092f00f0:17189:1876178898116992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789263820.399309:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd981531e00/0xce1582440fb1ebb8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1ebbf expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263820.399318:0:17189:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd981531e00/0xce1582440fb1ebb8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1ebbf expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263820.399369:0:17189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de026c8f-6636-4fc7-8061-42c8092f00f0:17189:1876178898117120:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789263820.399399:0:17189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263820.399423:0:17189:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9b7996e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789263820.399448:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898117120 00000100:00100000:2.0:1789263820.399461:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898117120 00000100:00100000:2.0:1789263820.399490:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789263820.399497:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd987343c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de026c8f-6636-4fc7-8061-42c8092f00f0+18:17189:x1876178898117120:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789263820.399509:0:17186:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789263820.399519:0:17186:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789263820.399522:0:17186:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1789263820.399591:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd987343c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de026c8f-6636-4fc7-8061-42c8092f00f0+18:17189:x1876178898117120:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 93us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263820.399599:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789263820.399642:0:17189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de026c8f-6636-4fc7-8061-42c8092f00f0:17189:1876178898117120:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789263820.399680:0:17189:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789263820.399686:0:17189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd981531e00/0xce1582440fb1ebb8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1ebbf expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263820.399694:0:17189:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd981531e00/0xce1582440fb1ebb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1ebbf expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:02000400:3.0:1789263820.567013:0:18192:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg320-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000020:00000004:3.0:1789263820.933820:0:18244:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789263820.933995:0:18244:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:0.0:1789263821.101697:0:17950:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789263821.101886:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789263821.229218:0:17233:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9872a5900 going to sleep for 0 seconds 00000020:00000004:1.0:1789263821.281168:0:18294:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789263821.281379:0:18294:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000020:00000080:0.0:1789263821.691322:0:18342:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffda5bdc280 20000000:00000080:0.0:1789263821.691356:0:18342:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9dd988e18400 uarg=0000000000000000 20000000:01000000:0.0:1789263821.691417:0:18342:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1789263821.691427:0:18342:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1789263821.691433:0:18342:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1789263821.691821:0:18343:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:3.0:1789263821.691972:0:18342:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789263821.696858:0:18342:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789263821.696888:0:18342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dd981530a00/0xce1582440fb1ebc6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263821.696906:0:18342:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd883f59600/0xce1582440fb1ea76 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1ea6f expref: 17 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263821.696914:0:18342:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd9bb805e00/0xce1582440fb1eb79 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1eb72 expref: 17 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263821.696921:0:18342:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dd981530a00/0xce1582440fb1ebc6 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263821.696962:0:18342:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd9bb805e00/0xce1582440fb1eb79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce1582440fb1eb72 expref: 17 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263821.696990:0:18342:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dd9bb805e00/0xce1582440fb1eb79 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce1582440fb1eb72 expref: 17 pid: 17187 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263821.697004:0:18342:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18342:1876178898117248:0@lo:104: 00000100:00100000:3.0:1789263821.697066:0:18342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789263821.697142:0:18342:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd883f59600/0xce1582440fb1ea76 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce1582440fb1ea6f expref: 17 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263821.697148:0:18342:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dd883f59600/0xce1582440fb1ea76 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce1582440fb1ea6f expref: 17 pid: 17185 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263821.697153:0:18342:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18342:1876178898117376:0@lo:104: 00000100:00100000:3.0:1789263821.697181:0:18342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263821.697197:0:18342:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd985565b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789263821.697436:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898117248 00000100:00100000:2.0:1789263821.697454:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898117248 00000100:00100000:1.0:1789263821.697491:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898117376 00000100:00100000:1.0:1789263821.697501:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898117376 00000100:00100000:2.0:1789263821.697532:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789263821.697548:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de026c8f-6636-4fc7-8061-42c8092f00f0+4:18342:x1876178898117248:12345-0@lo:104: 00010000:00010000:2.0:1789263821.697568:0:17175:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff9dd883e72200/0xce1582440fb1eb72 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1eb79 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263821.697676:0:17175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789263821.697683:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de026c8f-6636-4fc7-8061-42c8092f00f0+4:18342:x1876178898117248:12345-0@lo:104: Request processed in 141us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263821.697691:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789263821.697712:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789263821.697718:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de026c8f-6636-4fc7-8061-42c8092f00f0+3:18342:x1876178898117376:12345-0@lo:104: 00010000:00010000:2.0:1789263821.697727:0:17175:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff9dd883e73600/0xce1582440fb1ea6f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1ea76 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263821.697763:0:18342:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18342:1876178898117248:0@lo:104: 00010000:00010000:2.0:1789263821.697769:0:17175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789263821.697776:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de026c8f-6636-4fc7-8061-42c8092f00f0+3:18342:x1876178898117376:12345-0@lo:104: Request processed in 57us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263821.697780:0:18342:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18342:1876178898117376:0@lo:104: 00000100:00100000:2.0:1789263821.697799:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1789263821.697801:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789263821.697808:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd883e72200/0xce1582440fb1eb72 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1eb79 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263821.697818:0:18342:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dd981530a00/0xce1582440fb1ebc6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263821.697818:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883e72200 already unused, calling callback (ffffffffc12b1c20) 10000000:00010000:1.0:1789263821.697827:0:17181:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd883e72200/0xce1582440fb1eb72 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xce1582440fb1eb79 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263821.697844:0:17181:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd883e72200/0xce1582440fb1eb72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xce1582440fb1eb79 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789263821.697853:0:17181:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd883e72200/0xce1582440fb1eb72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xce1582440fb1eb79 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263821.697858:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789263821.697867:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd883e73600/0xce1582440fb1ea6f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1ea76 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789263821.697870:0:17181:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789263821.697881:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883e73600 already unused, calling callback (ffffffffc12b1c20) 10000000:00010000:0.0:1789263821.697885:0:17180:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd883e73600/0xce1582440fb1ea6f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xce1582440fb1ea76 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263821.697893:0:17180:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd883e73600/0xce1582440fb1ea6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xce1582440fb1ea76 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789263821.697900:0:17180:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd883e73600/0xce1582440fb1ea6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xce1582440fb1ea76 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789263821.697906:0:17180:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789263821.698029:0:17181:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff9dd883e72200/0xce1582440fb1eb72 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1eb79 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263821.698030:0:17180:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff9dd883e73600/0xce1582440fb1ea6f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1ea76 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263821.698046:0:17181:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789263821.698048:0:17180:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789263821.698060:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd883e73600/0xce1582440fb1ea6f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1ea76 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263821.698065:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd883e73600/0xce1582440fb1ea6f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1ea76 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263821.698111:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263821.698114:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263821.698124:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789263821.698135:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:de026c8f-6636-4fc7-8061-42c8092f00f0:3619:1876178898117504:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789263821.698179:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263821.698218:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898117504 00000100:00100000:3.0:1789263821.698223:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898117504 00000100:00100000:2.0:1789263821.698227:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:de026c8f-6636-4fc7-8061-42c8092f00f0:3619:1876178898117632:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789263821.698249:0:17177:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd9bb805e00/0xce1582440fb1eb79 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1eb72 expref: 18 pid: 17187 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263821.698260:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789263821.698289:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd883e72200/0xce1582440fb1eb72 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1eb79 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263821.698296:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd883e72200/0xce1582440fb1eb72 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1eb79 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263821.698316:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263821.698320:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263821.698327:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789263821.698350:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898117632 00000100:00100000:0.0:1789263821.698357:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789263821.698358:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898117632 00000100:00100000:0.0:1789263821.698380:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd884acdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de026c8f-6636-4fc7-8061-42c8092f00f0+19:3619:x1876178898117504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789263821.698396:0:17179:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789263821.698402:0:17177:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd883f59600/0xce1582440fb1ea76 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1ea6f expref: 19 pid: 17185 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263821.698408:0:17179:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd9bb805e00/0xce1582440fb1eb79 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1eb72 expref: 19 pid: 17187 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263821.698444:0:17179:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd9bb805e00/0xce1582440fb1eb79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce1582440fb1eb72 expref: 19 pid: 17187 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263821.698446:0:17177:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1789263821.698458:0:17178:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789263821.698469:0:17177:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1789263821.698481:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1789263821.698483:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd9bb805e00/0xce1582440fb1eb79 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce1582440fb1eb72 expref: 19 pid: 17187 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263821.698496:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd884acca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:de026c8f-6636-4fc7-8061-42c8092f00f0+18:3619:x1876178898117632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789263821.698505:0:17179:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789263821.698513:0:17178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789263821.698522:0:17178:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd883f59600/0xce1582440fb1ea76 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1ea6f expref: 18 pid: 17185 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263821.698544:0:17178:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd883f59600/0xce1582440fb1ea76 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce1582440fb1ea6f expref: 18 pid: 17185 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263821.698560:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd883f59600/0xce1582440fb1ea76 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce1582440fb1ea6f expref: 18 pid: 17185 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263821.698567:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd884acdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de026c8f-6636-4fc7-8061-42c8092f00f0+18:3619:x1876178898117504:12345-0@lo:103:ldlm_bl.0 Request processed in 195us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263821.698590:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1789263821.698597:0:17178:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dd981530a00/0xce1582440fb1ebc6 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263821.698622:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:de026c8f-6636-4fc7-8061-42c8092f00f0:3619:1876178898117504:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789263821.698622:0:17178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd981530a00/0xce1582440fb1ebc6 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263821.698645:0:17178:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd981530a00/0xce1582440fb1ebc6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263821.698654:0:17178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd981530a00/0xce1582440fb1ebc6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263821.698661:0:17178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dd981530a00/0xce1582440fb1ebc6 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263821.698669:0:17178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dd981530a00/0xce1582440fb1ebc6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263821.698676:0:17178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981530a00 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263821.698681:0:17178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dd981530a00/0xce1582440fb1ebc6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263821.698688:0:17178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dd981530a00/0xce1582440fb1ebc6 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263821.698711:0:17178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dd981530a00/0xce1582440fb1ebc6 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263821.698723:0:17178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789263821.698744:0:18342:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dd981530a00/0xce1582440fb1ebc6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263821.698756:0:18342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dd981530a00/0xce1582440fb1ebc6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263821.698763:0:18342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd981530a00/0xce1582440fb1ebc6 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263821.698809:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd884acca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:de026c8f-6636-4fc7-8061-42c8092f00f0+16:3619:x1876178898117632:12345-0@lo:103:ldlm_bl.0 Request processed in 311us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263821.698821:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789263821.698862:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:de026c8f-6636-4fc7-8061-42c8092f00f0:3619:1876178898117632:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789263822.126190:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789263822.253151:0:17233:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9872a5900 going to sleep for 0 seconds 10000000:01000000:3.0:1789263822.381208:0:17189:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789263822.381219:0:17189:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dd9b7a92000 from 13 10000000:01000000:3.0:1789263822.381227:0:17189:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789263822.381285:0:17189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd981530600/0xce1582440fb1ebcd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263822.381298:0:17189:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd981530600/0xce1582440fb1ebcd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263822.381345:0:17189:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd981530600/0xce1582440fb1ebcd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263822.381382:0:17189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de026c8f-6636-4fc7-8061-42c8092f00f0:17189:1876178898117760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789263822.381474:0:17189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263822.381527:0:17189:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd985565000 going to sleep for 11 seconds 00000100:00100000:2.0:1789263822.381600:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898117760 00000100:00100000:2.0:1789263822.381616:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898117760 00000100:00100000:2.0:1789263822.381687:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789263822.381700:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd987342850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+16:17189:x1876178898117760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789263822.381717:0:17185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263822.381739:0:17185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd9bb805e00/0xce1582440fb1ebd4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1ebcd expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263822.381768:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd9bb805e00/0xce1582440fb1ebd4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1ebcd expref: 17 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263822.381780:0:17185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd9bb805e00/0xce1582440fb1ebd4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1ebcd expref: 17 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263822.381809:0:17185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bb805e00, rc 0) 00000100:00100000:2.0:1789263822.381891:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd987342850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+17:17189:x1876178898117760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 194us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263822.381899:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789263822.381919:0:17189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de026c8f-6636-4fc7-8061-42c8092f00f0:17189:1876178898117760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789263822.381938:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd981530600/0xce1582440fb1ebcd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1ebd4 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263822.381950:0:17189:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd981530600/0xce1582440fb1ebcd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1ebd4 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263822.382013:0:17189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de026c8f-6636-4fc7-8061-42c8092f00f0:17189:1876178898117888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789263822.382041:0:17189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263822.382060:0:17189:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd985565000 going to sleep for 11 seconds 00000100:00100000:0.0:1789263822.382101:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898117888 00000100:00100000:0.0:1789263822.382109:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898117888 00000100:00100000:0.0:1789263822.382162:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789263822.382178:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd987340450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de026c8f-6636-4fc7-8061-42c8092f00f0+17:17189:x1876178898117888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789263822.382355:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd987340450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de026c8f-6636-4fc7-8061-42c8092f00f0+17:17189:x1876178898117888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 183us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263822.382363:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789263822.382422:0:17189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de026c8f-6636-4fc7-8061-42c8092f00f0:17189:1876178898117888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789263822.382474:0:17189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de026c8f-6636-4fc7-8061-42c8092f00f0:17189:1876178898118016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789263822.382526:0:17189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263822.382564:0:17189:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd985565000 going to sleep for 11 seconds 00000100:00100000:2.0:1789263822.382571:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898118016 00000100:00100000:2.0:1789263822.382578:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898118016 00000100:00100000:2.0:1789263822.382614:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789263822.382621:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd987341c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+17:17189:x1876178898118016:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789263822.382715:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd987341c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+17:17189:x1876178898118016:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 94us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263822.382725:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789263822.382749:0:17189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de026c8f-6636-4fc7-8061-42c8092f00f0:17189:1876178898118016:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789263822.383593:0:18422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789263822.383716:0:17189:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789263822.383751:0:17189:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789263822.383762:0:17189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd981530600/0xce1582440fb1ebcd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1ebd4 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263822.383782:0:17189:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd981530600/0xce1582440fb1ebcd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1ebd4 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789263822.383794:0:17189:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789263822.383797:0:17189:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dd882a35000 from 13 10000000:01000000:3.0:1789263822.383800:0:17189:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789263822.383830:0:17189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd981531c00/0xce1582440fb1ebdb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263822.383838:0:17189:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd981531c00/0xce1582440fb1ebdb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263822.383848:0:17189:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd981531c00/0xce1582440fb1ebdb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263822.383879:0:17189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de026c8f-6636-4fc7-8061-42c8092f00f0:17189:1876178898118144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789263822.383926:0:17189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263822.383974:0:17189:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd985565000 going to sleep for 11 seconds 00000100:00100000:0.0:1789263822.383984:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898118144 00000100:00100000:0.0:1789263822.383993:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898118144 00000100:00100000:0.0:1789263822.384039:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789263822.384049:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd987342050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de026c8f-6636-4fc7-8061-42c8092f00f0+17:17189:x1876178898118144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789263822.384070:0:17187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263822.384110:0:17187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd883e73600/0xce1582440fb1ebe2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1ebdb expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263822.384140:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd883e73600/0xce1582440fb1ebe2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1ebdb expref: 18 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263822.384155:0:17187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd883e73600/0xce1582440fb1ebe2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1ebdb expref: 18 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263822.384164:0:17187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd883e73600, rc 0) 00000100:00100000:0.0:1789263822.384212:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd987342050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de026c8f-6636-4fc7-8061-42c8092f00f0+18:17189:x1876178898118144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 164us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263822.384219:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789263822.384255:0:17189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de026c8f-6636-4fc7-8061-42c8092f00f0:17189:1876178898118144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789263822.384271:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd981531c00/0xce1582440fb1ebdb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1ebe2 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263822.384280:0:17189:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd981531c00/0xce1582440fb1ebdb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1ebe2 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263822.384422:0:17189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de026c8f-6636-4fc7-8061-42c8092f00f0:17189:1876178898118272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789263822.384450:0:17189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263822.384484:0:17189:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd985565000 going to sleep for 11 seconds 00000100:00100000:2.0:1789263822.384776:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898118272 00000100:00100000:2.0:1789263822.384781:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898118272 00000100:00100000:2.0:1789263822.384817:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789263822.384826:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd987341050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+18:17189:x1876178898118272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789263822.384956:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd987341050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+18:17189:x1876178898118272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 131us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263822.384964:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789263822.385000:0:17189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de026c8f-6636-4fc7-8061-42c8092f00f0:17189:1876178898118272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789263822.385029:0:17189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de026c8f-6636-4fc7-8061-42c8092f00f0:17189:1876178898118400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789263822.385073:0:17189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263822.385121:0:17189:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd985565000 going to sleep for 11 seconds 00000100:00100000:0.0:1789263822.385141:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898118400 00000100:00100000:0.0:1789263822.385147:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898118400 00000100:00100000:0.0:1789263822.385178:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789263822.385186:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd987340050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de026c8f-6636-4fc7-8061-42c8092f00f0+18:17189:x1876178898118400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789263822.385276:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd987340050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de026c8f-6636-4fc7-8061-42c8092f00f0+18:17189:x1876178898118400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 91us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263822.385283:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789263822.385314:0:17189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de026c8f-6636-4fc7-8061-42c8092f00f0:17189:1876178898118400:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789263822.386120:0:18423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789263822.387003:0:17189:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789263822.387027:0:17189:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789263822.387038:0:17189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd981531c00/0xce1582440fb1ebdb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1ebe2 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263822.387051:0:17189:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd981531c00/0xce1582440fb1ebdb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1ebe2 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263823.085235:0:3617:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789263813/real 1789263813] req@ffff9dd9bfa66d80 x1876178898109056/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789263823 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263823.085276:0:3617:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9dd9bfa66d80 x1876178898109056/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789263823 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263823.085297:0:3617:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789263813/real 1789263813] req@ffff9dd884acd180 x1876178898108928/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789263823 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263823.085322:0:3617:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9dd884acd180 x1876178898108928/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789263823 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789263823.085359:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd9bf998000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789263823.085391:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789263823.085396:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1876178898109056:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1789263823.085403:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd9c088f800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789263823.085409:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789263823.085413:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd884acd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1876178898108928:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1789263823.085479:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789263823.085485:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1789263823.085489:0:38:0:(import.c:65:import_set_state_nolock()) ffff9dd882698000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789263823.085506:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9dd882698000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:3.0:1789263823.085532:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd98ff7ca80 x1876178898118656/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789263823.085548:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789263823.085552:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789263823.085554:0:38:0:(import.c:65:import_set_state_nolock()) ffff9dd9c088f800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789263823.085560:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 256 00000100:00080000:3.0:1789263823.085566:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789263823.085570:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9dd9c088f800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:3.0:1789263823.085595:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd98ff7ea00 x1876178898118784/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789263823.085598:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de026c8f-6636-4fc7-8061-42c8092f00f0:3620:1876178898118528:0@lo:400:kworker.0 00000100:00080000:3.0:1789263823.085611:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789263823.085616:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789263823.085619:0:38:0:(import.c:65:import_set_state_nolock()) ffff9dd9bf998000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1789263823.085623:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1876178898118656:0@lo:38:kworker.0 00000100:00080000:3.0:1789263823.085624:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 256 00000100:00080000:3.0:1789263823.085630:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789263823.085635:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9dd9bf998000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:3.0:1789263823.085661:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd98ff7ed80 x1876178898118912/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789263823.085708:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:2.0:1789263823.085709:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789263823.085722:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789263823.085726:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789263823.085730:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789263823.085771:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1876178898119040:0@lo:400:kworker.0 00000100:00100000:2.0:1789263823.085805:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898118528 00000100:00100000:2.0:1789263823.085813:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898118528 00000100:00100000:3.0:1789263823.085850:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263823.085863:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789263823.085877:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd987343850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+18:3620:x1876178898118528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263823.085903:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263823.085914:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898119168:0@lo:400:kworker.0 00000100:00100000:0.0:1789263823.085953:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1876178898118784:0@lo:8:kworker.0 00000100:00100000:2.0:1789263823.085968:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd987343850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+18:3620:x1876178898118528:12345-0@lo:400:kworker.0 Request processed in 93us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263823.085978:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000400:00000100:0.0:1789263823.085987:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876178898118784 offset 0 length 520: 4 00000100:00100000:2.0:1789263823.086000:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789263823.086024:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789263823.086036:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876178898119296:0@lo:400:kworker.0 00000100:00100000:0.0:1789263823.086043:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1876178898118912:0@lo:8:kworker.0 00000100:00100000:2.0:1789263823.086116:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de026c8f-6636-4fc7-8061-42c8092f00f0:3620:1876178898118528:0@lo:400:kworker.0 00000400:00000100:0.0:1789263823.086147:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876178898118912 offset 0 length 520: 4 00000100:00100000:3.0:1789263823.086156:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263823.086194:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898118656 00000100:00100000:2.0:1789263823.086199:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898118656 00000100:00100000:2.0:1789263823.086229:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898119168 00000100:00100000:2.0:1789263823.086233:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898119168 00000100:00100000:3.0:1789263823.086237:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898119040 00000100:00100000:3.0:1789263823.086245:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898119040 00000100:00100000:0.0:1789263823.086247:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898119296 00000100:00100000:0.0:1789263823.086255:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898119296 00000100:00100000:2.0:1789263823.086262:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789263823.086269:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883f5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3617:x1876178898118656:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1789263823.086290:0:17196:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 265 last 0 00000020:00000080:2.0:1789263823.086340:0:17196:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xce1582440fb1ebe9 00000004:00100000:2.0:1789263823.086355:0:17196:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1789263823.086385:0:17196:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:3.0:1789263823.086638:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789263823.086657:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789263823.086663:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1876178898119040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263823.086676:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876178898119296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263823.086736:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1876178898119040:12345-0@lo:400:kworker.0 Request processed in 78us (892us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263823.086745:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789263823.086769:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876178898119296:12345-0@lo:400:kworker.0 Request processed in 95us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263823.086782:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789263823.086785:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dd98ff7e680 x1876178898119040/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263839 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789263823.086807:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1876178898119040:0@lo:400:kworker.0 00010000:00080000:3.0:1789263823.086844:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dd98ff7f480 x1876178898119296/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263839 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263823.086859:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876178898119296:0@lo:400:kworker.0 00000100:00080000:2.0:1789263823.091032:0:17196:0:(import.c:65:import_set_state_nolock()) ffff9dd882b2e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789263823.091200:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883f5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3617:x1876178898118656:12345-0@lo:38:kworker.0 Request processed in 4926us (5298us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263823.091215:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1789263823.091244:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00100000:2.0:1789263823.091257:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1789263823.091263:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00100000:2.0:1789263823.091271:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1876178898119168:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789263823.091283:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1789263823.091289:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd882698000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1789263823.091339:0:3617:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000019b7c627): req@ffff9dd98ff7f100 x1876178898111488/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789263823.091358:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1876178898119168:12345-0@lo:400:kworker.0 Request processed in 89us (5378us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263823.091364:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1876178898118656:0@lo:38:kworker.0 00000100:00100000:2.0:1789263823.091375:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789263823.091448:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898119168:0@lo:400:kworker.0 00000100:00100000:0.0:1789263823.091509:0:17233:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263823.091511:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789263823.091530:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898119424:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789263823.091550:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898111488 00000100:00100000:0.0:1789263823.091554:0:17233:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9872a5900 going to sleep for 11 seconds 00000100:00100000:2.0:1789263823.091559:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898111488 00000100:00100000:1.0:1789263823.091590:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263823.091607:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898119424 00000100:00100000:2.0:1789263823.091612:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898119424 00000100:00100000:2.0:1789263823.091633:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789263823.091640:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883f5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:17233:x1876178898111488:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1789263823.091653:0:17196:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1789263823.091663:0:17196:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1789263823.091730:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883f5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:17233:x1876178898111488:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 87us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263823.091740:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789263823.091765:0:17233:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7f100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17233:1876178898111488:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1789263823.091766:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789263823.091787:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3621:x1876178898119424:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789263823.091816:0:17197:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000040:01000000:0.0:1789263823.091825:0:17233:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1789263823.091871:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3621:x1876178898119424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263823.091879:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789263823.091897:0:17233:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5d880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17233:1876178898119552:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1789263823.091933:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898119424:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789263823.091957:0:17233:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263823.091990:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898119552 00000100:00100000:1.0:1789263823.091998:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898119552 00000100:00100000:0.0:1789263823.092012:0:17233:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9bb605d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789263823.092049:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789263823.092059:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883f5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17233:x1876178898119552:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789263823.092242:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883f5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17233:x1876178898119552:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 185us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263823.092252:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789263823.092264:0:17233:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5d880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17233:1876178898119552:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1789263823.092368:0:17233:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5d880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17233:1876178898119680:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1789263823.092397:0:17233:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263823.092418:0:17233:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9bb605d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789263823.092539:0:18524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898119680 00000100:00100000:1.0:1789263823.092546:0:18524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898119680 00000100:00100000:1.0:1789263823.092583:0:18524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789263823.092591:0:18524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883f5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17233:x1876178898119680:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789263823.092666:0:18524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883f5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17233:x1876178898119680:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 75us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263823.092674:0:18524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789263823.092704:0:17233:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5d880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17233:1876178898119680:0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1789263823.092753:0:17233:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789263823.094551:0:17233:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789263823.094619:0:17233:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 9, retries 0 00000004:00080000:0.0:1789263823.094624:0:17233:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1789263823.149206:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263824.173265:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789263824.297242:0:18692:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789263824.297246:0:18692:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1789263824.297247:0:18692:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1789263824.297344:0:18692:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9dd9bfa35800 00000020:01000004:3.0:1789263824.297359:0:18692:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1789263824.297372:0:18692:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789263824.297384:0:18692:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9dd88389b370) 00000020:00000080:3.0:1789263824.297399:0:18692:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789263824.327869:0:18692:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1789263824.328822:0:18692:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1789263824.329119:0:18692:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1789263824.329566:0:18692:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1789263824.329791:0:18692:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1789263824.330011:0:18692:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1789263824.330178:0:18692:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:3.0:1789263824.332955:0:18692:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789263824.333205:0:18692:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1789263824.333217:0:18692:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789263824.333234:0:18692:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xce1582440fb1ebf7 00000020:01000004:3.0:1789263824.333241:0:18692:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1789263824.333268:0:18692:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.120@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789263824.333271:0:18692:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.120@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789263824.333278:0:18692:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1789263824.333283:0:18692:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1789263824.333294:0:18692:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9dd883898000) 00000020:00000080:3.0:1789263824.333305:0:18692:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:3.0:1789263824.334488:0:18692:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789263824.334731:0:18692:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1789263824.334739:0:18692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1789263824.335812:0:18692:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1789263824.335821:0:18692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1789263824.336212:0:18692:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1789263824.336220:0:18692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1789263824.337569:0:18692:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789263824.337730:0:18692:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1789263824.337734:0:18692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1789263824.338160:0:18692:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1789263824.338167:0:18692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1789263824.349269:0:18692:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789263824.349515:0:18692:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789263824.349524:0:18692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1789263824.350536:0:18692:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789263824.350547:0:18692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1789263824.351332:0:18692:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789263824.351351:0:18692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1789263824.353229:0:18692:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789263824.353431:0:18692:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1789263824.353437:0:18692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1789263824.354330:0:18692:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1789263824.354339:0:18692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1789263824.378132:0:18692:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789263824.378313:0:18692:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1789263824.378332:0:18692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1789263824.379007:0:18692:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1789263824.379014:0:18692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1789263824.379479:0:18692:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1789263824.379506:0:18692:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1789263824.379511:0:18692:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.120@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1789263824.389752:0:18692:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.120@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789263824.389793:0:18692:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.120@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1789263824.389797:0:18692:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789263824.389799:0:18692:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789263824.389800:0:18692:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789263824.389801:0:18692:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789263824.389803:0:18692:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789263824.389804:0:18692:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789263824.389806:0:18692:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789263824.389808:0:18692:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789263824.389809:0:18692:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789263824.389812:0:18692:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1789263824.389814:0:18692:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789263824.389816:0:18692:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789263824.389817:0:18692:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789263824.389818:0:18692:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789263824.389819:0:18692:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789263824.389820:0:18692:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789263824.389821:0:18692:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789263824.389823:0:18692:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789263824.389824:0:18692:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789263824.389856:0:18692:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789263824.389876:0:18692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa65880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:18692:1876178898119808:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789263824.389942:0:18692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263824.389990:0:18692:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd983852600 going to sleep for 11 seconds 00000100:00100000:0.0:1789263824.390071:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898119808 00000100:00100000:0.0:1789263824.390113:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898119808 00000100:00100000:0.0:1789263824.390167:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789263824.390181:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd987343050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de026c8f-6636-4fc7-8061-42c8092f00f0+18:18692:x1876178898119808:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789263824.390209:0:17187:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789263824.390212:0:17187:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1789263824.390216:0:17187:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1789263824.390568:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd987343050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de026c8f-6636-4fc7-8061-42c8092f00f0+18:18692:x1876178898119808:12345-0@lo:253:mount.lustre.0 Request processed in 387us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263824.390576:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789263824.390784:0:18692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa65880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:18692:1876178898119808:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789263824.390795:0:18692:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1789263824.390797:0:18692:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789263824.390799:0:18692:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789263824.390800:0:18692:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789263824.390801:0:18692:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789263824.390803:0:18692:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789263824.390804:0:18692:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789263824.390805:0:18692:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789263824.390806:0:18692:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789263824.390808:0:18692:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789263824.390824:0:18692:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9dd9bfa35800 from lustre-OST0000 10000000:01000000:1.0:1789263824.390849:0:18692:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1789263824.390857:0:18692:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789263824.390865:0:18692:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9dd9bf8f19b8 local copy 00010000:00010000:1.0:1789263824.390872:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883f59a00/0xce1582440fb1e9b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1e9b9 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263824.390933:0:18692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa65880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:18692:1876178898119936:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789263824.390953:0:18692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263824.390976:0:18692:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9c0be36c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789263824.390998:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898119936 00000100:00100000:2.0:1789263824.391004:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898119936 00000100:00100000:2.0:1789263824.391052:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789263824.391060:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd987341450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de026c8f-6636-4fc7-8061-42c8092f00f0+18:18692:x1876178898119936:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789263824.391167:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd987341450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de026c8f-6636-4fc7-8061-42c8092f00f0+18:18692:x1876178898119936:12345-0@lo:501:mount.lustre.0 Request processed in 107us (210us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789263824.391175:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789263824.391180:0:18692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa65880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:18692:1876178898119936:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789263824.391197:0:18692:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.120@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789263824.391214:0:18692:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.120@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789263824.391221:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883f59a00/0xce1582440fb1e9b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1e9b9 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263824.391229:0:18692:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd883f59a00/0xce1582440fb1e9b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1e9b9 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789263824.391252:0:18692:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9dd9bfa35800 10000000:01000000:1.0:1789263824.391257:0:18692:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789263824.391262:0:18692:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789263824.391264:0:18692:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789263824.391268:0:18692:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1789263824.391271:0:18692:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789263824.391290:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883f59600/0xce1582440fb1ec05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263824.391297:0:18692:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd883f59600/0xce1582440fb1ec05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263824.391312:0:18692:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd883f59600/0xce1582440fb1ec05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263824.391356:0:18692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa65880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:18692:1876178898120064:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789263824.391383:0:18692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263824.391404:0:18692:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9c0be36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789263824.391420:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898120064 00000100:00100000:0.0:1789263824.391425:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898120064 00000100:00100000:0.0:1789263824.391454:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789263824.391460:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd987340850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de026c8f-6636-4fc7-8061-42c8092f00f0+18:18692:x1876178898120064:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789263824.391468:0:17187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263824.391480:0:17187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd883e72a00/0xce1582440fb1ec0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1ec05 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263824.391501:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd883e72a00/0xce1582440fb1ec0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1ec05 expref: 19 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263824.391512:0:17187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd883e72a00/0xce1582440fb1ec0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1ec05 expref: 19 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263824.391521:0:17187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd883e72a00, rc 0) 00000100:00100000:0.0:1789263824.391555:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd987340850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de026c8f-6636-4fc7-8061-42c8092f00f0+19:18692:x1876178898120064:12345-0@lo:101:mount.lustre.0 Request processed in 94us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263824.391562:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789263824.391570:0:18692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa65880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:18692:1876178898120064:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789263824.391583:0:18692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd883f59600/0xce1582440fb1ec05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1ec0c expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263824.391594:0:18692:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd883f59600/0xce1582440fb1ec05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1ec0c expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789263824.392259:0:18692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1789263824.392693:0:18692:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789263824.394476:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1789263824.394511:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1789263824.394522:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1789263824.394532:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1789263824.394543:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1789263824.394553:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1789263824.394570:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1789263824.394575:0:18692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1789263824.394653:0:18692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa65880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:18692:1876178898120192:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789263824.394984:0:18692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263824.395023:0:18692:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd983852600 going to sleep for 11 seconds 00000100:00100000:0.0:1789263824.395149:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898120192 00000100:00100000:0.0:1789263824.395156:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898120192 00000100:00100000:0.0:1789263824.395202:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789263824.395210:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd987343450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+19:18692:x1876178898120192:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789263824.395557:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd987343450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+19:18692:x1876178898120192:12345-0@lo:501:mount.lustre.0 Request processed in 347us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263824.395565:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789263824.395672:0:18692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa65880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:18692:1876178898120192:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789263824.395763:0:18692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa65880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:18692:1876178898120320:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789263824.395795:0:18692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263824.395822:0:18692:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd983852600 going to sleep for 11 seconds 00000100:00100000:2.0:1789263824.395856:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898120320 00000100:00100000:2.0:1789263824.395862:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898120320 00000100:00100000:2.0:1789263824.395891:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789263824.395898:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98fe86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de026c8f-6636-4fc7-8061-42c8092f00f0+19:18692:x1876178898120320:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789263824.396410:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98fe86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de026c8f-6636-4fc7-8061-42c8092f00f0+19:18692:x1876178898120320:12345-0@lo:503:mount.lustre.0 Request processed in 510us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263824.396417:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789263824.396450:0:18692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa65880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:18692:1876178898120320:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789263824.396753:0:18692:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789263824.396803:0:18692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa65880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:18692:1876178898120448:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789263824.396835:0:18692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263824.396863:0:18692:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd983852600 going to sleep for 11 seconds 00000100:00100000:0.0:1789263824.396887:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898120448 00000100:00100000:0.0:1789263824.396893:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898120448 00000100:00100000:0.0:1789263824.396928:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789263824.396935:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98fe87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+19:18692:x1876178898120448:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789263824.398454:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98fe87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+19:18692:x1876178898120448:12345-0@lo:502:mount.lustre.0 Request processed in 1516us (1615us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263824.398464:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789263824.398482:0:18692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa65880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:18692:1876178898120448:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789263824.398769:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1789263824.398794:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1789263824.398823:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1789263824.398836:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1789263824.398865:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1789263824.398939:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1789263824.398955:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1789263824.398967:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1789263824.398978:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1789263824.399012:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1789263824.399032:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1789263824.399057:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1789263824.399242:0:18692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa65880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:18692:1876178898120576:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789263824.399293:0:18692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263824.399375:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898120576 00000100:00100000:1.0:1789263824.399377:0:18692:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd983852600 going to sleep for 11 seconds 00000100:00100000:2.0:1789263824.399383:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898120576 00000100:00100000:2.0:1789263824.399421:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789263824.399429:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98fe87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de026c8f-6636-4fc7-8061-42c8092f00f0+19:18692:x1876178898120576:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789263824.399516:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98fe87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de026c8f-6636-4fc7-8061-42c8092f00f0+19:18692:x1876178898120576:12345-0@lo:502:mount.lustre.0 Request processed in 87us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263824.399524:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789263824.399566:0:18692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa65880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:18692:1876178898120576:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789263824.399627:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1789263824.399663:0:18692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:1.0:1789263824.400378:0:18709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789263824.400386:0:18709:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1789263824.400392:0:18709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789263824.400394:0:18709:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1789263824.400399:0:18709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789263824.400424:0:18709:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9dd9c1bab370) 00000020:00000080:1.0:1789263824.400459:0:18709:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789263824.400466:0:18709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789263824.400569:0:18709:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dd9bfa35800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1789263824.400586:0:18709:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789263824.400592:0:18709:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xce1582440fb1ec1a 00010000:00010000:1.0:1789263824.403983:0:18709:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:1.0:1789263824.404371:0:18709:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:1.0:1789263824.405401:0:18709:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:1.0:1789263824.406418:0:18709:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1789263824.406429:0:18709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789263824.406435:0:18709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789263824.406438:0:18709:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1789263824.406442:0:18709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789263824.406445:0:18709:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:1.0:1789263824.406447:0:18709:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789263824.406449:0:18709:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789263824.406450:0:18709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789263824.406453:0:18709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789263824.406454:0:18709:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789263824.406456:0:18709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789263824.406459:0:18709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789263824.406461:0:18709:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789263824.406464:0:18709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789263824.406466:0:18709:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789263824.406468:0:18709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789263824.406470:0:18709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789263824.406477:0:18709:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789263824.406481:0:18709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789263824.406484:0:18709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789263824.406485:0:18709:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789263824.406488:0:18709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1789263824.406509:0:18709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789263824.406512:0:18709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789263824.406513:0:18709:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789263824.406516:0:18709:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1789263824.406607:0:18692:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1789263824.406646:0:18692:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789263824.406675:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883f59600/0xce1582440fb1ec05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1ec0c expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263824.406687:0:18692:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd883f59600/0xce1582440fb1ec05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1ec0c expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789263824.406695:0:18692:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dd9bfa35800 from 1 10000000:01000000:2.0:1789263824.406698:0:18692:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789263824.406738:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9bb804c00/0xce1582440fb1ec21 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263824.406746:0:18692:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd9bb804c00/0xce1582440fb1ec21 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263824.406757:0:18692:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd9bb804c00/0xce1582440fb1ec21 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263824.406781:0:18692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd884acd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:18692:1876178898120704:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789263824.406852:0:18692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263824.406902:0:18692:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9bb50cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789263824.406972:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898120704 00000100:00100000:1.0:1789263824.406980:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898120704 00000100:00100000:1.0:1789263824.407022:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789263824.407033:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98fe85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+19:18692:x1876178898120704:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789263824.407048:0:17185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263824.407065:0:17185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd883f58000/0xce1582440fb1ec28 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1ec21 expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263824.407125:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd883f58000/0xce1582440fb1ec28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1ec21 expref: 20 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263824.407137:0:17185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd883f58000/0xce1582440fb1ec28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1ec21 expref: 20 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263824.407145:0:17185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd883f58000, rc 0) 00000100:00100000:1.0:1789263824.407184:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98fe85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+20:18692:x1876178898120704:12345-0@lo:101:mount.lustre.0 Request processed in 154us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263824.407191:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789263824.407274:0:18692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd884acd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:18692:1876178898120704:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789263824.407288:0:18692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd9bb804c00/0xce1582440fb1ec21 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1ec28 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263824.407297:0:18692:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd9bb804c00/0xce1582440fb1ec21 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1ec28 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789263824.408306:0:18692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1789263824.408586:0:18692:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789263824.408747:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1789263824.408776:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1789263824.408808:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1789263824.408814:0:18692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1789263824.408872:0:18692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa65880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:18692:1876178898120832:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789263824.408910:0:18692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263824.409027:0:18692:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9bf982240 going to sleep for 11 seconds 00000100:00100000:3.0:1789263824.409069:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898120832 00000100:00100000:3.0:1789263824.409139:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898120832 00000100:00100000:3.0:1789263824.409178:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789263824.409187:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98fe86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de026c8f-6636-4fc7-8061-42c8092f00f0+20:18692:x1876178898120832:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789263824.409294:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98fe86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de026c8f-6636-4fc7-8061-42c8092f00f0+20:18692:x1876178898120832:12345-0@lo:501:mount.lustre.0 Request processed in 108us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263824.409303:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789263824.409338:0:18692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa65880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:18692:1876178898120832:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789263824.409369:0:18692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa65880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:18692:1876178898120960:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789263824.409416:0:18692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263824.409446:0:18692:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9bf982240 going to sleep for 11 seconds 00000100:00100000:0.0:1789263824.409472:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898120960 00000100:00100000:0.0:1789263824.409480:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898120960 00000100:00100000:0.0:1789263824.409514:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789263824.409524:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98fe87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+20:18692:x1876178898120960:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789263824.409614:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98fe87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+20:18692:x1876178898120960:12345-0@lo:503:mount.lustre.0 Request processed in 92us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263824.409621:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789263824.409634:0:18692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa65880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:18692:1876178898120960:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789263824.409909:0:18692:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789263824.409953:0:18692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa65880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:18692:1876178898121088:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789263824.409990:0:18692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263824.410009:0:18692:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd8841cf900 going to sleep for 11 seconds 00000100:00100000:3.0:1789263824.410204:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898121088 00000100:00100000:3.0:1789263824.410210:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898121088 00000100:00100000:3.0:1789263824.410240:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789263824.410248:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882aae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de026c8f-6636-4fc7-8061-42c8092f00f0+20:18692:x1876178898121088:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789263824.410350:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882aae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de026c8f-6636-4fc7-8061-42c8092f00f0+20:18692:x1876178898121088:12345-0@lo:502:mount.lustre.0 Request processed in 102us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263824.410359:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789263824.410375:0:18692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa65880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:18692:1876178898121088:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789263824.410520:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1789263824.410546:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1789263824.410576:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1789263824.410592:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1789263824.410611:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1789263824.410628:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1789263824.410648:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1789263824.410665:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:1.0:1789263824.410684:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1789263824.410700:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:1.0:1789263824.410719:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:1.0:1789263824.410740:0:18692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa65880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:18692:1876178898121216:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789263824.410780:0:18692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263824.410809:0:18692:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9bf982240 going to sleep for 11 seconds 00000100:00100000:0.0:1789263824.410916:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898121216 00000100:00100000:0.0:1789263824.410921:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898121216 00000100:00100000:0.0:1789263824.410950:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789263824.410956:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882aac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+20:18692:x1876178898121216:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789263824.411029:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882aac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+20:18692:x1876178898121216:12345-0@lo:502:mount.lustre.0 Request processed in 73us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263824.411036:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789263824.411057:0:18692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa65880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:18692:1876178898121216:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789263824.411142:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:1.0:1789263824.411150:0:18692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1789263824.411885:0:18713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789263824.411897:0:18713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263824.411899:0:18713:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789263824.411905:0:18713:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dd9bfa35800 00000020:00000080:2.0:1789263824.411908:0:18713:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789263824.411916:0:18713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789263824.411918:0:18713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263824.411919:0:18713:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1789263824.411921:0:18713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789263824.411923:0:18713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263824.411925:0:18713:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789263824.411928:0:18713:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dd9bfa35800 00000020:00000080:2.0:1789263824.411930:0:18713:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789263824.411970:0:18713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789263824.411974:0:18713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263824.411975:0:18713:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1789263824.411978:0:18713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789263824.411980:0:18713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263824.411982:0:18713:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789263824.411985:0:18713:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9dd9bfa35800 00000020:00000080:2.0:1789263824.411987:0:18713:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789263824.412005:0:18713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789263824.412008:0:18713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263824.412009:0:18713:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789263824.412011:0:18713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789263824.412013:0:18713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263824.412014:0:18713:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1789263824.412017:0:18713:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9dd9bfa35800 00000020:00000080:2.0:1789263824.412019:0:18713:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789263824.412039:0:18713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789263824.412042:0:18713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263824.412044:0:18713:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1789263824.412046:0:18713:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:1.0:1789263824.412159:0:18692:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1789263824.412189:0:18692:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789263824.412204:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9bb804c00/0xce1582440fb1ec21 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1ec28 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263824.412215:0:18692:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd9bb804c00/0xce1582440fb1ec21 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1ec28 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789263824.412278:0:18692:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789263824.412281:0:18692:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9dd9bfa35800 10000000:01000000:1.0:1789263824.412284:0:18692:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9dd9bfa35800 10000000:01000000:1.0:1789263824.412289:0:18692:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789263824.412294:0:18692:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9dd9bfa35800 from 1 10000000:01000000:1.0:1789263824.412297:0:18692:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789263824.412338:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883f59e00/0xce1582440fb1ec2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263824.412346:0:18692:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd883f59e00/0xce1582440fb1ec2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263824.412356:0:18692:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd883f59e00/0xce1582440fb1ec2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263824.412373:0:18692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa65880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:18692:1876178898121344:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789263824.412412:0:18692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263824.412443:0:18692:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd8841cf540 going to sleep for 11 seconds 00000100:00100000:3.0:1789263824.412464:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898121344 00000100:00100000:3.0:1789263824.412470:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898121344 00000100:00100000:3.0:1789263824.412505:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789263824.412513:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882aad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de026c8f-6636-4fc7-8061-42c8092f00f0+20:18692:x1876178898121344:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789263824.412522:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263824.412547:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd981530200/0xce1582440fb1ec36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1ec2f expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263824.412568:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd981530200/0xce1582440fb1ec36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1ec2f expref: 21 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263824.412579:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd981530200/0xce1582440fb1ec36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1ec2f expref: 21 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263824.412588:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981530200, rc 0) 00000100:00100000:1.0:1789263824.412710:0:18692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa65880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:18692:1876178898121344:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789263824.412722:0:18692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd883f59e00/0xce1582440fb1ec2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1ec36 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263824.412732:0:18692:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd883f59e00/0xce1582440fb1ec2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1ec36 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263824.412775:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882aad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de026c8f-6636-4fc7-8061-42c8092f00f0+21:18692:x1876178898121344:12345-0@lo:101:mount.lustre.0 Request processed in 262us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263824.412783:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000040:00080000:2.0:1789263824.414907:0:18692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1789263824.415411:0:18692:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789263824.415691:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1789263824.415719:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1789263824.415736:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1789263824.415757:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1789263824.415775:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1789263824.415793:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1789263824.415810:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1789263824.415828:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1789263824.415843:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1789263824.415855:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1789263824.415870:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1789263824.415884:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1789263824.415898:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1789263824.415930:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1789263824.415950:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1789263824.415969:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1789263824.415984:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1789263824.416001:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1789263824.416022:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1789263824.416040:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1789263824.416056:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1789263824.416071:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1789263824.416110:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1789263824.416132:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1789263824.416151:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:2.0:1789263824.416168:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:2.0:1789263824.416183:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:2.0:1789263824.416200:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:2.0:1789263824.416216:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:2.0:1789263824.416250:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:2.0:1789263824.416271:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:2.0:1789263824.416289:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:2.0:1789263824.416311:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:2.0:1789263824.416352:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:2.0:1789263824.416372:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:2.0:1789263824.416390:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:2.0:1789263824.416407:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:2.0:1789263824.416435:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:2.0:1789263824.416443:0:18692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1789263824.416520:0:18692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd884acd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:18692:1876178898121472:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789263824.416576:0:18692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263824.416623:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898121472 00000100:00100000:2.0:1789263824.416623:0:18692:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9bb50c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789263824.416639:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898121472 00000100:00100000:3.0:1789263824.416679:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789263824.416688:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882aadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+21:18692:x1876178898121472:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789263824.416797:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882aadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+21:18692:x1876178898121472:12345-0@lo:501:mount.lustre.0 Request processed in 110us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263824.416805:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789263824.416831:0:18692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd884acd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:18692:1876178898121472:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789263824.416868:0:18692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd884acd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:18692:1876178898121600:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789263824.416907:0:18692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263824.417606:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898121600 00000100:00100000:3.0:1789263824.417612:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898121600 00000100:00100000:2.0:1789263824.417629:0:18692:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9bb50c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789263824.417662:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789263824.417672:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882aac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de026c8f-6636-4fc7-8061-42c8092f00f0+21:18692:x1876178898121600:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789263824.417762:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882aac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de026c8f-6636-4fc7-8061-42c8092f00f0+21:18692:x1876178898121600:12345-0@lo:503:mount.lustre.0 Request processed in 93us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263824.417770:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789263824.417820:0:18692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd884acd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:18692:1876178898121600:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789263824.418218:0:18692:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789263824.418280:0:18692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd884acd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:18692:1876178898121728:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789263824.418334:0:18692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263824.418362:0:18692:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9bb50c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789263824.418378:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898121728 00000100:00100000:1.0:1789263824.418384:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898121728 00000100:00100000:1.0:1789263824.418418:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789263824.418426:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882aaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de026c8f-6636-4fc7-8061-42c8092f00f0+21:18692:x1876178898121728:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789263824.418526:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882aaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de026c8f-6636-4fc7-8061-42c8092f00f0+21:18692:x1876178898121728:12345-0@lo:502:mount.lustre.0 Request processed in 100us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263824.418535:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789263824.418558:0:18692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd884acd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:18692:1876178898121728:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789263824.418737:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1789263824.418769:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1789263824.418784:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1789263824.418802:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1789263824.418817:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1789263824.418843:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1789263824.418858:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1789263824.418871:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1789263824.418896:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1789263824.418923:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1789263824.418942:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1789263824.418966:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1789263824.418980:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1789263824.418993:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1789263824.419008:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1789263824.419024:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1789263824.419038:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1789263824.419068:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1789263824.419107:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1789263824.419124:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1789263824.419146:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1789263824.419173:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1789263824.419191:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1789263824.419209:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1789263824.419227:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:2.0:1789263824.419246:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:2.0:1789263824.419264:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:2.0:1789263824.419300:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:2.0:1789263824.419329:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:2.0:1789263824.419349:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:2.0:1789263824.419366:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:2.0:1789263824.419385:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:2.0:1789263824.419401:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:2.0:1789263824.419421:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:2.0:1789263824.419436:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:2.0:1789263824.419451:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:2.0:1789263824.419464:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:2.0:1789263824.419486:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:2.0:1789263824.419499:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:2.0:1789263824.419510:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:2.0:1789263824.419521:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:2.0:1789263824.419543:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:2.0:1789263824.419562:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:2.0:1789263824.419579:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:2.0:1789263824.419599:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:2.0:1789263824.419615:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:2.0:1789263824.419632:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:2.0:1789263824.419645:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:2.0:1789263824.419673:0:18692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd884acd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:18692:1876178898121856:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789263824.419718:0:18692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263824.419753:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898121856 00000100:00100000:2.0:1789263824.419758:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898121856 00000100:00100000:2.0:1789263824.419789:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789263824.419797:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882aaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+21:18692:x1876178898121856:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789263824.419877:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882aaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+21:18692:x1876178898121856:12345-0@lo:502:mount.lustre.0 Request processed in 81us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263824.419884:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789263824.419938:0:18692:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9bb50c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789263824.419953:0:18692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd884acd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:18692:1876178898121856:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789263824.420116:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:2.0:1789263824.420142:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:2.0:1789263824.420162:0:18692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd884acd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:18692:1876178898121984:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789263824.420198:0:18692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263824.420222:0:18692:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9bb50c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789263824.420372:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898121984 00000100:00100000:1.0:1789263824.420377:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898121984 00000100:00100000:1.0:1789263824.420410:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789263824.420418:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882aaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de026c8f-6636-4fc7-8061-42c8092f00f0+21:18692:x1876178898121984:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789263824.420503:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882aaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de026c8f-6636-4fc7-8061-42c8092f00f0+21:18692:x1876178898121984:12345-0@lo:502:mount.lustre.0 Request processed in 85us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263824.420513:0:18692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd884acd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:18692:1876178898121984:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789263824.420513:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000040:00080000:2.0:1789263824.420562:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:2.0:1789263824.420571:0:18692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1789263824.421385:0:18718:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1789263824.421399:0:18718:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9dd9c1bacd28) 00000020:00000080:1.0:1789263824.421421:0:18718:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:1.0:1789263824.421530:0:18718:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dd9bfa35800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789263824.421539:0:18718:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dd9bfa35800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789263824.421543:0:18718:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dd9bfa35800 3 00010000:00080000:1.0:1789263824.421579:0:18718:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dd8810d3800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.120@tcp at head 00010000:00010000:1.0:1789263824.423543:0:18718:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:1.0:1789263824.423805:0:18718:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1789263824.423844:0:18718:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789263824.423857:0:18718:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xce1582440fb1ec44 00000100:00080000:1.0:1789263824.423866:0:18718:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789263824.423872:0:18718:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9dd8810d3800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:1.0:1789263824.423904:0:18718:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd9bfa65880 x1876178898122112/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789263824.423960:0:18718:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789263824.424021:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789263824.424031:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789263824.424034:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789263824.424037:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789263824.424068:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789263824.424072:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789263824.424094:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789263824.424098:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789263824.424137:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898122240:0@lo:400:kworker.0 00000100:00100000:3.0:1789263824.424202:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:1.0:1789263824.424223:0:18718:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1789263824.424238:0:18718:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9dd99f9c0000) 00000100:00100000:3.0:1789263824.424242:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789263824.424251:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1876178898122624:0@lo:400:kworker.0 00000020:00000080:1.0:1789263824.424253:0:18718:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000100:00100000:3.0:1789263824.424287:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263824.424295:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3617:1876178898122112:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789263824.424345:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898122496:0@lo:400:kworker.0 00000020:01000004:1.0:1789263824.424348:0:18718:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dd9bfa35800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789263824.424354:0:18718:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dd9bfa35800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789263824.424357:0:18718:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dd9bfa35800 3 00000100:00100000:0.0:1789263824.424363:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263824.424386:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789263824.424406:0:18718:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dd8810d1800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.120@tcp at head 00000100:00100000:3.0:1789263824.424417:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789263824.424425:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1876178898122368:0@lo:400:kworker.0 00000100:00100000:3.0:1789263824.424448:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263824.424482:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898122240 00000100:00100000:3.0:1789263824.424487:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898122240 00000100:00100000:3.0:1789263824.424516:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898122496 00000100:00100000:3.0:1789263824.424517:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898122496 00000100:00100000:3.0:1789263824.424533:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789263824.424538:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3621:x1876178898122240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263824.424583:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3621:x1876178898122240:12345-0@lo:400:kworker.0 Request processed in 45us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263824.424594:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789263824.424612:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789263824.424619:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1876178898122496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263824.424672:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1876178898122496:12345-0@lo:400:kworker.0 Request processed in 54us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263824.424680:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789263824.424703:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898122624 00000100:00100000:3.0:1789263824.424706:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898122624 00000100:00100000:3.0:1789263824.424727:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898122112 00000100:00100000:3.0:1789263824.424730:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898122112 00000100:00100000:3.0:1789263824.424741:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898122368 00000100:00100000:3.0:1789263824.424743:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898122368 00000100:00100000:3.0:1789263824.424763:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789263824.424772:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1876178898122624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263824.424808:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1876178898122624:12345-0@lo:400:kworker.0 Request processed in 38us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263824.424815:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789263824.424825:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789263824.424830:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1876178898122368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263824.424849:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1876178898122368:12345-0@lo:400:kworker.0 Request processed in 21us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263824.424853:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789263824.424860:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789263824.424862:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883f5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3617:x1876178898122112:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789263824.424876:0:17191:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 266 last 0 00000020:00000080:3.0:1789263824.424906:0:17191:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xce1582440fb1ec52 00000004:00100000:3.0:1789263824.424926:0:17191:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789263824.424961:0:17191:0:(import.c:65:import_set_state_nolock()) ffff9dd9c08ee800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789263824.425004:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883f5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1876178898122112:12345-0@lo:38:llog_process_th.0 Request processed in 139us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263824.425011:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789263824.425058:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dd9bfa65880 x1876178898122112/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789263834 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263824.425068:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789263824.425093:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1789263824.425101:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789263824.425105:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789263824.425108:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd8810d3800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789263824.425114:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3617:1876178898122112:0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789263824.425145:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dd98ff7fb80 x1876178898122368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263840 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263824.425154:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1876178898122368:0@lo:400:kworker.0 00000100:00100000:3.0:1789263824.425164:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898122496:0@lo:400:kworker.0 00010000:00080000:3.0:1789263824.425189:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dd98ff7d180 x1876178898122624/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263840 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263824.425197:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1876178898122624:0@lo:400:kworker.0 00000100:00100000:3.0:1789263824.425205:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898122240:0@lo:400:kworker.0 00010000:00010000:1.0:1789263824.426369:0:18718:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:1.0:1789263824.426544:0:18718:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1789263824.426580:0:18718:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789263824.426594:0:18718:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xce1582440fb1ec59 00000100:00080000:1.0:1789263824.426601:0:18718:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789263824.426605:0:18718:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9dd8810d1800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:1.0:1789263824.426630:0:18718:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd9bfa67b80 x1876178898122752/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789263824.426746:0:18718:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1789263824.426779:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3617:1876178898122752:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789263824.426838:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1789263824.427022:0:18718:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:2.0:1789263824.427152:0:18692:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1789263824.427188:0:18692:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789263824.427202:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883f59e00/0xce1582440fb1ec2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1ec36 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263824.427213:0:18692:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd883f59e00/0xce1582440fb1ec2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1ec36 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789263824.427258:0:18692:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789263824.427260:0:18692:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789263824.427262:0:18692:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789263824.427264:0:18692:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789263824.427265:0:18692:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789263824.427267:0:18692:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789263824.427269:0:18692:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789263824.427271:0:18692:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789263824.427273:0:18692:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789263824.427277:0:18692:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1789263824.427279:0:18692:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789263824.427281:0:18692:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789263824.427283:0:18692:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789263824.427284:0:18692:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789263824.427286:0:18692:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789263824.427287:0:18692:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789263824.427288:0:18692:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789263824.427290:0:18692:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789263824.427291:0:18692:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789263824.427306:0:18692:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789263824.427330:0:18692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd884acc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:18692:1876178898122880:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789263824.427369:0:18692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263824.427392:0:18692:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9bb50c300 going to sleep for 11 seconds 00000100:00100000:2.0:1789263824.427412:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898122880 00000100:00100000:2.0:1789263824.427424:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898122880 00000100:00100000:2.0:1789263824.427466:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789263824.427475:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882aafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de026c8f-6636-4fc7-8061-42c8092f00f0+21:18692:x1876178898122880:12345-0@lo:253:mount.lustre.0 00000100:00080000:3.0:1789263824.427490:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789263824.427495:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 20000000:01000000:2.0:1789263824.427496:0:17186:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 00000100:00080000:3.0:1789263824.427504:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789263824.427508:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789263824.427511:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 20000000:01000000:2.0:1789263824.427511:0:17186:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00080000:3.0:1789263824.427517:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789263824.427520:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789263824.427523:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789263824.427545:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898122752 00000100:00100000:3.0:1789263824.427549:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898122752 00000100:00100000:3.0:1789263824.427575:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789263824.427579:0:17192:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789263824.427581:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd884acd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3617:x1876178898122752:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789263824.427587:0:17192:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00010000:00080000:3.0:1789263824.427599:0:17191:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 266 last 0 00000020:00000080:3.0:1789263824.427640:0:17191:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xce1582440fb1ec60 00000004:00100000:3.0:1789263824.427651:0:17191:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789263824.427678:0:17191:0:(import.c:65:import_set_state_nolock()) ffff9dd99f96b800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789263824.427721:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd884acd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1876178898122752:12345-0@lo:38:llog_process_th.0 Request processed in 139us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263824.427730:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1789263824.427767:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dd9bfa67b80 x1876178898122752/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789263834 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263824.427774:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789263824.427779:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1789263824.427784:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789263824.427787:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1789263824.427788:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd8810d1800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789263824.427797:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3617:1876178898122752:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789263824.429251:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789263824.429277:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898123008:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789263824.429336:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263824.429379:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898123008 00000100:00100000:0.0:1789263824.429385:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898123008 00000100:00100000:0.0:1789263824.429423:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789263824.429445:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd884acce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898123008:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789263824.429471:0:17196:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446289408 avail 1300049920 00000100:00100000:0.0:1789263824.429522:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd884acce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898123008:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263824.429527:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789263824.429560:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898123008:0@lo:41:osp-pre-0-1.0 20000000:01000000:2.0:1789263824.430023:0:17186:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789263824.430034:0:17186:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1789263824.430045:0:17207:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789263824.430051:0:17207:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789263824.430069:0:17207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dd981531000/0xce1582440fb1ec67 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263824.430215:0:17207:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd981530c00/0xce1582440fb1ebb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1ebaa expref: 21 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263824.430223:0:17207:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd9bb804400/0xce1582440fb1ebbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1ebb8 expref: 21 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263824.430231:0:17207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dd981531000/0xce1582440fb1ec67 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263824.430259:0:17207:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd9bb804400/0xce1582440fb1ebbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce1582440fb1ebb8 expref: 21 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263824.430285:0:17207:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dd9bb804400/0xce1582440fb1ebbf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce1582440fb1ebb8 expref: 21 pid: 17185 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263824.430296:0:17207:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7f480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17207:1876178898123136:0@lo:104: 00000100:00100000:3.0:1789263824.430342:0:17207:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263824.430375:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882aafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de026c8f-6636-4fc7-8061-42c8092f00f0+21:18692:x1876178898122880:12345-0@lo:253:mount.lustre.0 Request processed in 2900us (3004us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263824.430382:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00010000:3.0:1789263824.430407:0:17207:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd981530c00/0xce1582440fb1ebb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce1582440fb1ebaa expref: 20 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263824.430417:0:17207:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dd981530c00/0xce1582440fb1ebb1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce1582440fb1ebaa expref: 20 pid: 17185 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263824.430427:0:17207:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7f100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17207:1876178898123264:0@lo:104: 00000100:00100000:2.0:1789263824.430430:0:18692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd884acc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:18692:1876178898122880:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789263824.430443:0:18692:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789263824.430447:0:18692:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789263824.430448:0:18692:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789263824.430450:0:18692:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789263824.430451:0:18692:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789263824.430453:0:18692:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789263824.430454:0:18692:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789263824.430456:0:18692:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789263824.430458:0:18692:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789263824.430459:0:18692:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1789263824.430468:0:17207:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:02000000:2.0:1789263824.430472:0:18692:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1789263824.430487:0:17207:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd8840863c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789263824.430509:0:17175:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789263824.430519:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898123136 00000100:00100000:3.0:1789263824.430522:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898123136 00000100:00100000:3.0:1789263824.430554:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898123264 00000100:00100000:3.0:1789263824.430556:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898123264 00000100:00100000:3.0:1789263824.430568:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789263824.430574:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de026c8f-6636-4fc7-8061-42c8092f00f0+4:17207:x1876178898123136:12345-0@lo:104: 00010000:00010000:3.0:1789263824.430585:0:17175:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff9dd981531e00/0xce1582440fb1ebb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1ebbf expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263824.430627:0:17175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789263824.430642:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de026c8f-6636-4fc7-8061-42c8092f00f0+4:17207:x1876178898123136:12345-0@lo:104: Request processed in 59us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263824.430649:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789263824.430663:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789263824.430668:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98738d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de026c8f-6636-4fc7-8061-42c8092f00f0+3:17207:x1876178898123264:12345-0@lo:104: 00010000:00010000:3.0:1789263824.430675:0:17175:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff9dd9bb804000/0xce1582440fb1ebaa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1ebb1 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263824.430703:0:17175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789263824.430708:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98738d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de026c8f-6636-4fc7-8061-42c8092f00f0+3:17207:x1876178898123264:12345-0@lo:104: Request processed in 41us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263824.430714:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1789263824.430743:0:17944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789263824.430748:0:17944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd981531e00/0xce1582440fb1ebb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1ebbf expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263824.430765:0:17944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981531e00 already unused, calling callback (ffffffffc12b1c20) 10000000:00010000:3.0:1789263824.430769:0:17944:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd981531e00/0xce1582440fb1ebb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xce1582440fb1ebbf expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263824.430777:0:17944:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd981531e00/0xce1582440fb1ebb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xce1582440fb1ebbf expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789263824.430784:0:17944:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd981531e00/0xce1582440fb1ebb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xce1582440fb1ebbf expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789263824.430790:0:17944:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789263824.430837:0:17944:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff9dd981531e00/0xce1582440fb1ebb8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1ebbf expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263824.430844:0:17944:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789263824.430877:0:17944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd981531e00/0xce1582440fb1ebb8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1ebbf expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263824.430884:0:17944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd981531e00/0xce1582440fb1ebb8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1ebbf expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263824.430896:0:17944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789263824.430899:0:17944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd9bb804000/0xce1582440fb1ebaa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1ebb1 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263824.430905:0:17944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bb804000 already unused, calling callback (ffffffffc12b1c20) 10000000:00010000:3.0:1789263824.430908:0:17944:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd9bb804000/0xce1582440fb1ebaa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xce1582440fb1ebb1 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263824.430953:0:17944:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd9bb804000/0xce1582440fb1ebaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xce1582440fb1ebb1 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789263824.430959:0:17944:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd9bb804000/0xce1582440fb1ebaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xce1582440fb1ebb1 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789263824.430964:0:17944:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789263824.430994:0:17944:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff9dd9bb804000/0xce1582440fb1ebaa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1ebb1 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263824.431000:0:17944:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789263824.431019:0:17944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd9bb804000/0xce1582440fb1ebaa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1ebb1 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263824.431027:0:17944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd9bb804000/0xce1582440fb1ebaa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1ebb1 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263824.431058:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263824.431060:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263824.431062:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263824.431068:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789263824.431104:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:de026c8f-6636-4fc7-8061-42c8092f00f0:3618:1876178898123392:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789263824.431143:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263824.431186:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789263824.431192:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:de026c8f-6636-4fc7-8061-42c8092f00f0:3618:1876178898123520:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789263824.431269:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263824.431349:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898123392 00000100:00100000:3.0:1789263824.431354:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898123392 00010000:00010000:3.0:1789263824.431415:0:17179:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd9bb804400/0xce1582440fb1ebbf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1ebb8 expref: 21 pid: 17185 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263824.431447:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898123520 00000100:00100000:3.0:1789263824.431465:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898123520 00010000:00010000:3.0:1789263824.431487:0:17179:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd981530c00/0xce1582440fb1ebb1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1ebaa expref: 22 pid: 17185 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263824.431507:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789263824.431514:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de026c8f-6636-4fc7-8061-42c8092f00f0+22:3618:x1876178898123392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789263824.431523:0:17179:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789263824.431528:0:17179:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd9bb804400/0xce1582440fb1ebbf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1ebb8 expref: 22 pid: 17185 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263824.431542:0:17179:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd9bb804400/0xce1582440fb1ebbf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce1582440fb1ebb8 expref: 22 pid: 17185 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263824.431556:0:17179:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789263824.431584:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de026c8f-6636-4fc7-8061-42c8092f00f0+22:3618:x1876178898123392:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263824.431603:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789263824.431617:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789263824.431633:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa61050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de026c8f-6636-4fc7-8061-42c8092f00f0+21:3618:x1876178898123520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789263824.431641:0:17179:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789263824.431645:0:17179:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd981530c00/0xce1582440fb1ebb1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1ebaa expref: 21 pid: 17185 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263824.431669:0:17179:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd981530c00/0xce1582440fb1ebb1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce1582440fb1ebaa expref: 21 pid: 17185 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263824.431702:0:17179:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dd981531000/0xce1582440fb1ec67 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263824.431710:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd981531000/0xce1582440fb1ec67 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789263824.431734:0:17179:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003869632s 00010000:00010000:3.0:1789263824.431738:0:17179:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd981531000/0xce1582440fb1ec67 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263824.431745:0:17179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd981531000/0xce1582440fb1ec67 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263824.431762:0:17179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dd981531000/0xce1582440fb1ec67 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263824.431768:0:17179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dd981531000/0xce1582440fb1ec67 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263824.431774:0:17179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981531000 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:3.0:1789263824.431777:0:17179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dd981531000/0xce1582440fb1ec67 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263824.431796:0:17179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dd981531000/0xce1582440fb1ec67 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263824.431805:0:17179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dd981531000/0xce1582440fb1ec67 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263824.431823:0:17179:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789263824.431861:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa61050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de026c8f-6636-4fc7-8061-42c8092f00f0+21:3618:x1876178898123520:12345-0@lo:103:ldlm_bl.0 Request processed in 238us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263824.431886:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789263824.431985:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:de026c8f-6636-4fc7-8061-42c8092f00f0:3618:1876178898123520:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789263824.431994:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:de026c8f-6636-4fc7-8061-42c8092f00f0:3618:1876178898123392:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789263824.432041:0:17207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd9bb804400/0xce1582440fb1ebbf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce1582440fb1ebb8 expref: 20 pid: 17185 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263824.432062:0:17207:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7f480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17207:1876178898123136:0@lo:104: 00010000:00010000:3.0:1789263824.432072:0:17207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd981530c00/0xce1582440fb1ebb1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce1582440fb1ebaa expref: 19 pid: 17185 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263824.432117:0:17207:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7f100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17207:1876178898123264:0@lo:104: 00010000:00010000:3.0:1789263824.432141:0:17207:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dd981531000/0xce1582440fb1ec67 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263824.432150:0:17207:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dd981531000/0xce1582440fb1ec67 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263824.432165:0:17207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dd981531000/0xce1582440fb1ec67 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263824.432171:0:17207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd981531000/0xce1582440fb1ec67 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:0.0:1789263824.437840:0:18692:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1789263824.440275:0:18692:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1789263824.440290:0:18692:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1789263824.440331:0:18692:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789263824.440369:0:18692:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.120@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789263824.440386:0:18692:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1789263824.440414:0:18692:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1789263824.441066:0:18692:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789263824.441269:0:18692:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:1.0:1789263824.817286:0:18772:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789263824.817495:0:18772:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789263825.197379:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789263825.773131:0:17189:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789263825.773138:0:17189:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9dd9b7a92000 from 9 10000000:01000000:3.0:1789263825.773142:0:17189:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789263825.773185:0:17189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd981531000/0xce1582440fb1ec6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263825.773208:0:17189:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd981531000/0xce1582440fb1ec6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263825.773221:0:17189:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd981531000/0xce1582440fb1ec6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263825.773245:0:17189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de026c8f-6636-4fc7-8061-42c8092f00f0:17189:1876178898123648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789263825.773333:0:17189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263825.773380:0:17189:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9872af0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789263825.773389:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898123648 00000100:00100000:1.0:1789263825.773398:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898123648 00000100:00100000:1.0:1789263825.773458:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789263825.773468:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882aac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de026c8f-6636-4fc7-8061-42c8092f00f0+19:17189:x1876178898123648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789263825.773483:0:17187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263825.773499:0:17187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd883f58e00/0xce1582440fb1ec75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1ec6e expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263825.773524:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd883f58e00/0xce1582440fb1ec75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1ec6e expref: 20 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263825.773533:0:17187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd883f58e00/0xce1582440fb1ec75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1ec6e expref: 20 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263825.773540:0:17187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd883f58e00, rc 0) 00000100:00100000:1.0:1789263825.773579:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882aac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de026c8f-6636-4fc7-8061-42c8092f00f0+20:17189:x1876178898123648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263825.773585:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789263825.773613:0:17189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de026c8f-6636-4fc7-8061-42c8092f00f0:17189:1876178898123648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789263825.773628:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd981531000/0xce1582440fb1ec6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1ec75 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263825.773638:0:17189:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd981531000/0xce1582440fb1ec6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1ec75 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263825.773689:0:17189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de026c8f-6636-4fc7-8061-42c8092f00f0:17189:1876178898123776:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789263825.773725:0:17189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263825.773745:0:17189:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9872af0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789263825.773762:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898123776 00000100:00100000:2.0:1789263825.773768:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898123776 00000100:00100000:2.0:1789263825.773800:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789263825.773809:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882aae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de026c8f-6636-4fc7-8061-42c8092f00f0+20:17189:x1876178898123776:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789263825.773824:0:17186:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789263825.773840:0:17186:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789263825.773844:0:17186:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:2.0:1789263825.773936:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882aae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de026c8f-6636-4fc7-8061-42c8092f00f0+20:17189:x1876178898123776:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 129us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263825.773946:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789263825.773952:0:17189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de026c8f-6636-4fc7-8061-42c8092f00f0:17189:1876178898123776:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789263825.774002:0:17189:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789263825.774008:0:17189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd981531000/0xce1582440fb1ec6e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1ec75 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263825.774017:0:17189:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd981531000/0xce1582440fb1ec6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1ec75 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789263825.774035:0:17189:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789263825.774037:0:17189:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9dd882a35000 from 9 10000000:01000000:3.0:1789263825.774039:0:17189:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789263825.774054:0:17189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd981530c00/0xce1582440fb1ec7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263825.774062:0:17189:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd981530c00/0xce1582440fb1ec7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263825.774070:0:17189:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd981530c00/0xce1582440fb1ec7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263825.774103:0:17189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de026c8f-6636-4fc7-8061-42c8092f00f0:17189:1876178898123904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789263825.774135:0:17189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263825.774161:0:17189:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9872af0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789263825.774172:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898123904 00000100:00100000:2.0:1789263825.774178:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898123904 00000100:00100000:2.0:1789263825.774210:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789263825.774217:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882aae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+20:17189:x1876178898123904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789263825.774225:0:17185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263825.774233:0:17185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd9bb805800/0xce1582440fb1ec83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1ec7c expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263825.774249:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd9bb805800/0xce1582440fb1ec83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1ec7c expref: 21 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263825.774258:0:17185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd9bb805800/0xce1582440fb1ec83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1ec7c expref: 21 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263825.774265:0:17185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bb805800, rc 0) 00000100:00100000:2.0:1789263825.774299:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882aae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+21:17189:x1876178898123904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 82us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263825.774325:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789263825.774346:0:17189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de026c8f-6636-4fc7-8061-42c8092f00f0:17189:1876178898123904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789263825.774359:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd981530c00/0xce1582440fb1ec7c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1ec83 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263825.774374:0:17189:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd981530c00/0xce1582440fb1ec7c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1ec83 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263825.774411:0:17189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de026c8f-6636-4fc7-8061-42c8092f00f0:17189:1876178898124032:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789263825.774432:0:17189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263825.774450:0:17189:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9872af0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789263825.774470:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898124032 00000100:00100000:2.0:1789263825.774475:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898124032 00000100:00100000:2.0:1789263825.774564:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789263825.774572:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882aad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de026c8f-6636-4fc7-8061-42c8092f00f0+21:17189:x1876178898124032:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789263825.774583:0:17186:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789263825.774594:0:17186:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789263825.774597:0:17186:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:2.0:1789263825.774679:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882aad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de026c8f-6636-4fc7-8061-42c8092f00f0+21:17189:x1876178898124032:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 108us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263825.774687:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789263825.774697:0:17189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de026c8f-6636-4fc7-8061-42c8092f00f0:17189:1876178898124032:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789263825.774735:0:17189:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789263825.774744:0:17189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd981530c00/0xce1582440fb1ec7c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1ec83 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263825.774749:0:17189:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd981530c00/0xce1582440fb1ec7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1ec83 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263826.222857:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789263826.286299:0:17227:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789263826.286326:0:17227:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789263826.286471:0:17227:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:0.0:1789263826.286482:0:17227:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:02000400:2.0:1789263826.681206:0:19062:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg320-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000020:00000004:1.0:1789263827.052383:0:19114:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789263827.052568:0:19114:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789263827.246329:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789263827.391423:0:19164:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789263827.391589:0:19164:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789263828.270212:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789263828.525256:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789263828.525279:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898124160:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789263828.525354:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263828.525401:0:18524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898124160 00000100:00100000:2.0:1789263828.525409:0:18524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898124160 00000100:00100000:2.0:1789263828.525457:0:18524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789263828.525468:0:18524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3621:x1876178898124160:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789263828.525501:0:18524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789263828.525551:0:18524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3621:x1876178898124160:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263828.525556:0:18524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789263828.525592:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898124160:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789263828.526142:0:3617:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789263818/real 1789263818] req@ffff9dd9bfa64380 x1876178898113664/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789263828 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000001:00100000:3.0:1789263828.526147:0:17923:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1789263828.526167:0:3617:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9dd9bfa64380 x1876178898113664/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789263828 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263828.526177:0:3617:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789263818/real 1789263818] req@ffff9dd9bfa65500 x1876178898113536/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789263828 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263828.526189:0:3617:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9dd9bfa65500 x1876178898113536/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789263828 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789263828.526203:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd9862e7800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789263828.526218:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789263828.526231:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1876178898113664:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1789263828.526237:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd9bf999000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789263828.526247:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789263828.526252:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1876178898113536:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1789263828.526305:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789263828.526309:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789263828.526312:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:de026c8f-6636-4fc7-8061-42c8092f00f0:3621:1876178898124288:0@lo:400:kworker.0 00000100:00080000:1.0:1789263828.526313:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789263828.526320:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789263828.526352:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:0.0:1789263828.526352:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876178898124416:0@lo:400:kworker.0 00000100:00100000:3.0:1789263828.526356:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789263828.526358:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789263828.526363:0:38:0:(import.c:65:import_set_state_nolock()) ffff9dd9bf999000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789263828.526367:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 261 00000100:00080000:1.0:1789263828.526371:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789263828.526374:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9dd9bf999000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:1.0:1789263828.526392:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd9bfa66a00 x1876178898124672/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789263828.526404:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789263828.526407:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789263828.526412:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789263828.526414:0:38:0:(import.c:65:import_set_state_nolock()) ffff9dd9862e7800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789263828.526419:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 261 00000100:00100000:3.0:1789263828.526420:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898124288 00000100:00080000:1.0:1789263828.526423:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00100000:3.0:1789263828.526426:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898124288 00000100:00080000:1.0:1789263828.526429:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9dd9862e7800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:0.0:1789263828.526435:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789263828.526443:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898124544:0@lo:400:kworker.0 00000100:00100000:1.0:1789263828.526449:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd9bfa65500 x1876178898124800/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789263828.526469:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263828.526470:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789263828.526480:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882aad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+21:3621:x1876178898124288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263828.526505:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898124416 00000100:00100000:0.0:1789263828.526509:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898124416 00000100:00100000:1.0:1789263828.526525:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789263828.526528:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882aad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+21:3621:x1876178898124288:12345-0@lo:400:kworker.0 Request processed in 50us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263828.526540:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789263828.526541:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3619:1876178898125184:0@lo:400:kworker.0 00000100:00100000:0.0:1789263828.526552:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789263828.526563:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883f5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876178898124416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789263828.526583:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263828.526622:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883f5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876178898124416:12345-0@lo:400:kworker.0 Request processed in 60us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263828.526631:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789263828.526641:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898125184 00000100:00100000:1.0:1789263828.526647:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898125184 00000100:00100000:0.0:1789263828.526662:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898124544 00000100:00100000:0.0:1789263828.526668:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898124544 00000100:00100000:1.0:1789263828.526694:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1789263828.526695:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789263828.526706:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1876178898125184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263828.526711:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789263828.526723:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883f5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1876178898124544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789263828.526762:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1876178898125184:12345-0@lo:400:kworker.0 Request processed in 58us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263828.526769:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883f5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1876178898124544:12345-0@lo:400:kworker.0 Request processed in 48us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263828.526771:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1789263828.526781:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd9bfa66680 x1876178898125184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263844 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263828.526785:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789263828.526798:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3619:1876178898125184:0@lo:400:kworker.0 00000100:00100000:1.0:1789263828.526812:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1876178898124928:0@lo:400:kworker.0 00000100:00100000:0.0:1789263828.526816:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1876178898124672:0@lo:8:kworker.0 00000100:00100000:1.0:1789263828.526858:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263828.526864:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263828.526887:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898124928 00000100:00100000:1.0:1789263828.526887:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789263828.526893:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898124928 00000100:00100000:1.0:1789263828.526897:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1876178898125056:0@lo:400:kworker.0 00000100:00100000:0.0:1789263828.526905:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1876178898124800:0@lo:8:kworker.0 00000100:00100000:3.0:1789263828.526929:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789263828.526939:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263828.526943:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1876178898124928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263828.526946:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263828.526984:0:18698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898124672 00000100:00100000:1.0:1789263828.526987:0:18698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898124672 00000100:00100000:3.0:1789263828.526998:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1876178898124928:12345-0@lo:400:kworker.0 Request processed in 60us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263828.526999:0:18696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898124800 00000100:00100000:0.0:1789263828.527005:0:18696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898124800 00000100:00100000:1.0:1789263828.527010:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789263828.527017:0:18698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883f5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3617:x1876178898124672:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1789263828.527021:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1789263828.527041:0:18698:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 270 last 0 00000100:00100000:3.0:1789263828.527042:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898125056 00000100:00100000:0.0:1789263828.527047:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898124544:0@lo:400:kworker.0 00000100:00100000:3.0:1789263828.527049:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898125056 00010000:00080000:0.0:1789263828.527065:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd9bfa64a80 x1876178898124416/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263844 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263828.527097:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876178898124416:0@lo:400:kworker.0 00000100:00100000:3.0:1789263828.527115:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000020:00000080:1.0:1789263828.527125:0:18698:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xce1582440fb1ec8a 00000100:00100000:3.0:1789263828.527126:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1876178898125056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263828.527151:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:de026c8f-6636-4fc7-8061-42c8092f00f0:3621:1876178898124288:0@lo:400:kworker.0 00002000:00100000:1.0:1789263828.527153:0:18698:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9dd8810d3000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1789263828.527161:0:18698:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:1.0:1789263828.527165:0:18698:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1789263828.527171:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1876178898125056:12345-0@lo:400:kworker.0 Request processed in 47us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263828.527180:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1789263828.527196:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd9bfa64700 x1876178898125056/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263844 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789263828.527202:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789263828.527208:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1876178898125056:0@lo:400:kworker.0 00010000:00080000:0.0:1789263828.527226:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd9bfa64380 x1876178898124928/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263844 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263828.527245:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1876178898124928:0@lo:400:kworker.0 00002000:00080000:1.0:1789263828.527355:0:18698:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1789263828.527380:0:18698:0:(import.c:65:import_set_state_nolock()) ffff9dd8810d6800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789263828.527427:0:18698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883f5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3617:x1876178898124672:12345-0@lo:8:kworker.0 Request processed in 408us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263828.527434:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789263828.527451:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789263828.527465:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd9bfa66a00 x1876178898124672/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789263843 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789263828.527466:0:18698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883f5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3617:x1876178898124800:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1789263828.527479:0:18698:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789263828.527479:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789263828.527492:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1789263828.527500:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789263828.527506:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1789263828.527508:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd9bf999000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789263828.527529:0:3617:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789263828.527535:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1876178898124672:0@lo:8:kworker.0 00000004:00080000:0.0:1789263828.527577:0:17931:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789263828.527588:0:17932:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1789263828.527610:0:17932:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17932:1876178898125440:0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1789263828.527641:0:17931:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 270817563364ns, next at 0ns, rc = 0 00000100:00100000:3.0:1789263828.527648:0:17932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00080000:00080000:0.0:1789263828.527652:0:17931:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1789263828.527668:0:17932:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9872af0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789263828.527681:0:18696:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1789263828.527688:0:18696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1789263828.527702:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898125312:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789263828.527735:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263828.527764:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898125312 00000100:00100000:0.0:1789263828.527770:0:18700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898125312 00000100:00080000:3.0:1789263828.527799:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789263828.527809:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789263828.527818:0:18700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3619:x1876178898125312:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789263828.527836:0:18700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789263828.527879:0:18700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3619:x1876178898125312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 62us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263828.527887:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789263828.527894:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd98ff7f100 x1876178898125312/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789263844 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263828.527909:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898125312:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789263828.528053:0:18696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898125440 00000100:00100000:3.0:1789263828.528057:0:18696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898125440 00000100:00100000:0.0:1789263828.528237:0:19302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789263828.528247:0:19302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17932:x1876178898125440:12345-0@lo:7:osp-pre-0-1.0 00000004:00080000:3.0:1789263828.529061:0:17923:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:0.0:1789263828.530641:0:19302:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1789263828.530648:0:19302:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1789263828.530732:0:19302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17932:x1876178898125440:12345-0@lo:7:osp-pre-0-1.0 Request processed in 2485us (3084us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263828.530743:0:19302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789263828.530774:0:17932:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd98ff7f480 x1876178898125440/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789263844 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263828.530784:0:17932:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17932:1876178898125440:0@lo:7:osp-pre-0-1.0 00000004:00080000:3.0:1789263828.530801:0:17932:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:3.0:1789263828.530834:0:17932:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17932:1876178898125568:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1789263828.530865:0:17932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263828.530889:0:17932:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9872af0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789263828.530921:0:18696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898125568 00000100:00100000:3.0:1789263828.530928:0:18696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898125568 00000100:00100000:3.0:1789263828.530964:0:18696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789263828.530972:0:18696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17932:x1876178898125568:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1789263828.530997:0:18696:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:3.0:1789263828.531033:0:18696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17932:x1876178898125568:12345-0@lo:5:osp-pre-0-1.0 Request processed in 61us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263828.531039:0:18696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789263828.531070:0:17932:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd98ff7f480 x1876178898125568/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789263844 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263828.531100:0:17932:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17932:1876178898125568:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1789263828.531109:0:17932:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:3.0:1789263828.531148:0:17932:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17932:1876178898125696:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1789263828.531174:0:17932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263828.531199:0:17932:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9872af0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789263828.531220:0:19302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898125696 00000100:00100000:2.0:1789263828.531226:0:19302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898125696 00000100:00100000:2.0:1789263828.531259:0:19302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789263828.531268:0:19302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17932:x1876178898125696:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1789263828.531308:0:19302:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:1.0:1789263828.544970:0:18698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883f5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3617:x1876178898124800:12345-0@lo:8:kworker.0 Request processed in 17498us (18018us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789263828.544983:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1789263828.545036:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd9862e7800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789263828.545041:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789263828.545045:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1876178898124800:0@lo:8:kworker.0 00000001:00080000:3.0:1789263828.547063:0:18693:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:3.0:1789263828.547199:0:18693:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1789263828.547402:0:19302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:17932:x1876178898125696:12345-0@lo:5:osp-pre-0-1.0 Request processed in 16132us (16222us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1789263828.547420:0:19302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1789263828.547516:0:17932:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd98ff7f480 x1876178898125696/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789263844 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263828.547527:0:17932:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1789263828.547533:0:17932:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17932:1876178898125696:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1789263828.547553:0:17932:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:3.0:1789263828.547602:0:17932:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17932:1876178898125824:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1789263828.547643:0:17932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263828.547767:0:17932:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9872af0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789263828.547774:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898125824 00000100:00100000:1.0:1789263828.547783:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898125824 00000100:00100000:1.0:1789263828.547887:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789263828.547918:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17932:x1876178898125824:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1789263828.548048:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17932:x1876178898125824:12345-0@lo:900:osp-pre-0-1.0 Request processed in 146us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263828.548060:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789263828.548072:0:17932:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd98ff7f480 x1876178898125824/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789263844 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263828.548113:0:17932:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17932:1876178898125824:0@lo:900:osp-pre-0-1.0 00010000:00010000:3.0:1789263829.293272:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789263829.550224:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789263829.550251:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898125952:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789263829.550337:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263829.550394:0:18524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898125952 00000100:00100000:3.0:1789263829.550417:0:18524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898125952 00000100:00100000:3.0:1789263829.550496:0:18524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789263829.550512:0:18524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883f5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1876178898125952:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789263829.550562:0:18524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446289408 avail 1300049920 00000100:00100000:3.0:1789263829.550657:0:18524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883f5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1876178898125952:12345-0@lo:41:osp-pre-0-1.0 Request processed in 151us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263829.550666:0:18524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789263829.550718:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898125952:0@lo:41:osp-pre-0-1.0 00000020:01000004:3.0:1789263829.989211:0:19509:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789263829.989215:0:19509:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1789263829.989216:0:19509:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1789263829.989335:0:19509:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9dd9bf6c0800 00000020:01000004:3.0:1789263829.989348:0:19509:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1789263829.989361:0:19509:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789263829.989374:0:19509:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9dd88389cd28) 00000020:00000080:3.0:1789263829.989392:0:19509:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1789263830.017354:0:19509:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1789263830.019499:0:19509:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1789263830.019704:0:19509:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1789263830.020103:0:19509:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1789263830.020330:0:19509:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1789263830.020558:0:19509:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1789263830.020739:0:19509:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:1.0:1789263830.021674:0:19509:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1789263830.021861:0:19509:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1789263830.021874:0:19509:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789263830.021882:0:19509:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xce1582440fb1ec98 00000020:01000004:1.0:1789263830.021892:0:19509:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1789263830.021908:0:19509:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.120@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1789263830.021910:0:19509:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.120@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1789263830.021914:0:19509:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1789263830.021940:0:19509:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:1.0:1789263830.021943:0:19509:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.120@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1789263830.027061:0:19509:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.120@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789263830.027267:0:19509:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.120@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1789263830.027272:0:19509:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789263830.027274:0:19509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789263830.027276:0:19509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789263830.027277:0:19509:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789263830.027290:0:19509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789263830.027292:0:19509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789263830.027293:0:19509:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789263830.027295:0:19509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789263830.027296:0:19509:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789263830.027299:0:19509:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1789263830.027301:0:19509:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789263830.027303:0:19509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789263830.027304:0:19509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789263830.027305:0:19509:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789263830.027306:0:19509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789263830.027307:0:19509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789263830.027308:0:19509:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789263830.027309:0:19509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789263830.027310:0:19509:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789263830.027334:0:19509:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789263830.027354:0:19509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa65500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:19509:1876178898126080:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789263830.027426:0:19509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263830.027467:0:19509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd8838d1840 going to sleep for 11 seconds 00000100:00100000:2.0:1789263830.027481:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898126080 00000100:00100000:2.0:1789263830.027491:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898126080 00000100:00100000:2.0:1789263830.027533:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789263830.027540:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd990736450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de026c8f-6636-4fc7-8061-42c8092f00f0+21:19509:x1876178898126080:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789263830.027562:0:17186:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1789263830.027565:0:17186:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1789263830.027568:0:17186:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1789263830.028405:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd990736450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de026c8f-6636-4fc7-8061-42c8092f00f0+21:19509:x1876178898126080:12345-0@lo:253:mount.lustre.0 Request processed in 862us (976us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263830.028414:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789263830.028440:0:19509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa65500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:19509:1876178898126080:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789263830.028451:0:19509:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789263830.028454:0:19509:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789263830.028461:0:19509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789263830.028462:0:19509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789263830.028463:0:19509:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789263830.028464:0:19509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789263830.028466:0:19509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789263830.028467:0:19509:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789263830.028468:0:19509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789263830.028469:0:19509:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789263830.028487:0:19509:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9dd9bf6c0800 from lustre-OST0001 10000000:01000000:1.0:1789263830.028510:0:19509:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1789263830.028513:0:19509:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789263830.028520:0:19509:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9dd9bf8f19b8 local copy 00010000:00010000:1.0:1789263830.028530:0:19509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883f59a00/0xce1582440fb1e9b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1e9b9 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263830.028615:0:19509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa65500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:19509:1876178898126208:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789263830.028644:0:19509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263830.028675:0:19509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd8838d16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789263830.028692:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898126208 00000100:00100000:2.0:1789263830.028698:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898126208 00000100:00100000:2.0:1789263830.028727:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789263830.028732:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd990736c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de026c8f-6636-4fc7-8061-42c8092f00f0+21:19509:x1876178898126208:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789263830.028793:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd990736c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de026c8f-6636-4fc7-8061-42c8092f00f0+21:19509:x1876178898126208:12345-0@lo:501:mount.lustre.0 Request processed in 60us (148us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789263830.028811:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789263830.028816:0:19509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa65500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:19509:1876178898126208:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789263830.028830:0:19509:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.120@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789263830.028844:0:19509:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.120@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789263830.028849:0:19509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883f59a00/0xce1582440fb1e9b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1e9b9 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263830.028855:0:19509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd883f59a00/0xce1582440fb1e9b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1e9b9 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789263830.028878:0:19509:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9dd9bf6c0800 10000000:01000000:1.0:1789263830.028882:0:19509:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789263830.028887:0:19509:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789263830.028889:0:19509:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789263830.028899:0:19509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1789263830.028902:0:19509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1789263830.028921:0:19509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883f58600/0xce1582440fb1ec9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263830.028928:0:19509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd883f58600/0xce1582440fb1ec9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263830.028936:0:19509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd883f58600/0xce1582440fb1ec9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263830.028948:0:19509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa65500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:19509:1876178898126336:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789263830.028973:0:19509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263830.028990:0:19509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd8838d16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789263830.029009:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898126336 00000100:00100000:2.0:1789263830.029014:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898126336 00000100:00100000:2.0:1789263830.029044:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789263830.029053:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd990736050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de026c8f-6636-4fc7-8061-42c8092f00f0+21:19509:x1876178898126336:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789263830.029063:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263830.029095:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd9bb804200/0xce1582440fb1eca6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1ec9f expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263830.029117:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd9bb804200/0xce1582440fb1eca6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1ec9f expref: 22 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263830.029135:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd9bb804200/0xce1582440fb1eca6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1ec9f expref: 22 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263830.029144:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bb804200, rc 0) 00000100:00100000:2.0:1789263830.029177:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd990736050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de026c8f-6636-4fc7-8061-42c8092f00f0+22:19509:x1876178898126336:12345-0@lo:101:mount.lustre.0 Request processed in 125us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263830.029185:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789263830.029188:0:19509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa65500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:19509:1876178898126336:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789263830.029199:0:19509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd883f58600/0xce1582440fb1ec9f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1eca6 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263830.029206:0:19509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd883f58600/0xce1582440fb1ec9f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1eca6 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789263830.030050:0:19509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1789263830.030676:0:19509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789263830.032128:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1789263830.032164:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1789263830.032180:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1789263830.032195:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1789263830.032208:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1789263830.032221:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1789263830.032243:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1789263830.032256:0:19509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1789263830.032352:0:19509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa65500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:19509:1876178898126464:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789263830.032407:0:19509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263830.032450:0:19509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd8838d1e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789263830.032544:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898126464 00000100:00100000:3.0:1789263830.032552:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898126464 00000100:00100000:3.0:1789263830.032597:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789263830.032606:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd990735050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+22:19509:x1876178898126464:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789263830.032757:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd990735050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+22:19509:x1876178898126464:12345-0@lo:501:mount.lustre.0 Request processed in 152us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263830.032770:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789263830.032801:0:19509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa65500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:19509:1876178898126464:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789263830.032835:0:19509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd884acc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:19509:1876178898126592:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789263830.032887:0:19509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263830.032909:0:19509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd986324900 going to sleep for 11 seconds 00000100:00100000:0.0:1789263830.032939:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898126592 00000100:00100000:0.0:1789263830.032945:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898126592 00000100:00100000:0.0:1789263830.032973:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789263830.032987:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd990734c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de026c8f-6636-4fc7-8061-42c8092f00f0+22:19509:x1876178898126592:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789263830.033603:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd990734c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de026c8f-6636-4fc7-8061-42c8092f00f0+22:19509:x1876178898126592:12345-0@lo:503:mount.lustre.0 Request processed in 617us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263830.033610:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789263830.033690:0:19509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd884acc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:19509:1876178898126592:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789263830.034010:0:19509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789263830.034108:0:19509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd884acc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:19509:1876178898126720:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789263830.034146:0:19509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263830.034176:0:19509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd986324900 going to sleep for 11 seconds 00000100:00100000:3.0:1789263830.034228:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898126720 00000100:00100000:3.0:1789263830.034232:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898126720 00000100:00100000:3.0:1789263830.034268:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789263830.034276:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd990735c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+22:19509:x1876178898126720:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789263830.034545:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd990735c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+22:19509:x1876178898126720:12345-0@lo:502:mount.lustre.0 Request processed in 270us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263830.034557:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789263830.034615:0:19509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd884acc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:19509:1876178898126720:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789263830.034758:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1789263830.034782:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1789263830.034796:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1789263830.034810:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1789263830.034824:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1789263830.034838:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1789263830.034852:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1789263830.034866:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1789263830.034892:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1789263830.034913:0:19509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd884acc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:19509:1876178898126848:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789263830.034943:0:19509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263830.035068:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898126848 00000100:00100000:2.0:1789263830.035074:0:19509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd986324900 going to sleep for 11 seconds 00000100:00100000:0.0:1789263830.035091:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898126848 00000100:00100000:0.0:1789263830.035133:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789263830.035140:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd990737c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de026c8f-6636-4fc7-8061-42c8092f00f0+22:19509:x1876178898126848:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789263830.035214:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd990737c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de026c8f-6636-4fc7-8061-42c8092f00f0+22:19509:x1876178898126848:12345-0@lo:502:mount.lustre.0 Request processed in 75us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263830.035219:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789263830.035262:0:19509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd884acc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:19509:1876178898126848:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789263830.035312:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1789263830.035320:0:19509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:2.0:1789263830.035842:0:19513:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789263830.035849:0:19513:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1789263830.035856:0:19513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263830.035858:0:19513:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1789263830.035864:0:19513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789263830.035876:0:19513:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9dd9b7983370) 00000020:00000080:2.0:1789263830.035898:0:19513:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789263830.035905:0:19513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789263830.035973:0:19513:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dd9bf6c0800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1789263830.035981:0:19513:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789263830.035988:0:19513:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xce1582440fb1ecb4 00010000:00010000:2.0:1789263830.039159:0:19513:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:2.0:1789263830.039621:0:19513:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:2.0:1789263830.040900:0:19513:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:2.0:1789263830.041652:0:19513:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1789263830.041662:0:19513:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789263830.041669:0:19513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263830.041671:0:19513:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1789263830.041675:0:19513:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789263830.041679:0:19513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263830.041681:0:19513:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789263830.041684:0:19513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789263830.041686:0:19513:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789263830.041688:0:19513:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789263830.041697:0:19513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263830.041699:0:19513:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789263830.041703:0:19513:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789263830.041706:0:19513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263830.041708:0:19513:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789263830.041711:0:19513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1789263830.041732:0:19513:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789263830.041735:0:19513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263830.041737:0:19513:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789263830.041740:0:19513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1789263830.041833:0:19509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1789263830.041872:0:19509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789263830.041900:0:19509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883f58600/0xce1582440fb1ec9f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1eca6 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263830.041912:0:19509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd883f58600/0xce1582440fb1ec9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1eca6 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789263830.041920:0:19509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dd9bf6c0800 from 1 10000000:01000000:1.0:1789263830.041923:0:19509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789263830.041957:0:19509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883f58a00/0xce1582440fb1ecbb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263830.041965:0:19509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd883f58a00/0xce1582440fb1ecbb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263830.041976:0:19509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd883f58a00/0xce1582440fb1ecbb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263830.041998:0:19509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa65500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:19509:1876178898126976:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789263830.042063:0:19509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263830.042127:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898126976 00000100:00100000:1.0:1789263830.042131:0:19509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd8838d16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789263830.042135:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898126976 00000100:00100000:2.0:1789263830.042183:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789263830.042193:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd990734450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+22:19509:x1876178898126976:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789263830.042206:0:17185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263830.042218:0:17185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd9bb804000/0xce1582440fb1ecc2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1ecbb expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263830.042239:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd9bb804000/0xce1582440fb1ecc2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1ecbb expref: 23 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263830.042247:0:17185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd9bb804000/0xce1582440fb1ecc2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1ecbb expref: 23 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263830.042253:0:17185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bb804000, rc 0) 00000100:00100000:2.0:1789263830.042351:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd990734450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+23:19509:x1876178898126976:12345-0@lo:101:mount.lustre.0 Request processed in 158us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263830.042358:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789263830.042374:0:19509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa65500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:19509:1876178898126976:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789263830.042400:0:19509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd883f58a00/0xce1582440fb1ecbb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1ecc2 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263830.042421:0:19509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd883f58a00/0xce1582440fb1ecbb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1ecc2 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789263830.043344:0:19509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1789263830.043569:0:19509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789263830.043767:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1789263830.043791:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1789263830.043803:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1789263830.043806:0:19509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1789263830.043853:0:19509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa65500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:19509:1876178898127104:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789263830.043889:0:19509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263830.043936:0:19509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd8838d1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789263830.043937:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898127104 00000100:00100000:0.0:1789263830.043944:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898127104 00000100:00100000:0.0:1789263830.043997:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789263830.044006:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd990736850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de026c8f-6636-4fc7-8061-42c8092f00f0+23:19509:x1876178898127104:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789263830.044154:0:19509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa65500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:19509:1876178898127104:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789263830.044186:0:19509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa65500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:19509:1876178898127232:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789263830.044190:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd990736850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de026c8f-6636-4fc7-8061-42c8092f00f0+23:19509:x1876178898127104:12345-0@lo:501:mount.lustre.0 Request processed in 185us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263830.044197:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789263830.044234:0:19509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263830.044260:0:19509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd8838d1e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789263830.044290:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898127232 00000100:00100000:3.0:1789263830.044296:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898127232 00000100:00100000:1.0:1789263830.044428:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789263830.044439:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd990734850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de026c8f-6636-4fc7-8061-42c8092f00f0+23:19509:x1876178898127232:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789263830.044528:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd990734850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de026c8f-6636-4fc7-8061-42c8092f00f0+23:19509:x1876178898127232:12345-0@lo:503:mount.lustre.0 Request processed in 92us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263830.044536:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789263830.044558:0:19509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa65500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:19509:1876178898127232:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789263830.044885:0:19509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789263830.044956:0:19509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:19509:1876178898127360:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789263830.044993:0:19509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263830.045013:0:19509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9869c3180 going to sleep for 11 seconds 00000100:00100000:0.0:1789263830.045043:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898127360 00000100:00100000:0.0:1789263830.045047:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898127360 00000100:00100000:0.0:1789263830.045101:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789263830.045109:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd990734050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de026c8f-6636-4fc7-8061-42c8092f00f0+23:19509:x1876178898127360:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789263830.045187:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd990734050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de026c8f-6636-4fc7-8061-42c8092f00f0+23:19509:x1876178898127360:12345-0@lo:502:mount.lustre.0 Request processed in 78us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263830.045194:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789263830.045331:0:19509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:19509:1876178898127360:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789263830.045484:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1789263830.045517:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1789263830.045532:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1789263830.045543:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1789263830.045554:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1789263830.045566:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1789263830.045579:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1789263830.045592:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:2.0:1789263830.045604:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1789263830.045618:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:2.0:1789263830.045631:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:2.0:1789263830.045653:0:19509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd884acc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:19509:1876178898127488:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789263830.045689:0:19509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263830.045724:0:19509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd98ff6fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789263830.045849:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898127488 00000100:00100000:1.0:1789263830.045854:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898127488 00000100:00100000:1.0:1789263830.045882:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789263830.045890:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd990737850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de026c8f-6636-4fc7-8061-42c8092f00f0+23:19509:x1876178898127488:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789263830.045985:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd990737850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de026c8f-6636-4fc7-8061-42c8092f00f0+23:19509:x1876178898127488:12345-0@lo:502:mount.lustre.0 Request processed in 96us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263830.045993:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789263830.046747:0:19509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd884acc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:19509:1876178898127488:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789263830.046791:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:2.0:1789263830.046797:0:19509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1789263830.047310:0:19517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789263830.047319:0:19517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263830.047322:0:19517:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789263830.047328:0:19517:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dd9bf6c0800 00000020:00000080:2.0:1789263830.047330:0:19517:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789263830.047338:0:19517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789263830.047340:0:19517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263830.047342:0:19517:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1789263830.047344:0:19517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789263830.047346:0:19517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263830.047348:0:19517:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789263830.047351:0:19517:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dd9bf6c0800 00000020:00000080:2.0:1789263830.047352:0:19517:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789263830.047393:0:19517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789263830.047397:0:19517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263830.047404:0:19517:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1789263830.047408:0:19517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789263830.047422:0:19517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263830.047424:0:19517:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789263830.047428:0:19517:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9dd9bf6c0800 00000020:00000080:2.0:1789263830.047430:0:19517:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789263830.047447:0:19517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789263830.047450:0:19517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263830.047451:0:19517:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789263830.047454:0:19517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789263830.047456:0:19517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263830.047457:0:19517:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1789263830.047460:0:19517:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9dd9bf6c0800 00000020:00000080:2.0:1789263830.047462:0:19517:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789263830.047483:0:19517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789263830.047486:0:19517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263830.047487:0:19517:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1789263830.047489:0:19517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:3.0:1789263830.047547:0:19509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1789263830.047579:0:19509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789263830.047601:0:19509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883f58a00/0xce1582440fb1ecbb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1ecc2 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263830.047611:0:19509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd883f58a00/0xce1582440fb1ecbb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1ecc2 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789263830.047677:0:19509:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789263830.047680:0:19509:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9dd9bf6c0800 10000000:01000000:3.0:1789263830.047689:0:19509:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9dd9bf6c0800 10000000:01000000:3.0:1789263830.047694:0:19509:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789263830.047699:0:19509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9dd9bf6c0800 from 1 10000000:01000000:3.0:1789263830.047702:0:19509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789263830.047731:0:19509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd981531e00/0xce1582440fb1ecc9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263830.047740:0:19509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd981531e00/0xce1582440fb1ecc9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263830.047750:0:19509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd981531e00/0xce1582440fb1ecc9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263830.047777:0:19509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:19509:1876178898127616:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789263830.047811:0:19509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263830.047844:0:19509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9869c3180 going to sleep for 11 seconds 00000100:00100000:2.0:1789263830.047956:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898127616 00000100:00100000:2.0:1789263830.047962:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898127616 00000100:00100000:2.0:1789263830.048005:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789263830.048014:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd990735850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+23:19509:x1876178898127616:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789263830.048026:0:17185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263830.048038:0:17185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd9bb804400/0xce1582440fb1ecd0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1ecc9 expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263830.048060:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd9bb804400/0xce1582440fb1ecd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1ecc9 expref: 24 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263830.048071:0:17185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd9bb804400/0xce1582440fb1ecd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1ecc9 expref: 24 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263830.048118:0:17185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bb804400, rc 0) 00000100:00100000:2.0:1789263830.048157:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd990735850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+24:19509:x1876178898127616:12345-0@lo:101:mount.lustre.0 Request processed in 145us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263830.048164:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789263830.048384:0:19509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:19509:1876178898127616:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789263830.048397:0:19509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd981531e00/0xce1582440fb1ecc9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1ecd0 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263830.048405:0:19509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd981531e00/0xce1582440fb1ecc9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1ecd0 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789263830.049340:0:19509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:3.0:1789263830.049556:0:19509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789263830.049787:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1789263830.049817:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1789263830.049838:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1789263830.049857:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1789263830.049879:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1789263830.049908:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1789263830.049930:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1789263830.049949:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1789263830.049968:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1789263830.049987:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1789263830.050005:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1789263830.050026:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1789263830.050047:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1789263830.050101:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1789263830.050126:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1789263830.050145:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1789263830.050165:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1789263830.050184:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1789263830.050201:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1789263830.050221:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1789263830.050241:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1789263830.050259:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1789263830.050292:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1789263830.050314:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1789263830.050334:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:3.0:1789263830.050354:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:3.0:1789263830.050375:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:3.0:1789263830.050397:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:3.0:1789263830.050415:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:3.0:1789263830.050447:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:3.0:1789263830.050463:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:3.0:1789263830.050477:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:3.0:1789263830.050492:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:3.0:1789263830.050506:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:3.0:1789263830.050523:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:3.0:1789263830.050537:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:3.0:1789263830.050552:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:3.0:1789263830.050567:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:3.0:1789263830.050595:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:3.0:1789263830.050611:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:3.0:1789263830.050627:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:3.0:1789263830.050639:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:3.0:1789263830.050654:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:3.0:1789263830.050671:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:3.0:1789263830.050686:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:3.0:1789263830.050714:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:3.0:1789263830.050739:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:3.0:1789263830.050745:0:19509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:3.0:1789263830.050817:0:19509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:19509:1876178898127744:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789263830.050868:0:19509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263830.050901:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898127744 00000100:00100000:1.0:1789263830.050909:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898127744 00000100:00100000:3.0:1789263830.050910:0:19509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9869c3840 going to sleep for 11 seconds 00000100:00100000:1.0:1789263830.050957:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789263830.050967:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd990737050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de026c8f-6636-4fc7-8061-42c8092f00f0+24:19509:x1876178898127744:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789263830.051095:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd990737050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de026c8f-6636-4fc7-8061-42c8092f00f0+24:19509:x1876178898127744:12345-0@lo:501:mount.lustre.0 Request processed in 110us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263830.051105:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789263830.051123:0:19509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:19509:1876178898127744:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789263830.051155:0:19509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:19509:1876178898127872:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789263830.051194:0:19509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263830.051220:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898127872 00000100:00100000:3.0:1789263830.051224:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898127872 00000100:00100000:3.0:1789263830.051250:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789263830.051257:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd990737450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de026c8f-6636-4fc7-8061-42c8092f00f0+24:19509:x1876178898127872:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789263830.051341:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd990737450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de026c8f-6636-4fc7-8061-42c8092f00f0+24:19509:x1876178898127872:12345-0@lo:503:mount.lustre.0 Request processed in 83us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263830.051347:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789263830.051388:0:19509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9869c3840 going to sleep for 11 seconds 00000100:00100000:3.0:1789263830.051400:0:19509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:19509:1876178898127872:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789263830.051703:0:19509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789263830.051759:0:19509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:19509:1876178898128000:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789263830.051800:0:19509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263830.052862:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898128000 00000100:00100000:1.0:1789263830.052870:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898128000 00000100:00100000:3.0:1789263830.052888:0:19509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd8838d19c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789263830.052915:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789263830.052924:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd990735450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de026c8f-6636-4fc7-8061-42c8092f00f0+24:19509:x1876178898128000:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789263830.053015:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd990735450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de026c8f-6636-4fc7-8061-42c8092f00f0+24:19509:x1876178898128000:12345-0@lo:502:mount.lustre.0 Request processed in 92us (1215us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263830.053020:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789263830.053058:0:19509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:19509:1876178898128000:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789263830.053335:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1789263830.053370:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1789263830.053391:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1789263830.053407:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1789263830.053420:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1789263830.053434:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1789263830.053454:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1789263830.053476:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1789263830.053494:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1789263830.053507:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1789263830.053523:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1789263830.053554:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1789263830.053573:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1789263830.053590:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1789263830.053604:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1789263830.053624:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1789263830.053639:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1789263830.053658:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1789263830.053676:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1789263830.053690:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1789263830.053704:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1789263830.053731:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1789263830.053746:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1789263830.053764:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1789263830.053781:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:3.0:1789263830.053795:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:3.0:1789263830.053811:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:3.0:1789263830.053839:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:3.0:1789263830.053868:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:3.0:1789263830.053884:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:3.0:1789263830.053901:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:3.0:1789263830.053916:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:3.0:1789263830.053931:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:3.0:1789263830.053946:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:3.0:1789263830.053965:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:3.0:1789263830.053983:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:3.0:1789263830.053999:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:3.0:1789263830.054014:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:3.0:1789263830.054035:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:3.0:1789263830.054053:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:3.0:1789263830.054069:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:3.0:1789263830.054293:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:3.0:1789263830.054312:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:3.0:1789263830.054339:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:3.0:1789263830.054359:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:3.0:1789263830.054379:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:3.0:1789263830.054400:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:3.0:1789263830.054420:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:3.0:1789263830.054469:0:19509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:19509:1876178898128128:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789263830.054525:0:19509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263830.054570:0:19509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd8838d19c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789263830.054574:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898128128 00000100:00100000:0.0:1789263830.054588:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898128128 00000100:00100000:0.0:1789263830.054635:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789263830.054646:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd987389050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+24:19509:x1876178898128128:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789263830.054770:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd987389050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+24:19509:x1876178898128128:12345-0@lo:502:mount.lustre.0 Request processed in 126us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263830.054779:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789263830.054790:0:19509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:19509:1876178898128128:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789263830.054965:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:3.0:1789263830.054994:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:3.0:1789263830.055019:0:19509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:19509:1876178898128256:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789263830.055056:0:19509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263830.055114:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898128256 00000100:00100000:3.0:1789263830.055117:0:19509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd8838d19c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789263830.055119:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898128256 00000100:00100000:0.0:1789263830.055149:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789263830.055158:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98738a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de026c8f-6636-4fc7-8061-42c8092f00f0+24:19509:x1876178898128256:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789263830.055222:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98738a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de026c8f-6636-4fc7-8061-42c8092f00f0+24:19509:x1876178898128256:12345-0@lo:502:mount.lustre.0 Request processed in 65us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263830.055230:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789263830.055238:0:19509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:19509:1876178898128256:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789263830.055295:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:3.0:1789263830.055305:0:19509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1789263830.055999:0:19522:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1789263830.056022:0:19522:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9dd88380cd28) 00000020:00000080:3.0:1789263830.056051:0:19522:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:3.0:1789263830.056183:0:19522:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dd9bf6c0800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789263830.056187:0:19522:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dd9bf6c0800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789263830.056190:0:19522:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dd9bf6c0800 3 00010000:00080000:3.0:1789263830.056224:0:19522:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dd883814000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.120@tcp at head 00010000:00010000:3.0:1789263830.058044:0:19522:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:3.0:1789263830.058253:0:19522:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1789263830.058305:0:19522:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789263830.058317:0:19522:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xce1582440fb1ecde 00000100:00080000:3.0:1789263830.058328:0:19522:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789263830.058332:0:19522:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9dd883814000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:3.0:1789263830.058359:0:19522:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd98ff7d180 x1876178898128384/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789263830.058375:0:19522:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789263830.058437:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:3.0:1789263830.058442:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd884acc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898128512:0@lo:400:kworker.0 00000100:00080000:2.0:1789263830.058444:0:479:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789263830.058450:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789263830.058454:0:479:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789263830.058500:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789263830.058506:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789263830.058510:0:479:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789263830.058513:0:479:0:(import.c:65:import_set_state_nolock()) ffff9dd9862e7800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789263830.058520:0:479:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 270 00000100:00100000:0.0:1789263830.058524:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898128512 00000100:00080000:2.0:1789263830.058525:0:479:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00100000:0.0:1789263830.058530:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898128512 00000100:00080000:2.0:1789263830.058532:0:479:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9dd9862e7800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:3.0:1789263830.058534:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789263830.058543:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd884acd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898128896:0@lo:400:kworker.0 00000100:00100000:2.0:1789263830.058557:0:479:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd884acc000 x1876178898129024/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789263830.058568:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789263830.058573:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263830.058580:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1876178898128512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263830.058598:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd884acea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1876178898129152:0@lo:400:kworker.0 00000100:00100000:2.0:1789263830.058612:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd884acf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876178898128640:0@lo:400:kworker.0 00000100:00100000:3.0:1789263830.058639:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263830.058639:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1876178898128512:12345-0@lo:400:kworker.0 Request processed in 60us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263830.058651:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789263830.058663:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd884acc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898128768:0@lo:400:kworker.0 00000100:00100000:0.0:1789263830.058678:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898129152 00000100:00100000:0.0:1789263830.058682:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898129152 00000100:00100000:3.0:1789263830.058693:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd884acc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898128512:0@lo:400:kworker.0 00000100:00100000:2.0:1789263830.058701:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263830.058714:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789263830.058724:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1876178898129152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789263830.058733:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd884aced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3619:1876178898129408:0@lo:400:kworker.0 00000100:00100000:3.0:1789263830.058747:0:18699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898128896 00000100:00100000:3.0:1789263830.058757:0:18699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898128896 00000100:00100000:2.0:1789263830.058774:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263830.058779:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1876178898129152:12345-0@lo:400:kworker.0 Request processed in 56us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263830.058786:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789263830.058806:0:18699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789263830.058816:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898129408 00000100:00100000:3.0:1789263830.058820:0:18699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1876178898128896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789263830.058820:0:18524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898128768 00000100:00100000:0.0:1789263830.058822:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898129408 00000100:00100000:2.0:1789263830.058833:0:18524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898128768 00000100:00100000:0.0:1789263830.058859:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789263830.058871:0:18699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1876178898128896:12345-0@lo:400:kworker.0 Request processed in 55us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263830.058871:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd884acdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1876178898129408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789263830.058878:0:18524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789263830.058888:0:18699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789263830.058893:0:18524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd884acfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1876178898128768:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789263830.058909:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789263830.058916:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789263830.058928:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd884acdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1876178898129408:12345-0@lo:400:kworker.0 Request processed in 60us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263830.058935:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789263830.058947:0:18524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd884acfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1876178898128768:12345-0@lo:400:kworker.0 Request processed in 57us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263830.058955:0:18524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1789263830.058974:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd884acea00 x1876178898129152/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263846 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263830.058986:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd884acea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1876178898129152:0@lo:400:kworker.0 00000100:00100000:2.0:1789263830.058993:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789263830.059004:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd884acd880 x1876178898128896/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789263846 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263830.059015:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd884acd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898128896:0@lo:400:kworker.0 00000100:00100000:3.0:1789263830.059019:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898128640 00000100:00100000:2.0:1789263830.059023:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd884ace680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1876178898129280:0@lo:400:kworker.0 00000100:00100000:3.0:1789263830.059025:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898128640 00000100:00100000:3.0:1789263830.059061:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789263830.059067:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263830.059074:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd884acca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876178898128640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263830.059140:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898129280 00000100:00100000:0.0:1789263830.059145:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898129280 00000100:00100000:3.0:1789263830.059154:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd884acca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876178898128640:12345-0@lo:400:kworker.0 Request processed in 82us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263830.059163:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1789263830.059167:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd884acf800 x1876178898128640/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263846 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789263830.059178:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd884acf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876178898128640:0@lo:400:kworker.0 00000100:00100000:3.0:1789263830.059185:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789263830.059195:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd884acf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876178898129280:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789263830.059204:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789263830.059222:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd884acc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898128768:0@lo:400:kworker.0 00010000:00080000:2.0:1789263830.059237:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd884aced80 x1876178898129408/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263846 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263830.059245:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd884acf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876178898129280:12345-0@lo:400:kworker.0 Request processed in 50us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263830.059250:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd884aced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3619:1876178898129408:0@lo:400:kworker.0 00000100:00100000:3.0:1789263830.059257:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1789263830.059306:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd884ace680 x1876178898129280/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263846 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789263830.059316:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd884ace680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1876178898129280:0@lo:400:kworker.0 00000100:00100000:1.0:1789263830.059801:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3617:1876178898128384:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789263830.059839:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263830.059872:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd884acc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1876178898129024:0@lo:8:kworker.0 00000100:00100000:1.0:1789263830.059897:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263830.059932:0:18698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898129024 00000100:00100000:1.0:1789263830.059937:0:18698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898129024 00000100:00100000:1.0:1789263830.059965:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789263830.059971:0:18698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3617:x1876178898129024:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1789263830.060022:0:18698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3617:x1876178898129024:12345-0@lo:8:kworker.0 Request processed in 50us (123us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789263830.060036:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789263830.060057:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898128384 00000100:00100000:1.0:1789263830.060061:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898128384 00000100:00100000:1.0:1789263830.060110:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789263830.060116:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3617:x1876178898128384:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789263830.060133:0:17193:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 272 last 0 00000020:00000080:1.0:1789263830.060172:0:17193:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xce1582440fb1ece5 00000004:00100000:1.0:1789263830.060188:0:17193:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789263830.060219:0:17193:0:(import.c:65:import_set_state_nolock()) ffff9dd883fdf800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789263830.060262:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1876178898128384:12345-0@lo:38:llog_process_th.0 Request processed in 144us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263830.060269:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1789263830.060313:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd98ff7d180 x1876178898128384/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789263840 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789263830.060323:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789263830.060330:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1789263830.060337:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789263830.060342:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789263830.060344:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd883814000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789263830.060350:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3617:1876178898128384:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789263830.060362:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789263830.060366:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd9862e7800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789263830.060370:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789263830.060373:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd884acc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1876178898129024:0@lo:8:kworker.0 00000020:01000004:1.0:1789263830.060503:0:19522:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1789263830.060521:0:19522:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9dd99f9c4d28) 00000020:00000080:1.0:1789263830.060537:0:19522:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:1.0:1789263830.060645:0:19522:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dd9bf6c0800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789263830.060650:0:19522:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dd9bf6c0800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789263830.060653:0:19522:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dd9bf6c0800 3 00010000:00080000:1.0:1789263830.060682:0:19522:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dd883fde000@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.120@tcp at head 00010000:00010000:1.0:1789263830.062564:0:19522:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:1.0:1789263830.062728:0:19522:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1789263830.062767:0:19522:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789263830.062779:0:19522:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xce1582440fb1ecf3 00000100:00080000:1.0:1789263830.062788:0:19522:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789263830.062794:0:19522:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9dd883fde000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:1.0:1789263830.062827:0:19522:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd9bfa64700 x1876178898129536/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789263830.062864:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3617:1876178898129536:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789263830.062927:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789263830.062986:0:19522:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1789263830.063005:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789263830.063009:0:479:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789263830.063011:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789263830.063013:0:479:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:1.0:1789263830.063219:0:19522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000100:00100000:2.0:1789263830.063315:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898129536 00000100:00100000:2.0:1789263830.063324:0:18722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898129536 00000100:00100000:2.0:1789263830.063364:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789263830.063371:0:18722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3617:x1876178898129536:12345-0@lo:38:llog_process_th.0 00000020:01000000:1.0:1789263830.063383:0:19509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 00010000:00080000:2.0:1789263830.063398:0:18722:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 272 last 0 10000000:01000000:1.0:1789263830.063424:0:19509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789263830.063445:0:19509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd981531e00/0xce1582440fb1ecc9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1ecd0 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1789263830.063463:0:18722:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xce1582440fb1ecfa 00010000:00010000:1.0:1789263830.063468:0:19509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd981531e00/0xce1582440fb1ecc9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1ecd0 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00100000:2.0:1789263830.063483:0:18722:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789263830.063521:0:18722:0:(import.c:65:import_set_state_nolock()) ffff9dd99081f800 : changing import state from RECOVER to FULL 00000020:01000004:1.0:1789263830.063526:0:19509:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789263830.063530:0:19509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789263830.063531:0:19509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789263830.063532:0:19509:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789263830.063534:0:19509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789263830.063535:0:19509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789263830.063537:0:19509:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789263830.063539:0:19509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789263830.063540:0:19509:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789263830.063544:0:19509:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1789263830.063548:0:19509:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789263830.063550:0:19509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789263830.063551:0:19509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789263830.063553:0:19509:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789263830.063554:0:19509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789263830.063556:0:19509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789263830.063557:0:19509:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789263830.063558:0:19509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789263830.063559:0:19509:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789263830.063577:0:19509:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789263830.063591:0:19509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa64a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:19509:1876178898129664:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789263830.063594:0:18722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1876178898129536:12345-0@lo:38:llog_process_th.0 Request processed in 218us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263830.063605:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789263830.063639:0:19509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1789263830.063663:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd9bfa64700 x1876178898129536/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789263840 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263830.063668:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898129664 00000100:00100000:1.0:1789263830.063674:0:19509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9872afc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789263830.063675:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898129664 00000100:00100000:2.0:1789263830.063676:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789263830.063686:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1789263830.063693:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789263830.063697:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1789263830.063700:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd883fde000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789263830.063709:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3617:1876178898129536:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789263830.063720:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789263830.063731:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98738ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+24:19509:x1876178898129664:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789263830.063762:0:17185:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1789263830.063779:0:17185:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789263830.065843:0:17185:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789263830.065887:0:17185:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1789263830.065976:0:17207:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789263830.065982:0:17207:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789263830.066000:0:17207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dd981531200/0xce1582440fb1ed01 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263830.066017:0:17207:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd883f58e00/0xce1582440fb1ec75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1ec6e expref: 24 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263830.066025:0:17207:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd9bb805800/0xce1582440fb1ec83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1ec7c expref: 24 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263830.066039:0:17207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dd981531200/0xce1582440fb1ed01 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263830.066071:0:17207:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd9bb805800/0xce1582440fb1ec83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce1582440fb1ec7c expref: 24 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263830.066335:0:17207:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dd9bb805800/0xce1582440fb1ec83 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce1582440fb1ec7c expref: 24 pid: 17185 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263830.066349:0:17207:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaae300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17207:1876178898129792:0@lo:104: 00000100:00100000:3.0:1789263830.066418:0:17207:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263830.066451:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898129792 00000100:00100000:2.0:1789263830.066459:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898129792 00010000:00010000:3.0:1789263830.066467:0:17207:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd883f58e00/0xce1582440fb1ec75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce1582440fb1ec6e expref: 24 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263830.066477:0:17207:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dd883f58e00/0xce1582440fb1ec75 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce1582440fb1ec6e expref: 24 pid: 17187 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263830.066486:0:17207:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaaea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17207:1876178898129920:0@lo:104: 00000100:00100000:2.0:1789263830.066508:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789263830.066517:0:17207:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263830.066528:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de026c8f-6636-4fc7-8061-42c8092f00f0+3:17207:x1876178898129792:12345-0@lo:104: 00000100:00100000:3.0:1789263830.066531:0:17207:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd8838d1e40 going to sleep for 11 seconds 00010000:00010000:2.0:1789263830.066543:0:17175:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff9dd981530c00/0xce1582440fb1ec7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1ec83 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263830.066550:0:17176:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:0.0:1789263830.066559:0:17176:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:2.0:1789263830.066615:0:17175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789263830.066622:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de026c8f-6636-4fc7-8061-42c8092f00f0+3:17207:x1876178898129792:12345-0@lo:104: Request processed in 99us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263830.066631:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789263830.066652:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898129920 00000100:00100000:2.0:1789263830.066662:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898129920 00000100:00100000:0.0:1789263830.066689:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98738ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+24:19509:x1876178898129664:12345-0@lo:253:mount.lustre.0 Request processed in 2959us (3048us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263830.066690:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789263830.066701:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de026c8f-6636-4fc7-8061-42c8092f00f0+3:17207:x1876178898129920:12345-0@lo:104: 00000100:00100000:1.0:1789263830.066706:0:19509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa64a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de026c8f-6636-4fc7-8061-42c8092f00f0:19509:1876178898129664:0@lo:253:mount.lustre.0 00010000:00010000:2.0:1789263830.066717:0:17175:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff9dd981531000/0xce1582440fb1ec6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1ec75 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263830.066721:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 10000000:01000000:1.0:1789263830.066724:0:19509:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000100:00100000:3.0:1789263830.066726:0:17207:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaae300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17207:1876178898129792:0@lo:104: 00000020:01000004:1.0:1789263830.066730:0:19509:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789263830.066736:0:19509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789263830.066738:0:19509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789263830.066740:0:19509:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789263830.066741:0:19509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789263830.066749:0:19509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789263830.066751:0:19509:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789263830.066753:0:19509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789263830.066755:0:19509:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789263830.066774:0:19509:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1789263830.066784:0:17175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789263830.066791:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de026c8f-6636-4fc7-8061-42c8092f00f0+3:17207:x1876178898129920:12345-0@lo:104: Request processed in 93us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263830.066797:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1789263830.066815:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789263830.066821:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd981530c00/0xce1582440fb1ec7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1ec83 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263830.066829:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981530c00 already unused, calling callback (ffffffffc12b1c20) 10000000:00010000:2.0:1789263830.066833:0:17180:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd981530c00/0xce1582440fb1ec7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xce1582440fb1ec83 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263830.066841:0:17180:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd981530c00/0xce1582440fb1ec7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xce1582440fb1ec83 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789263830.066849:0:17180:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd981530c00/0xce1582440fb1ec7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xce1582440fb1ec83 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263830.066852:0:17207:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaaea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17207:1876178898129920:0@lo:104: 10000000:01000000:2.0:1789263830.066861:0:17180:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789263830.066875:0:17207:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dd981531200/0xce1582440fb1ed01 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263830.066893:0:17180:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff9dd981530c00/0xce1582440fb1ec7c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1ec83 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263830.066902:0:17180:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789263830.066926:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd981530c00/0xce1582440fb1ec7c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1ec83 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263830.066941:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd981530c00/0xce1582440fb1ec7c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1ec83 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263830.066954:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789263830.066958:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd981531000/0xce1582440fb1ec6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1ec75 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263830.066964:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981531000 already unused, calling callback (ffffffffc12b1c20) 10000000:00010000:2.0:1789263830.066968:0:17180:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd981531000/0xce1582440fb1ec6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xce1582440fb1ec75 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263830.066975:0:17180:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd981531000/0xce1582440fb1ec6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xce1582440fb1ec75 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789263830.066981:0:17180:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd981531000/0xce1582440fb1ec6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xce1582440fb1ec75 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789263830.066987:0:17180:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789263830.067006:0:17180:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff9dd981531000/0xce1582440fb1ec6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1ec75 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263830.067011:0:17180:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789263830.067019:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd981531000/0xce1582440fb1ec6e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1ec75 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263830.067026:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd981531000/0xce1582440fb1ec6e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1ec75 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263830.067039:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789263830.067047:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789263830.067050:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789263830.067057:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789263830.067105:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd884aced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:de026c8f-6636-4fc7-8061-42c8092f00f0:3621:1876178898130176:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789263830.067116:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd884ace680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de026c8f-6636-4fc7-8061-42c8092f00f0:3620:1876178898130048:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789263830.067138:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263830.067182:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263830.067205:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898130176 00000100:00100000:3.0:1789263830.067210:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898130176 00000100:00100000:2.0:1789263830.067228:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898130048 00000100:00100000:2.0:1789263830.067233:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898130048 00010000:00010000:3.0:1789263830.067235:0:17179:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd883f58e00/0xce1582440fb1ec75 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1ec6e expref: 24 pid: 17187 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263830.067251:0:17177:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd9bb805800/0xce1582440fb1ec83 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1ec7c expref: 25 pid: 17185 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263830.067263:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789263830.067273:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaaea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de026c8f-6636-4fc7-8061-42c8092f00f0+25:3621:x1876178898130176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789263830.067299:0:17179:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789263830.067300:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1789263830.067308:0:17179:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd883f58e00/0xce1582440fb1ec75 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1ec6e expref: 25 pid: 17187 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263830.067313:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd884acc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de026c8f-6636-4fc7-8061-42c8092f00f0+25:3620:x1876178898130048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789263830.067325:0:17177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789263830.067326:0:17179:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd883f58e00/0xce1582440fb1ec75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce1582440fb1ec6e expref: 25 pid: 17187 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263830.067330:0:17177:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd9bb805800/0xce1582440fb1ec83 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1ec7c expref: 25 pid: 17185 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263830.067354:0:17177:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd9bb805800/0xce1582440fb1ec83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce1582440fb1ec7c expref: 25 pid: 17185 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263830.067369:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd883f58e00/0xce1582440fb1ec75 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce1582440fb1ec6e expref: 25 pid: 17187 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263830.067377:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd9bb805800/0xce1582440fb1ec83 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce1582440fb1ec7c expref: 25 pid: 17185 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263830.067385:0:17179:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dd981531200/0xce1582440fb1ed01 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263830.067405:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd981531200/0xce1582440fb1ed01 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263830.067414:0:17177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 20000000:01000000:3.0:1789263830.067419:0:17179:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003869632s 00010000:00010000:3.0:1789263830.067425:0:17179:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd981531200/0xce1582440fb1ed01 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263830.067433:0:17179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd981531200/0xce1582440fb1ed01 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263830.067440:0:17179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dd981531200/0xce1582440fb1ed01 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263830.067450:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd884acc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de026c8f-6636-4fc7-8061-42c8092f00f0+23:3620:x1876178898130048:12345-0@lo:103:ldlm_bl.0 Request processed in 140us (269us total) trans 0 rc 0/0 00010000:00010000:3.0:1789263830.067465:0:17179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dd981531200/0xce1582440fb1ed01 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263830.067466:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1789263830.067477:0:17179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981531200 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:3.0:1789263830.067482:0:17179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dd981531200/0xce1582440fb1ed01 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263830.067489:0:17179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dd981531200/0xce1582440fb1ed01 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263830.067502:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd884ace680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de026c8f-6636-4fc7-8061-42c8092f00f0:3620:1876178898130048:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789263830.067505:0:17179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dd981531200/0xce1582440fb1ed01 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263830.067518:0:17179:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789263830.067538:0:17207:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dd981531200/0xce1582440fb1ed01 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263830.067552:0:17207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dd981531200/0xce1582440fb1ed01 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263830.067554:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaaea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de026c8f-6636-4fc7-8061-42c8092f00f0+22:3621:x1876178898130176:12345-0@lo:103:ldlm_bl.0 Request processed in 283us (415us total) trans 0 rc 0/0 00010000:00010000:2.0:1789263830.067560:0:17207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd981531200/0xce1582440fb1ed01 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263830.067568:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789263830.067593:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd884aced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:de026c8f-6636-4fc7-8061-42c8092f00f0:3621:1876178898130176:0@lo:103:ldlm_bl.0 00000001:00000004:1.0:1789263830.068204:0:19509:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1789263830.072217:0:19509:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1789263830.072226:0:19509:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1789263830.072271:0:19509:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789263830.072336:0:19509:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.120@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789263830.072361:0:19509:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1789263830.072379:0:19509:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1789263830.073432:0:19509:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789263830.073731:0:19509:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789263830.317192:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789263830.429507:0:19577:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789263830.429757:0:19577:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789263831.341342:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789263831.341748:0:17950:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1789263831.597173:0:17189:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789263831.597182:0:17189:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9dd9b7a92000 from 10 10000000:01000000:0.0:1789263831.597189:0:17189:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789263831.597250:0:17189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883e73000/0xce1582440fb1ed08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263831.597263:0:17189:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd883e73000/0xce1582440fb1ed08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263831.597288:0:17189:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd883e73000/0xce1582440fb1ed08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263831.597320:0:17189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de026c8f-6636-4fc7-8061-42c8092f00f0:17189:1876178898130304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789263831.597425:0:17189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263831.597465:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898130304 00000100:00100000:1.0:1789263831.597475:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898130304 00000100:00100000:0.0:1789263831.597479:0:17189:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd882616f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789263831.597547:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789263831.597558:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98738a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de026c8f-6636-4fc7-8061-42c8092f00f0+22:17189:x1876178898130304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789263831.597574:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263831.597592:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd883f58e00/0xce1582440fb1ed0f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1ed08 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263831.597615:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd883f58e00/0xce1582440fb1ed0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1ed08 expref: 23 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263831.597622:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd883f58e00/0xce1582440fb1ed0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1ed08 expref: 23 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263831.597630:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd883f58e00, rc 0) 00000100:00100000:1.0:1789263831.597677:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98738a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de026c8f-6636-4fc7-8061-42c8092f00f0+23:17189:x1876178898130304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263831.597684:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789263831.597728:0:17189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de026c8f-6636-4fc7-8061-42c8092f00f0:17189:1876178898130304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789263831.597752:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd883e73000/0xce1582440fb1ed08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1ed0f expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263831.597762:0:17189:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd883e73000/0xce1582440fb1ed08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1ed0f expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263831.597844:0:17189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de026c8f-6636-4fc7-8061-42c8092f00f0:17189:1876178898130432:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789263831.597890:0:17189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263831.597912:0:17189:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd882616f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789263831.597939:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898130432 00000100:00100000:1.0:1789263831.597943:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898130432 00000100:00100000:1.0:1789263831.597977:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789263831.597985:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd987389450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+23:17189:x1876178898130432:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789263831.598002:0:17185:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789263831.598026:0:17185:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789263831.598029:0:17185:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:1.0:1789263831.598175:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd987389450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+23:17189:x1876178898130432:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 191us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263831.598186:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789263831.598246:0:17189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de026c8f-6636-4fc7-8061-42c8092f00f0:17189:1876178898130432:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789263831.598323:0:17189:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789263831.598340:0:17189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883e73000/0xce1582440fb1ed08 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1ed0f expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263831.598350:0:17189:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd883e73000/0xce1582440fb1ed08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1ed0f expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789263831.598361:0:17189:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789263831.598363:0:17189:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9dd882a35000 from 10 10000000:01000000:0.0:1789263831.598365:0:17189:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789263831.598390:0:17189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883e73c00/0xce1582440fb1ed16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263831.598399:0:17189:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd883e73c00/0xce1582440fb1ed16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263831.598407:0:17189:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd883e73c00/0xce1582440fb1ed16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263831.598421:0:17189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de026c8f-6636-4fc7-8061-42c8092f00f0:17189:1876178898130560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789263831.598450:0:17189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263831.598474:0:17189:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd882616f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789263831.598499:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898130560 00000100:00100000:1.0:1789263831.598504:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898130560 00000100:00100000:1.0:1789263831.598532:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789263831.598539:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98738b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de026c8f-6636-4fc7-8061-42c8092f00f0+23:17189:x1876178898130560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789263831.598548:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263831.598558:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd883f58800/0xce1582440fb1ed1d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1ed16 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263831.598577:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd883f58800/0xce1582440fb1ed1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1ed16 expref: 24 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263831.598589:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd883f58800/0xce1582440fb1ed1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1ed16 expref: 24 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263831.598597:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd883f58800, rc 0) 00000100:00100000:1.0:1789263831.598632:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98738b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de026c8f-6636-4fc7-8061-42c8092f00f0+24:17189:x1876178898130560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263831.598639:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789263831.598671:0:17189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de026c8f-6636-4fc7-8061-42c8092f00f0:17189:1876178898130560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789263831.598689:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd883e73c00/0xce1582440fb1ed16 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1ed1d expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263831.598697:0:17189:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd883e73c00/0xce1582440fb1ed16 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1ed1d expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263831.598734:0:17189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de026c8f-6636-4fc7-8061-42c8092f00f0:17189:1876178898130688:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789263831.598775:0:17189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263831.598791:0:17189:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd882616f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789263831.598881:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898130688 00000100:00100000:1.0:1789263831.598886:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898130688 00000100:00100000:1.0:1789263831.598921:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789263831.598931:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98738b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+24:17189:x1876178898130688:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789263831.598942:0:17185:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789263831.598954:0:17185:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789263831.598961:0:17185:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:1.0:1789263831.599063:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98738b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+24:17189:x1876178898130688:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 132us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263831.599071:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789263831.599127:0:17189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de026c8f-6636-4fc7-8061-42c8092f00f0:17189:1876178898130688:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789263831.599212:0:17189:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789263831.599222:0:17189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883e73c00/0xce1582440fb1ed16 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1ed1d expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263831.599233:0:17189:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd883e73c00/0xce1582440fb1ed16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1ed1d expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:02000400:2.0:1789263832.349696:0:19866:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg320-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789263832.366280:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789263832.728268:0:19919:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789263832.728465:0:19919:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:2.0:1789263833.088814:0:19969:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789263833.089030:0:19969:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1789263833.180498:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263833.180584:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888660096 00000100:00100000:1.0:1789263833.180595:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888660096 00000100:00100000:1.0:1789263833.180640:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 107 00000100:00100000:1.0:1789263833.180650:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd987389850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2396:x1876178888660096:12345-192.168.203.20@tcp:250:mount.lustre.0 00010000:00080000:1.0:1789263833.180679:0:17186:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from f9c31cd1-b03c-4865-98dc-92dea6862336@192.168.203.20@tcp t0 exp 0000000000000000 cur 275 last 0 00000020:00000080:1.0:1789263833.180709:0:17186:0:(genops.c:1385:class_connect()) connect: client f9c31cd1-b03c-4865-98dc-92dea6862336, cookie 0xce1582440fb1ed24 00000100:00080000:1.0:1789263833.180842:0:17186:0:(import.c:65:import_set_state_nolock()) ffff9dd883fdf000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789263833.180907:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd987389850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9c31cd1-b03c-4865-98dc-92dea6862336+5:2396:x1876178888660096:12345-192.168.203.20@tcp:250:mount.lustre.0 Request processed in 257us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263833.180915:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 107 00000100:00100000:2.0:1789263833.185253:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263833.185330:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888660224 00000100:00100000:1.0:1789263833.185340:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888660224 00000100:00100000:1.0:1789263833.185392:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 108 00000100:00100000:1.0:1789263833.185403:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98738b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9c31cd1-b03c-4865-98dc-92dea6862336+5:14868:x1876178888660224:12345-192.168.203.20@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789263833.185419:0:17185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263833.185435:0:17185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd883f59000/0xce1582440fb1ed2b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b612752c1d1207b expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263833.185484:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd883f59000/0xce1582440fb1ed2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1207b expref: 6 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263833.185496:0:17185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd883f59000/0xce1582440fb1ed2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1207b expref: 6 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263833.185517:0:17185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd883f59000, rc 0) 00000100:00100000:1.0:1789263833.185580:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98738b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9c31cd1-b03c-4865-98dc-92dea6862336+6:14868:x1876178888660224:12345-192.168.203.20@tcp:101:mount.lustre.0 Request processed in 179us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263833.185588:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 108 00000100:00100000:0.0:1789263833.187215:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263833.187266:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888660352 00000100:00100000:1.0:1789263833.187274:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888660352 00000100:00100000:1.0:1789263833.187316:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 109 00000100:00100000:1.0:1789263833.187325:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd987388050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9c31cd1-b03c-4865-98dc-92dea6862336+6:14868:x1876178888660352:12345-192.168.203.20@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789263833.187431:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd987388050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9c31cd1-b03c-4865-98dc-92dea6862336+6:14868:x1876178888660352:12345-192.168.203.20@tcp:501:mount.lustre.0 Request processed in 106us (218us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789263833.187440:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 109 00000100:00100000:2.0:1789263833.189071:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263833.189129:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888660480 00000100:00100000:1.0:1789263833.189136:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888660480 00000100:00100000:1.0:1789263833.189173:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 110 00000100:00100000:1.0:1789263833.189179:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd987388850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9c31cd1-b03c-4865-98dc-92dea6862336+6:14868:x1876178888660480:12345-192.168.203.20@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789263833.189191:0:17185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263833.189204:0:17185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd883f59c00/0xce1582440fb1ed32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b612752c1d12082 expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263833.189229:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd883f59c00/0xce1582440fb1ed32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12082 expref: 7 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263833.189240:0:17185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd883f59c00/0xce1582440fb1ed32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12082 expref: 7 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263833.189248:0:17185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd883f59c00, rc 0) 00000100:00100000:1.0:1789263833.189310:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd987388850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9c31cd1-b03c-4865-98dc-92dea6862336+7:14868:x1876178888660480:12345-192.168.203.20@tcp:101:mount.lustre.0 Request processed in 131us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263833.189317:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 110 00000100:00100000:2.0:1789263833.191068:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263833.191249:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888660608 00000100:00100000:1.0:1789263833.191271:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888660608 00000100:00100000:1.0:1789263833.191323:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 111 00000100:00100000:1.0:1789263833.191334:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98738a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9c31cd1-b03c-4865-98dc-92dea6862336+7:14868:x1876178888660608:12345-192.168.203.20@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789263833.191511:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98738a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9c31cd1-b03c-4865-98dc-92dea6862336+8:14868:x1876178888660608:12345-192.168.203.20@tcp:501:mount.lustre.0 Request processed in 179us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263833.191520:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 111 00000100:00100000:0.0:1789263833.193440:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263833.193503:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888660736 00000100:00100000:1.0:1789263833.193512:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888660736 00000100:00100000:1.0:1789263833.193570:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 112 00000100:00100000:1.0:1789263833.193588:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd987388450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9c31cd1-b03c-4865-98dc-92dea6862336+8:14868:x1876178888660736:12345-192.168.203.20@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789263833.193734:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd987388450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9c31cd1-b03c-4865-98dc-92dea6862336+8:14868:x1876178888660736:12345-192.168.203.20@tcp:503:mount.lustre.0 Request processed in 143us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263833.193743:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 112 00000100:00100000:2.0:1789263833.196978:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263833.197039:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888660864 00000100:00100000:1.0:1789263833.197049:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888660864 00000100:00100000:1.0:1789263833.197126:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 113 00000100:00100000:1.0:1789263833.197138:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98738bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9c31cd1-b03c-4865-98dc-92dea6862336+8:14886:x1876178888660864:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789263833.197298:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98738bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9c31cd1-b03c-4865-98dc-92dea6862336+8:14886:x1876178888660864:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 163us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263833.197308:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 113 00000100:00100000:2.0:1789263833.206774:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263833.207156:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888660992 00000100:00100000:1.0:1789263833.207184:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888660992 00000100:00100000:1.0:1789263833.207238:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 114 00000100:00100000:1.0:1789263833.207250:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd987389c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9c31cd1-b03c-4865-98dc-92dea6862336+8:14886:x1876178888660992:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789263833.207422:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd987389c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9c31cd1-b03c-4865-98dc-92dea6862336+8:14886:x1876178888660992:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 174us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263833.207431:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 114 00000100:00100000:0.0:1789263833.209824:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263833.210033:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888661120 00000100:00100000:1.0:1789263833.210042:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888661120 00000100:00100000:1.0:1789263833.210172:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 115 00000100:00100000:1.0:1789263833.210183:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd987388c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9c31cd1-b03c-4865-98dc-92dea6862336+8:14886:x1876178888661120:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789263833.210328:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd987388c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9c31cd1-b03c-4865-98dc-92dea6862336+8:14886:x1876178888661120:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 147us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263833.210334:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 115 00000100:00100000:2.0:1789263833.212427:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263833.213105:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888661248 00000100:00100000:1.0:1789263833.213114:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888661248 00000100:00100000:1.0:1789263833.213158:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 116 00000100:00100000:1.0:1789263833.213167:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd987343c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9c31cd1-b03c-4865-98dc-92dea6862336+8:14868:x1876178888661248:12345-192.168.203.20@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789263833.213184:0:17185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263833.213203:0:17185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd8841a3400/0xce1582440fb1ed39 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b612752c1d120b3 expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263833.213231:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd8841a3400/0xce1582440fb1ed39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d120b3 expref: 9 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263833.213243:0:17185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd8841a3400/0xce1582440fb1ed39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d120b3 expref: 9 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263833.213282:0:17185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd8841a3400, rc 0) 00000100:00100000:1.0:1789263833.213337:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd987343c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9c31cd1-b03c-4865-98dc-92dea6862336+9:14868:x1876178888661248:12345-192.168.203.20@tcp:101:mount.lustre.0 Request processed in 171us (918us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263833.213344:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 116 00000100:00100000:2.0:1789263833.218713:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263833.218803:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888661376 00000100:00100000:1.0:1789263833.218811:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888661376 00000100:00100000:1.0:1789263833.218859:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 117 00000100:00100000:1.0:1789263833.218871:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd987342850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9c31cd1-b03c-4865-98dc-92dea6862336+9:14868:x1876178888661376:12345-192.168.203.20@tcp:256:mount.lustre.0 20000000:01000000:1.0:1789263833.218897:0:17186:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789263833.218920:0:17186:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789263833.218924:0:17186:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789263833.218927:0:17186:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789263833.218931:0:17186:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1789263833.218933:0:17186:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:1.0:1789263833.220617:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd987342850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9c31cd1-b03c-4865-98dc-92dea6862336+9:14868:x1876178888661376:12345-192.168.203.20@tcp:256:mount.lustre.0 Request processed in 1744us (1909us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263833.220626:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 117 00000100:00100000:2.0:1789263833.222546:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263833.222598:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888661504 00000100:00100000:1.0:1789263833.222606:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888661504 00000100:00100000:1.0:1789263833.222644:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 118 00000100:00100000:1.0:1789263833.222651:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd987340450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9c31cd1-b03c-4865-98dc-92dea6862336+9:14868:x1876178888661504:12345-192.168.203.20@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789263833.222666:0:17185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263833.222692:0:17185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd8841a3a00/0xce1582440fb1ed40 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b612752c1d120ba expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263833.222720:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd8841a3a00/0xce1582440fb1ed40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d120ba expref: 10 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263833.222745:0:17185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd8841a3a00/0xce1582440fb1ed40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d120ba expref: 10 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263833.222755:0:17185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd8841a3a00, rc 0) 00000100:00100000:1.0:1789263833.222810:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd987340450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9c31cd1-b03c-4865-98dc-92dea6862336+10:14868:x1876178888661504:12345-192.168.203.20@tcp:101:mount.lustre.0 Request processed in 159us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263833.222818:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 118 00000100:00100000:2.0:1789263833.224130:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263833.224224:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888661632 00000100:00100000:1.0:1789263833.224231:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888661632 00000100:00100000:1.0:1789263833.224281:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 119 00000100:00100000:1.0:1789263833.224290:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd987341c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9c31cd1-b03c-4865-98dc-92dea6862336+10:14868:x1876178888661632:12345-192.168.203.20@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789263833.224425:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd987341c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9c31cd1-b03c-4865-98dc-92dea6862336+10:14868:x1876178888661632:12345-192.168.203.20@tcp:501:mount.lustre.0 Request processed in 136us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263833.224434:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 119 00000100:00100000:0.0:1789263833.225569:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263833.225654:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888661760 00000100:00100000:1.0:1789263833.225661:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888661760 00000100:00100000:1.0:1789263833.225741:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 120 00000100:00100000:1.0:1789263833.225750:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd987342050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9c31cd1-b03c-4865-98dc-92dea6862336+10:14868:x1876178888661760:12345-192.168.203.20@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789263833.225855:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd987342050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9c31cd1-b03c-4865-98dc-92dea6862336+10:14868:x1876178888661760:12345-192.168.203.20@tcp:503:mount.lustre.0 Request processed in 106us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263833.225862:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 120 00000100:00100000:2.0:1789263833.227356:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263833.227579:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888661888 00000100:00100000:1.0:1789263833.227588:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888661888 00000100:00100000:1.0:1789263833.227634:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 121 00000100:00100000:1.0:1789263833.227643:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd987341050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9c31cd1-b03c-4865-98dc-92dea6862336+10:14891:x1876178888661888:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789263833.227768:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd987341050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9c31cd1-b03c-4865-98dc-92dea6862336+10:14891:x1876178888661888:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 126us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263833.227776:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 121 00000100:00100000:2.0:1789263833.229012:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263833.229137:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888662016 00000100:00100000:1.0:1789263833.229144:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888662016 00000100:00100000:1.0:1789263833.229181:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 122 00000100:00100000:1.0:1789263833.229190:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd987340050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9c31cd1-b03c-4865-98dc-92dea6862336+10:14891:x1876178888662016:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789263833.229294:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd987340050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9c31cd1-b03c-4865-98dc-92dea6862336+10:14891:x1876178888662016:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 105us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263833.229302:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 122 00000100:00100000:0.0:1789263833.230983:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263833.231045:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888662144 00000100:00100000:1.0:1789263833.231053:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888662144 00000100:00100000:1.0:1789263833.231117:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 7 00000100:00100000:1.0:1789263833.231125:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883f5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2396:x1876178888662144:12345-192.168.203.20@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789263833.231152:0:17193:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from aea5b0bf-5091-4b59-8387-6d6e4df18cfc@192.168.203.20@tcp t0 exp 0000000000000000 cur 275 last 0 00000100:00100000:1.0:1789263833.231203:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883f5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2396:x1876178888662144:12345-192.168.203.20@tcp:38:mount.lustre.0 Request processed in 79us (225us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789263833.231209:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 7 00000100:00100000:2.0:1789263833.231438:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263833.231481:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888662400 00000100:00100000:0.0:1789263833.231485:0:18722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888662400 00000100:00100000:0.0:1789263833.231508:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 8 00000100:00100000:0.0:1789263833.231512:0:18722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd884aced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2396:x1876178888662400:12345-192.168.203.20@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789263833.231525:0:18722:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from aea5b0bf-5091-4b59-8387-6d6e4df18cfc@192.168.203.20@tcp t0 exp 0000000000000000 cur 275 last 0 00000020:00000080:0.0:1789263833.231556:0:18722:0:(genops.c:1385:class_connect()) connect: client aea5b0bf-5091-4b59-8387-6d6e4df18cfc, cookie 0xce1582440fb1ed47 00000004:00100000:0.0:1789263833.231575:0:18722:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789263833.231756:0:18722:0:(import.c:65:import_set_state_nolock()) ffff9dd987d97000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789263833.231800:0:18722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd884aced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+6:2396:x1876178888662400:12345-192.168.203.20@tcp:38:mount.lustre.0 Request processed in 285us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263833.231807:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 8 00000100:00100000:2.0:1789263833.233464:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263833.233676:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888662528 00000100:00100000:1.0:1789263833.233684:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888662528 00000100:00100000:1.0:1789263833.233751:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 9 00000100:00100000:1.0:1789263833.233760:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd884ace680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+6:0:x1876178888662528:12345-192.168.203.20@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789263833.233786:0:17192:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00080000:0.0:1789263833.233856:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789263833.233865:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd884ace680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+6:0:x1876178888662528:12345-192.168.203.20@tcp:41:mount.lustre.0 Request processed in 105us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263833.233881:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 9 00010000:00010000:3.0:1789263833.389327:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789263833.645319:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898130816:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789263833.645409:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263833.645445:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898130944:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789263833.645483:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263833.645521:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898130944 00000100:00100000:2.0:1789263833.645529:0:18700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898130944 00000100:00100000:3.0:1789263833.645533:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898130816 00000100:00100000:3.0:1789263833.645539:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898130816 00000100:00100000:3.0:1789263833.645578:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789263833.645588:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789263833.645589:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd884acf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1876178898130816:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789263833.645603:0:18700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883f5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1876178898130944:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789263833.645609:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00000024:3.0:1789263833.645613:0:17197:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00002000:00000024:2.0:1789263833.645626:0:18700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789263833.645662:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd884acf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1876178898130816:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263833.645669:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789263833.645696:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898130816:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789263833.645767:0:18700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883f5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1876178898130944:12345-0@lo:13:osp-pre-0-1.0 Request processed in 169us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263833.645773:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789263833.645777:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd883f5d180 x1876178898130944/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789263849 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263833.645789:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898130944:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789263834.413226:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789263834.669342:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789263834.669360:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898131072:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789263834.669420:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263834.669471:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898131072 00000100:00100000:0.0:1789263834.669479:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898131072 00000100:00100000:0.0:1789263834.669525:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789263834.669535:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd884acd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1876178898131072:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789263834.669571:0:17196:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446289408 avail 1300049920 00000100:00100000:0.0:1789263834.669623:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd884acd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1876178898131072:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263834.669630:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789263834.669662:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898131072:0@lo:41:osp-pre-0-1.0 00000100:00080000:1.0:1789263835.181299:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789263835.181306:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789263835.181309:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789263835.181312:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789263835.181326:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898131328:0@lo:400:kworker.0 00000100:00100000:3.0:1789263835.181329:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:de026c8f-6636-4fc7-8061-42c8092f00f0:3621:1876178898131200:0@lo:400:kworker.0 00000100:00080000:1.0:1789263835.181344:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789263835.181348:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789263835.181351:0:38:0:(import.c:65:import_set_state_nolock()) ffff9dd9862e7800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789263835.181361:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9dd9862e7800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:1.0:1789263835.181385:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd98ff7d180 x1876178898131840/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789263835.181426:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263835.181441:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263835.181441:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898131584:0@lo:400:kworker.0 00000100:00100000:0.0:1789263835.181483:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263835.181491:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898131712:0@lo:400:kworker.0 00000100:00100000:2.0:1789263835.181494:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989aec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876178898131968:0@lo:400:kworker.0 00000100:00100000:1.0:1789263835.181511:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1876178898131840:0@lo:8:kworker.0 00000100:00100000:0.0:1789263835.181533:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989aeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1876178898132224:0@lo:400:kworker.0 00000100:00100000:3.0:1789263835.181539:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263835.181546:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263835.181567:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898131200 00000100:00100000:1.0:1789263835.181576:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898131200 00000100:00100000:3.0:1789263835.181580:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989aedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3621:1876178898132352:0@lo:400:kworker.0 00000100:00100000:2.0:1789263835.181584:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989aece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1876178898132480:0@lo:400:kworker.0 00000100:00100000:0.0:1789263835.181586:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263835.181624:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263835.181626:0:18524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898131328 00000100:00100000:1.0:1789263835.181631:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789263835.181631:0:18524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898131328 00000100:00100000:3.0:1789263835.181640:0:18699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898131712 00000100:00100000:1.0:1789263835.181646:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd987343850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de026c8f-6636-4fc7-8061-42c8092f00f0+24:3621:x1876178898131200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263835.181647:0:18699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898131712 00000100:00100000:2.0:1789263835.181651:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789263835.181660:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876178898131456:0@lo:400:kworker.0 00000100:00100000:0.0:1789263835.181663:0:18524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898131584 00000100:00100000:0.0:1789263835.181666:0:18524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898131584 00000100:00100000:0.0:1789263835.181687:0:18524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789263835.181688:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263835.181696:0:18524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd884acdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1876178898131328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789263835.181712:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989aee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1876178898132096:0@lo:400:kworker.0 00000100:00100000:3.0:1789263835.181716:0:18699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789263835.181716:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd987343850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de026c8f-6636-4fc7-8061-42c8092f00f0+24:3621:x1876178898131200:12345-0@lo:400:kworker.0 Request processed in 72us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263835.181728:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1789263835.181733:0:18699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1876178898131712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789263835.181744:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263835.181756:0:18524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd884acdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1876178898131328:12345-0@lo:400:kworker.0 Request processed in 62us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263835.181764:0:18524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789263835.181772:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263835.181776:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898131328:0@lo:400:kworker.0 00000100:00100000:0.0:1789263835.181787:0:18524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789263835.181788:0:18699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1876178898131712:12345-0@lo:400:kworker.0 Request processed in 58us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263835.181797:0:18524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883f5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898131584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263835.181801:0:18699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789263835.181819:0:19302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898131840 00000100:00100000:2.0:1789263835.181825:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898131968 00000100:00100000:1.0:1789263835.181825:0:19302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898131840 00000100:00100000:2.0:1789263835.181832:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898131968 00000100:00100000:0.0:1789263835.181842:0:18524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883f5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898131584:12345-0@lo:400:kworker.0 Request processed in 48us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263835.181853:0:18524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789263835.181854:0:19302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789263835.181857:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898132224 00000100:00100000:3.0:1789263835.181865:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898132224 00000100:00100000:2.0:1789263835.181867:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898132480 00000100:00100000:1.0:1789263835.181871:0:19302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989aef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3617:x1876178898131840:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1789263835.181873:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898132480 00000100:00080000:0.0:1789263835.181873:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789263835.181879:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789263835.181899:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898131456 00000100:00100000:2.0:1789263835.181902:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898132096 00010000:00080000:1.0:1789263835.181902:0:19302:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 277 last 0 00000100:00100000:3.0:1789263835.181904:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898131456 00000100:00100000:0.0:1789263835.181904:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898131584:0@lo:400:kworker.0 00000100:00100000:2.0:1789263835.181907:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898132096 00000100:00080000:0.0:1789263835.181925:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789263835.181936:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789263835.181947:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd884acf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876178898131968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263835.181947:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000020:00000080:1.0:1789263835.181949:0:19302:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xce1582440fb1ed4e 00000100:00100000:3.0:1789263835.181955:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789263835.181956:0:18722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883f5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1876178898132224:12345-0@lo:400:kworker.0 00002000:00100000:1.0:1789263835.181967:0:19302:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9dd883fdb800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 1 ocd_group 1 00000100:00100000:3.0:1789263835.181968:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd884acc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1876178898132480:12345-0@lo:400:kworker.0 00002000:00080000:1.0:1789263835.181973:0:19302:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:1.0:1789263835.181978:0:19302:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1789263835.181994:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd884acf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876178898131968:12345-0@lo:400:kworker.0 Request processed in 50us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263835.181994:0:18722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883f5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1876178898132224:12345-0@lo:400:kworker.0 Request processed in 41us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263835.182002:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789263835.182005:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789263835.182020:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789263835.182025:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd884acc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1876178898132480:12345-0@lo:400:kworker.0 Request processed in 60us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263835.182026:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789263835.182031:0:18722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd884acea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876178898132096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263835.182043:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789263835.182047:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd884acd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876178898131456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263835.182100:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263835.182116:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd884acd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876178898131456:12345-0@lo:400:kworker.0 Request processed in 79us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263835.182119:0:18722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd884acea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876178898132096:12345-0@lo:400:kworker.0 Request processed in 88us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263835.182123:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789263835.182138:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:de026c8f-6636-4fc7-8061-42c8092f00f0:3621:1876178898131200:0@lo:400:kworker.0 00000100:00100000:2.0:1789263835.182139:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898132352 00000100:00100000:0.0:1789263835.182140:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789263835.182152:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898132352 00010000:00080000:3.0:1789263835.182173:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd9bfa65500 x1876178898131712/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789263851 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1789263835.182179:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd989aeed80 x1876178898132224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263851 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789263835.182186:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789263835.182190:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898131712:0@lo:400:kworker.0 00000100:00100000:2.0:1789263835.182195:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1876178898132352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263835.182198:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989aeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1876178898132224:0@lo:400:kworker.0 00000100:00080000:0.0:1789263835.182229:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00002000:00080000:1.0:1789263835.182240:0:19302:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00010000:00080000:3.0:1789263835.182254:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd9bfa64a80 x1876178898131456/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263851 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789263835.182262:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1876178898132352:12345-0@lo:400:kworker.0 Request processed in 51us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263835.182270:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876178898131456:0@lo:400:kworker.0 00000100:00100000:2.0:1789263835.182276:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1789263835.182281:0:19302:0:(import.c:65:import_set_state_nolock()) ffff9dd883fd9000 : changing import state from RECOVER to FULL 00010000:00080000:3.0:1789263835.182295:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd989aee680 x1876178898132096/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263851 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1789263835.182306:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd989aedf80 x1876178898132352/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263851 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263835.182307:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989aee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1876178898132096:0@lo:400:kworker.0 00000100:00100000:0.0:1789263835.182324:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989aedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3621:1876178898132352:0@lo:400:kworker.0 00010000:00080000:3.0:1789263835.182328:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd989aec000 x1876178898131968/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263851 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263835.182338:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989aec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876178898131968:0@lo:400:kworker.0 00000100:00100000:1.0:1789263835.182343:0:19302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989aef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3617:x1876178898131840:12345-0@lo:8:kworker.0 Request processed in 471us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263835.182352:0:19302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1789263835.182360:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd989aece00 x1876178898132480/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263851 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263835.182369:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989aece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1876178898132480:0@lo:400:kworker.0 00010000:00080000:2.0:1789263835.182404:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd98ff7d180 x1876178898131840/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789263855 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789263835.182415:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1789263835.182422:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789263835.182433:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1789263835.182435:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd9862e7800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789263835.182457:0:3617:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789263835.182463:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1876178898131840:0@lo:8:kworker.0 00000004:00080000:0.0:1789263835.182494:0:17933:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789263835.182550:0:17933:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 277472472586ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789263835.182556:0:17933:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:1.0:1789263835.182616:0:17934:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1789263835.182637:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989aefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898132608:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789263835.182639:0:17934:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989aeea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17934:1876178898132736:0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1789263835.182686:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263835.182687:0:17934:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263835.182711:0:17934:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9b7a9ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1789263835.182723:0:18701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898132608 00000100:00100000:2.0:1789263835.182729:0:18701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898132608 00000100:00100000:1.0:1789263835.182751:0:18699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898132736 00000100:00080000:3.0:1789263835.182752:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789263835.182758:0:18699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898132736 00000100:00100000:2.0:1789263835.182774:0:18701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789263835.182783:0:18701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88397ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3619:x1876178898132608:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789263835.182799:0:18699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00002000:00000024:2.0:1789263835.182801:0:18701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789263835.182810:0:18699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989aef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+7:17934:x1876178898132736:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:2.0:1789263835.182844:0:18701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88397ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3619:x1876178898132608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263835.182852:0:18701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789263835.182875:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd989aefb80 x1876178898132608/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789263851 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263835.182893:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989aefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898132608:0@lo:13:osp-pre-1-1.0 00000004:00080000:3.0:1789263835.184120:0:17923:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000001:00100000:3.0:1789263835.184149:0:17923:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of aea5b0bf-5091-4b59-8387-6d6e4df18cfc 00002000:00080000:1.0:1789263835.185807:0:18699:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1789263835.185814:0:18699:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1789263835.185892:0:18699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989aef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17934:x1876178898132736:12345-0@lo:7:osp-pre-1-1.0 Request processed in 3082us (3205us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263835.185900:0:18699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1789263835.185939:0:17934:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd989aeea00 x1876178898132736/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789263851 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263835.185954:0:17934:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989aeea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17934:1876178898132736:0@lo:7:osp-pre-1-1.0 00000004:00080000:3.0:1789263835.185968:0:17934:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1789263835.185999:0:17934:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaaf480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17934:1876178898132864:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1789263835.186028:0:17934:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263835.186054:0:17934:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd98a6fbd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789263835.186103:0:18698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898132864 00000100:00100000:0.0:1789263835.186110:0:18698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898132864 00000100:00100000:0.0:1789263835.186152:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789263835.186162:0:18698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17934:x1876178898132864:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1789263835.186184:0:18698:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:0.0:1789263835.186225:0:18698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17934:x1876178898132864:12345-0@lo:5:osp-pre-1-1.0 Request processed in 66us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263835.186230:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1789263835.186269:0:17934:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd9bfaaf480 x1876178898132864/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789263851 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263835.186280:0:17934:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaaf480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17934:1876178898132864:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1789263835.186289:0:17934:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1789263835.186312:0:17934:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaaf480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17934:1876178898132992:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1789263835.186333:0:17934:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263835.186353:0:17934:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd98a6fbd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789263835.186379:0:18696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898132992 00000100:00100000:0.0:1789263835.186383:0:18696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898132992 00000100:00100000:0.0:1789263835.186407:0:18696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789263835.186414:0:18696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17934:x1876178898132992:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1789263835.186436:0:18696:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00000001:00080000:3.0:1789263835.195879:0:19510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:3.0:1789263835.195890:0:19510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1789263835.196037:0:18696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:17934:x1876178898132992:12345-0@lo:5:osp-pre-1-1.0 Request processed in 9619us (9698us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1789263835.196055:0:18696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1789263835.196115:0:17934:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd9bfaaf480 x1876178898132992/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789263851 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263835.196127:0:17934:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1789263835.196132:0:17934:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaaf480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17934:1876178898132992:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1789263835.196147:0:17934:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1789263835.196205:0:17934:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaaf480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17934:1876178898133120:0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1789263835.196263:0:17934:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263835.196293:0:17934:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd98a6fbd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789263835.196310:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898133120 00000100:00100000:1.0:1789263835.196319:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898133120 00000100:00100000:1.0:1789263835.196368:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789263835.196391:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17934:x1876178898133120:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1789263835.196441:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17934:x1876178898133120:12345-0@lo:900:osp-pre-1-1.0 Request processed in 58us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263835.196449:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789263835.196469:0:17934:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd9bfaaf480 x1876178898133120/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789263851 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263835.196480:0:17934:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaaf480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17934:1876178898133120:0@lo:900:osp-pre-1-1.0 00010000:00010000:3.0:1789263835.437288:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263836.461725:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789263836.525297:0:17227:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789263836.525306:0:17227:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789263836.525449:0:17227:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1789263836.525491:0:17227:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789263836.525633:0:17227:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00010000:00010000:1.0:1789263837.486420:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789263838.253310:0:3617:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789263823/real 1789263823] req@ffff9dd98ff7ed80 x1876178898118912/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789263838 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789263838.253340:0:3617:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9dd98ff7ed80 x1876178898118912/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789263838 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789263838.253353:0:3617:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789263823/real 1789263823] req@ffff9dd98ff7ea00 x1876178898118784/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789263838 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789263838.253366:0:3617:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9dd98ff7ea00 x1876178898118784/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789263838 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789263838.253386:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd9bf998000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789263838.253415:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789263838.253421:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1876178898118912:0@lo:8:kworker.0 00000100:00080000:2.0:1789263838.253430:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd9c088f800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789263838.253436:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789263838.253455:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1876178898118784:0@lo:8:kworker.0 00000100:00100000:0.0:1789263838.253645:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989aed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de026c8f-6636-4fc7-8061-42c8092f00f0:3620:1876178898133248:0@lo:400:kworker.0 00000100:00100000:0.0:1789263838.253742:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263838.253817:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898133248 00000100:00100000:2.0:1789263838.253825:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898133248 00000100:00100000:2.0:1789263838.253883:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1789263838.253890:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd987343050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+24:3620:x1876178898133248:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789263838.254554:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:2.0:1789263838.254567:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd987343050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+24:3620:x1876178898133248:12345-0@lo:400:kworker.0 Request processed in 674us (823us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263838.254578:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989aed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de026c8f-6636-4fc7-8061-42c8092f00f0:3620:1876178898133248:0@lo:400:kworker.0 00000100:00080000:1.0:1789263838.254579:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00100000:2.0:1789263838.254586:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:1.0:1789263838.254590:0:38:0:(import.c:65:import_set_state_nolock()) ffff9dd9c088f800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1789263838.254600:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989aec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898133376:0@lo:400:kworker.0 00000100:00080000:1.0:1789263838.254602:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 265 00000100:00080000:1.0:1789263838.254615:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789263838.254627:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9dd9c088f800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:3.0:1789263838.254658:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263838.254661:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd989aed880 x1876178898133504/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789263838.254694:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789263838.254698:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789263838.254701:0:38:0:(import.c:65:import_set_state_nolock()) ffff9dd9bf998000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1789263838.254706:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898133376 00000100:00080000:1.0:1789263838.254709:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 265 00000100:00100000:2.0:1789263838.254715:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898133376 00000100:00080000:1.0:1789263838.254716:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789263838.254725:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9dd9bf998000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:0.0:1789263838.254731:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989aed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1876178898133504:0@lo:8:kworker.0 00000100:00100000:1.0:1789263838.254745:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd989aec700 x1876178898133632/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789263838.254770:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789263838.254776:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263838.254787:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1876178898133376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263838.254819:0:19302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898133504 00000100:00100000:3.0:1789263838.254826:0:19302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898133504 00000100:00100000:0.0:1789263838.254832:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989aec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1876178898133632:0@lo:8:kworker.0 00000100:00100000:2.0:1789263838.254850:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1876178898133376:12345-0@lo:400:kworker.0 Request processed in 69us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263838.254855:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789263838.254868:0:19302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789263838.254878:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263838.254879:0:19302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88397f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3617:x1876178898133504:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1789263838.254910:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989aec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898133376:0@lo:400:kworker.0 00010000:00080000:3.0:1789263838.254913:0:19302:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 280 last 0 00000100:00100000:0.0:1789263838.254932:0:18698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898133632 00000100:00100000:0.0:1789263838.254938:0:18698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898133632 00000100:00100000:2.0:1789263838.254944:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989aedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898134144:0@lo:400:kworker.0 00000020:00000080:3.0:1789263838.254975:0:19302:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xce1582440fb1ed55 00000100:00100000:0.0:1789263838.254977:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789263838.254991:0:18698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88397ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3617:x1876178898133632:12345-0@lo:8:kworker.0 00002000:00100000:3.0:1789263838.254994:0:19302:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9dd883813000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 0 00000100:00100000:2.0:1789263838.254996:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:3.0:1789263838.255004:0:19302:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1789263838.255008:0:19302:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00010000:00080000:0.0:1789263838.255018:0:18698:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 280 last 0 00000100:00100000:2.0:1789263838.255028:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989aefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3621:1876178898134656:0@lo:400:kworker.0 00000100:00100000:1.0:1789263838.255029:0:18699:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1789263838.255050:0:18699:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000020:00000080:0.0:1789263838.255052:0:18698:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xce1582440fb1ed5c 00002000:00100000:0.0:1789263838.255067:0:18698:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9dd987d93800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1789263838.255071:0:18698:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1789263838.255125:0:18698:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1789263838.255131:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:3.0:1789263838.255152:0:19302:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:2.0:1789263838.255164:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789263838.255178:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989aee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898134016:0@lo:400:kworker.0 00002000:00080000:0.0:1789263838.255188:0:18698:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789263838.255195:0:19302:0:(import.c:65:import_set_state_nolock()) ffff9dd883817800 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1789263838.255208:0:18698:0:(import.c:65:import_set_state_nolock()) ffff9dd987d92800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789263838.255218:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263838.255254:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989aef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876178898133760:0@lo:400:kworker.0 00000100:00100000:2.0:1789263838.255262:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989aeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3621:1876178898134528:0@lo:400:kworker.0 00000100:00100000:3.0:1789263838.255283:0:19302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88397f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3617:x1876178898133504:12345-0@lo:8:kworker.0 Request processed in 404us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263838.255286:0:18698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88397ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3617:x1876178898133632:12345-0@lo:8:kworker.0 Request processed in 297us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263838.255299:0:19302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789263838.255306:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789263838.255322:0:19302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898134144 00000100:00100000:0.0:1789263838.255329:0:18698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898134016 00000100:00100000:1.0:1789263838.255331:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263838.255332:0:19302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898134144 00000100:00100000:0.0:1789263838.255338:0:18698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898134016 00000100:00100000:2.0:1789263838.255361:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898134656 00000100:00100000:2.0:1789263838.255378:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898134656 00000100:00100000:1.0:1789263838.255392:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989aed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876178898134272:0@lo:400:kworker.0 00000100:00100000:3.0:1789263838.255406:0:19302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789263838.255422:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789263838.255424:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898133760 00000100:00100000:3.0:1789263838.255428:0:19302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd884acc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1876178898134144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789263838.255431:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898133760 00000100:00100000:1.0:1789263838.255446:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263838.255447:0:18698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1876178898134016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789263838.255470:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898134272 00000100:00100000:2.0:1789263838.255475:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898134272 00000100:00100000:1.0:1789263838.255487:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989aece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1876178898134784:0@lo:400:kworker.0 00000100:00100000:3.0:1789263838.255505:0:19302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd884acc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1876178898134144:12345-0@lo:400:kworker.0 Request processed in 79us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263838.255505:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789263838.255513:0:18698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1876178898134016:12345-0@lo:400:kworker.0 Request processed in 73us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263838.255522:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1876178898134656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263838.255537:0:19302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789263838.255538:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263838.255554:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1789263838.255574:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789263838.255581:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789263838.255585:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00080000:3.0:1789263838.255586:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789263838.255597:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1876178898134656:12345-0@lo:400:kworker.0 Request processed in 77us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263838.255600:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898134784 00000100:00100000:1.0:1789263838.255602:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989aeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898133888:0@lo:400:kworker.0 00000100:00100000:0.0:1789263838.255608:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898134784 00010000:00080000:3.0:1789263838.255620:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd989aec700 x1876178898133632/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789263858 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789263838.255621:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789263838.255636:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789263838.255643:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00100000:2.0:1789263838.255649:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1789263838.255653:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789263838.255662:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00100000:0.0:1789263838.255663:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789263838.255670:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989aec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876178898133760:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789263838.255671:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd9bf998000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789263838.255674:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263838.255685:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989aee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876178898134272:12345-0@lo:400:kworker.0 00000004:00080000:3.0:1789263838.255701:0:3617:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789263838.255712:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989aec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1876178898133632:0@lo:8:kworker.0 00000100:00100000:1.0:1789263838.255715:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989aed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1876178898134400:0@lo:400:kworker.0 00010000:00080000:3.0:1789263838.255744:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd989aed880 x1876178898133504/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789263858 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789263838.255745:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989aec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876178898133760:12345-0@lo:400:kworker.0 Request processed in 85us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263838.255754:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989aee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876178898134272:12345-0@lo:400:kworker.0 Request processed in 74us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263838.255763:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00100000:2.0:1789263838.255772:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1789263838.255773:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00100000:1.0:1789263838.255780:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789263838.255787:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00100000:0.0:1789263838.255787:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:3.0:1789263838.255794:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1789263838.255799:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd9c088f800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789263838.255815:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898134400 00000004:00080000:3.0:1789263838.255817:0:3617:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789263838.255822:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898134400 00000100:00100000:0.0:1789263838.255825:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789263838.255826:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989aed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1876178898133504:0@lo:8:kworker.0 00010000:00080000:1.0:1789263838.255839:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd989aef800 x1876178898133760/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263854 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263838.255847:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989aedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1876178898134784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789263838.255863:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789263838.255877:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989aef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876178898133760:0@lo:400:kworker.0 00000100:00100000:2.0:1789263838.255883:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989aec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876178898134400:12345-0@lo:400:kworker.0 00000004:00080000:3.0:1789263838.255894:0:17218:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00010000:00080000:1.0:1789263838.255910:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd989aed180 x1876178898134272/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263854 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263838.255924:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989aedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1876178898134784:12345-0@lo:400:kworker.0 Request processed in 85us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263838.255925:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989aed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876178898134272:0@lo:400:kworker.0 00000100:00100000:3.0:1789263838.255929:0:17218:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaaf100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17218:1876178898135040:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1789263838.255942:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989aec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876178898134400:12345-0@lo:400:kworker.0 Request processed in 59us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263838.255953:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1789263838.255960:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd989aece00 x1876178898134784/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263854 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789263838.255961:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789263838.255981:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898133888 00000100:00100000:3.0:1789263838.255988:0:17218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263838.255991:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898133888 00000100:00100000:1.0:1789263838.255994:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989aece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1876178898134784:0@lo:400:kworker.0 00000100:00100000:2.0:1789263838.256000:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263838.256011:0:17218:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd98a6fbd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789263838.256038:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876178898134912:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789263838.256049:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1789263838.256066:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd989aefb80 x1876178898134656/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263854 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263838.256067:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989aeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1876178898133888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789263838.256110:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989aefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3621:1876178898134656:0@lo:400:kworker.0 00010000:00080000:1.0:1789263838.256114:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd989aed500 x1876178898134400/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263854 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1789263838.256132:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd989aedc00 x1876178898134144/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789263854 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263838.256149:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989aeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1876178898133888:12345-0@lo:400:kworker.0 Request processed in 81us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263838.256153:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263838.256175:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989aed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1876178898134400:0@lo:400:kworker.0 00000100:00100000:0.0:1789263838.256176:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789263838.256185:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989aedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898134144:0@lo:400:kworker.0 00000100:00100000:3.0:1789263838.256234:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898134912 00000004:00080000:0.0:1789263838.256235:0:17217:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1789263838.256244:0:18700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898134912 00000100:00100000:1.0:1789263838.256249:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989aeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898133888:0@lo:400:kworker.0 00010000:00080000:2.0:1789263838.256255:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd989aee300 x1876178898134016/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789263854 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789263838.256269:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989aee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898134016:0@lo:400:kworker.0 00000100:00100000:3.0:1789263838.256298:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789263838.256307:0:18701:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000004:00080000:0.0:1789263838.256310:0:17217:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 280546232501ns, next at 0ns, rc = 0 00000100:00100000:3.0:1789263838.256312:0:18700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1876178898134912:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789263838.256320:0:18701:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:1.0:1789263838.256322:0:18699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898135040 00080000:00080000:0.0:1789263838.256324:0:17217:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1789263838.256330:0:18699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898135040 00002000:00000024:3.0:1789263838.256337:0:18700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000004:00080000:0.0:1789263838.256390:0:17216:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:3.0:1789263838.256400:0:18700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3619:x1876178898134912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263838.256402:0:18699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789263838.256417:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789263838.256423:0:18699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:17218:x1876178898135040:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1789263838.256428:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898134528 00000100:00100000:0.0:1789263838.256428:0:17216:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17216:1876178898135296:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1789263838.256438:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898134528 00000100:00100000:2.0:1789263838.256478:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789263838.256483:0:17216:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263838.256492:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1876178898134528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263838.256499:0:17216:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9c0b536c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789263838.256542:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1876178898134528:12345-0@lo:400:kworker.0 Request processed in 53us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263838.256549:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000040:00080000:0.0:1789263838.256578:0:17215:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 9 count 3 00000040:00080000:0.0:1789263838.256602:0:17215:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789263838.256608:0:17215:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000004:00080000:0.0:1789263838.256631:0:17215:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789263838.256679:0:17215:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 280546601556ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789263838.256684:0:17215:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1789263838.256708:0:19302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898135296 00000100:00100000:0.0:1789263838.256711:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898135552:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789263838.256714:0:19302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898135296 00000100:00100000:2.0:1789263838.256752:0:19302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789263838.256760:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789263838.256765:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd9bfaac380 x1876178898134912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789263854 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789263838.256766:0:19302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88397e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17216:x1876178898135296:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1789263838.256790:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876178898134912:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789263838.256800:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898135168:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789263838.256829:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789263838.256832:0:19981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898135552 00000100:00080000:3.0:1789263838.256835:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789263838.256840:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263838.256843:0:19981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898135552 00000100:00080000:3.0:1789263838.256844:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789263838.256854:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789263838.256870:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789263838.256872:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898135168 00000100:00100000:3.0:1789263838.256878:0:18700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898135168 00000100:00100000:0.0:1789263838.256883:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898135424:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789263838.256913:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263838.256954:0:18698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898135424 00000100:00100000:0.0:1789263838.256958:0:18698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898135424 00000100:00100000:0.0:1789263838.256992:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789263838.257009:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789263838.257010:0:18698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88397fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3618:x1876178898135552:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789263838.257025:0:18700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88397df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3620:x1876178898135168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789263838.257043:0:18700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00010000:00080000:0.0:1789263838.257068:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd989aeea00 x1876178898134528/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263854 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263838.257105:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989aeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3621:1876178898134528:0@lo:400:kworker.0 00000100:00100000:3.0:1789263838.257129:0:18700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88397df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3620:x1876178898135168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263838.257146:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1789263838.257191:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd88397c700 x1876178898135168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789263854 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263838.257213:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898135168:0@lo:13:osp-pre-0-0.0 00000004:00080000:3.0:1789263838.258370:0:17172:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00080000:1.0:1789263838.258743:0:18699:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1789263838.258751:0:18699:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1789263838.258755:0:18699:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:33) 00002000:00080000:2.0:1789263838.259357:0:19302:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1789263838.259363:0:19302:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1789263838.259367:0:19302:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:33) 00000004:00080000:0.0:1789263838.259418:0:17172:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000001:00080000:3.0:1789263838.264668:0:18693:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:3.0:1789263838.264694:0:18693:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1789263838.264833:0:18698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88397fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3618:x1876178898135552:12345-0@lo:2:osp-syn-0-0.0 Request processed in 7830us (8073us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1789263838.264848:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789263838.264870:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789263838.264877:0:18698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88397e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3620:x1876178898135424:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789263838.264903:0:18698:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00010000:00080000:1.0:1789263838.264971:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd88397f100 x1876178898135552/t0(0) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1789263854 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1789263838.264984:0:3618:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9dd88397f100, transno 8589934594 00000100:00100000:1.0:1789263838.264994:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000004:00080000:1.0:1789263838.265001:0:3618:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9dd88397f100/2, rc 0, transno 8589934594 00000100:00100000:1.0:1789263838.265007:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898135552:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1789263838.265161:0:18699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789263838.265169:0:18699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aea88dc7/0xce1582440fb1ed63 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.265186:0:18699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=280s v=(0 0) 00010000:00010000:3.0:1789263838.265191:0:18699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789263838.265196:0:18699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aea88dc7/0xce1582440fb1ed63 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.265213:0:18699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aea88dc7/0xce1582440fb1ed63 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.265237:0:18699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aea88dc7/0xce1582440fb1ed63 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.265246:0:18699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aea88dc7/0xce1582440fb1ed63 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.265271:0:18699:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789263838.265313:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789263838.265321:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aea88dc7/0xce1582440fb1ed63 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.265332:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981530800 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:0.0:1789263838.265336:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aea88dc7/0xce1582440fb1ed63 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.265348:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aea88dc7/0xce1582440fb1ed63 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.265369:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aea88dc7/0xce1582440fb1ed63 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.265377:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aea88dc7/0xce1582440fb1ed63 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.265425:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263838.265427:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263838.265429:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789263838.265511:0:18698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88397e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3620:x1876178898135424:12345-0@lo:6:osp-syn-0-0.0 Request processed in 634us (8599us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789263838.265524:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:0.0:1789263838.265550:0:3620:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9dd88397d180, transno 0 00000004:00080000:0.0:1789263838.265556:0:3620:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9dd88397d180/1, rc -2, transno 0 00000100:00100000:0.0:1789263838.265576:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898135424:0@lo:6:osp-syn-0-0.0 00000040:00080000:1.0:1789263838.265652:0:17215:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 1, last_idx 2 00000040:00080000:1.0:1789263838.265669:0:17215:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00002000:00010000:3.0:1789263838.265816:0:18699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789263838.265822:0:18699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002534652b/0xce1582440fb1ed6a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.265830:0:18699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=280s v=(0 0) 00010000:00010000:3.0:1789263838.265834:0:18699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789263838.265839:0:18699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002534652b/0xce1582440fb1ed6a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.265847:0:18699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002534652b/0xce1582440fb1ed6a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.265853:0:18699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002534652b/0xce1582440fb1ed6a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.265859:0:18699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002534652b/0xce1582440fb1ed6a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.265878:0:18699:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789263838.265910:0:17944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789263838.265918:0:17944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002534652b/0xce1582440fb1ed6a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.265928:0:17944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981531a00 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:0.0:1789263838.265932:0:17944:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002534652b/0xce1582440fb1ed6a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.265941:0:17944:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002534652b/0xce1582440fb1ed6a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.265954:0:17944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002534652b/0xce1582440fb1ed6a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.265961:0:17944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002534652b/0xce1582440fb1ed6a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.266041:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263838.266043:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263838.266045:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789263838.266337:0:18699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789263838.266343:0:18699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2a4a5a4/0xce1582440fb1ed71 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.266352:0:18699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=280s v=(0 0) 00010000:00010000:3.0:1789263838.266355:0:18699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789263838.266359:0:18699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2a4a5a4/0xce1582440fb1ed71 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.266379:0:18699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b2a4a5a4/0xce1582440fb1ed71 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.266388:0:18699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2a4a5a4/0xce1582440fb1ed71 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.266396:0:18699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b2a4a5a4/0xce1582440fb1ed71 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.266413:0:18699:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789263838.266437:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263838.266442:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b2a4a5a4/0xce1582440fb1ed71 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.266460:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981530400 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263838.266464:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2a4a5a4/0xce1582440fb1ed71 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.266472:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2a4a5a4/0xce1582440fb1ed71 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.266485:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b2a4a5a4/0xce1582440fb1ed71 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.266493:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b2a4a5a4/0xce1582440fb1ed71 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.266509:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263838.266511:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263838.266512:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789263838.266702:0:18699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789263838.266709:0:18699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d51fd86/0xce1582440fb1ed78 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.266717:0:18699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=280s v=(0 0) 00010000:00010000:3.0:1789263838.266720:0:18699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789263838.266724:0:18699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d51fd86/0xce1582440fb1ed78 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.266733:0:18699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d51fd86/0xce1582440fb1ed78 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.266741:0:18699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d51fd86/0xce1582440fb1ed78 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.266759:0:18699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d51fd86/0xce1582440fb1ed78 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.266774:0:18699:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789263838.266794:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789263838.266801:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d51fd86/0xce1582440fb1ed78 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.266810:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981531600 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:0.0:1789263838.266814:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d51fd86/0xce1582440fb1ed78 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.266830:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d51fd86/0xce1582440fb1ed78 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.266843:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d51fd86/0xce1582440fb1ed78 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.266850:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d51fd86/0xce1582440fb1ed78 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.266865:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263838.266867:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263838.266870:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789263838.267263:0:18699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789263838.267270:0:18699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068b043a3/0xce1582440fb1ed7f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.267279:0:18699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=280s v=(0 0) 00010000:00010000:3.0:1789263838.267282:0:18699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789263838.267286:0:18699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068b043a3/0xce1582440fb1ed7f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.267295:0:18699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068b043a3/0xce1582440fb1ed7f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.267303:0:18699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068b043a3/0xce1582440fb1ed7f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.267310:0:18699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000068b043a3/0xce1582440fb1ed7f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.267331:0:18699:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789263838.267352:0:17944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789263838.267358:0:17944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000068b043a3/0xce1582440fb1ed7f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.267376:0:17944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981530e00 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:0.0:1789263838.267381:0:17944:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000068b043a3/0xce1582440fb1ed7f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.267391:0:17944:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000068b043a3/0xce1582440fb1ed7f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.267404:0:17944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000068b043a3/0xce1582440fb1ed7f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.267424:0:17944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068b043a3/0xce1582440fb1ed7f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.267439:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263838.267442:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263838.267444:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789263838.269285:0:18699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789263838.269295:0:18699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d90bc7f6/0xce1582440fb1ed86 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.269314:0:18699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=280s v=(0 0) 00010000:00010000:3.0:1789263838.269317:0:18699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789263838.269322:0:18699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d90bc7f6/0xce1582440fb1ed86 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.269333:0:18699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d90bc7f6/0xce1582440fb1ed86 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.269350:0:18699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d90bc7f6/0xce1582440fb1ed86 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.269359:0:18699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d90bc7f6/0xce1582440fb1ed86 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.269383:0:18699:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789263838.269403:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263838.269412:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d90bc7f6/0xce1582440fb1ed86 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.269422:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981531200 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263838.269427:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d90bc7f6/0xce1582440fb1ed86 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.269436:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d90bc7f6/0xce1582440fb1ed86 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.269461:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d90bc7f6/0xce1582440fb1ed86 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.269469:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d90bc7f6/0xce1582440fb1ed86 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.269487:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263838.269488:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263838.269490:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789263838.269955:0:18699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789263838.269961:0:18699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001cccf412/0xce1582440fb1ed8d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.269969:0:18699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=280s v=(0 0) 00010000:00010000:3.0:1789263838.269972:0:18699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789263838.269976:0:18699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001cccf412/0xce1582440fb1ed8d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.269986:0:18699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001cccf412/0xce1582440fb1ed8d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.270005:0:18699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001cccf412/0xce1582440fb1ed8d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.270017:0:18699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001cccf412/0xce1582440fb1ed8d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.270040:0:18699:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789263838.270231:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789263838.270238:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001cccf412/0xce1582440fb1ed8d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.270247:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981531000 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:0.0:1789263838.270251:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001cccf412/0xce1582440fb1ed8d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.270259:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001cccf412/0xce1582440fb1ed8d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.270272:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001cccf412/0xce1582440fb1ed8d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.270279:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001cccf412/0xce1582440fb1ed8d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.270294:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263838.270296:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263838.270298:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789263838.270383:0:18699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789263838.270389:0:18699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b24c9ac/0xce1582440fb1ed94 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.270397:0:18699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=280s v=(0 0) 00010000:00010000:3.0:1789263838.270401:0:18699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789263838.270405:0:18699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b24c9ac/0xce1582440fb1ed94 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.270416:0:18699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b24c9ac/0xce1582440fb1ed94 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.270424:0:18699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b24c9ac/0xce1582440fb1ed94 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.270432:0:18699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b24c9ac/0xce1582440fb1ed94 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789263838.270461:0:19302:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789263838.270469:0:19302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b87d9fdc/0xce1582440fb1ed9b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.270480:0:19302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=280s v=(0 0) 00010000:00010000:2.0:1789263838.270490:0:19302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789263838.270493:0:18699:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789263838.270495:0:19302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b87d9fdc/0xce1582440fb1ed9b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.270511:0:19302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b87d9fdc/0xce1582440fb1ed9b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.270520:0:19302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b87d9fdc/0xce1582440fb1ed9b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.270539:0:19302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b87d9fdc/0xce1582440fb1ed9b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.270614:0:17944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789263838.270620:0:19302:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789263838.270622:0:17944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b24c9ac/0xce1582440fb1ed94 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.270631:0:17944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981530c00 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:0.0:1789263838.270635:0:17944:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b24c9ac/0xce1582440fb1ed94 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.270643:0:17944:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b24c9ac/0xce1582440fb1ed94 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.270647:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263838.270655:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b87d9fdc/0xce1582440fb1ed9b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.270659:0:17944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b24c9ac/0xce1582440fb1ed94 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.270671:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bb805800 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:0.0:1789263838.270677:0:17944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b24c9ac/0xce1582440fb1ed94 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.270678:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b87d9fdc/0xce1582440fb1ed9b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.270701:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b87d9fdc/0xce1582440fb1ed9b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.270703:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263838.270707:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263838.270712:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263838.270721:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b87d9fdc/0xce1582440fb1ed9b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.270730:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b87d9fdc/0xce1582440fb1ed9b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.270759:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263838.270761:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263838.270763:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789263838.270793:0:18699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789263838.270799:0:18699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fce086e6/0xce1582440fb1eda2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.270807:0:18699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=280s v=(0 0) 00010000:00010000:3.0:1789263838.270811:0:18699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789263838.270815:0:18699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fce086e6/0xce1582440fb1eda2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.270824:0:18699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fce086e6/0xce1582440fb1eda2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.270832:0:18699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fce086e6/0xce1582440fb1eda2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.270839:0:18699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fce086e6/0xce1582440fb1eda2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.270855:0:18699:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789263838.270887:0:19302:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789263838.270894:0:19302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e4d7b32/0xce1582440fb1eda9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.270904:0:19302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=280s v=(0 0) 00010000:00010000:2.0:1789263838.270907:0:19302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789263838.270911:0:19302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e4d7b32/0xce1582440fb1eda9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.270922:0:19302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e4d7b32/0xce1582440fb1eda9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.270930:0:19302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e4d7b32/0xce1582440fb1eda9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.270945:0:19302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e4d7b32/0xce1582440fb1eda9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.271006:0:19302:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789263838.271016:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789263838.271021:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fce086e6/0xce1582440fb1eda2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.271030:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981530a00 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:0.0:1789263838.271033:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fce086e6/0xce1582440fb1eda2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.271054:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fce086e6/0xce1582440fb1eda2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.271066:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fce086e6/0xce1582440fb1eda2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.271094:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fce086e6/0xce1582440fb1eda2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.271114:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789263838.271118:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e4d7b32/0xce1582440fb1eda9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.271125:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bb804800 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:0.0:1789263838.271129:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e4d7b32/0xce1582440fb1eda9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.271137:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e4d7b32/0xce1582440fb1eda9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.271150:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e4d7b32/0xce1582440fb1eda9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.271157:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e4d7b32/0xce1582440fb1eda9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.271181:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263838.271183:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263838.271185:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789263838.271275:0:19302:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789263838.271283:0:19302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000817d1450/0xce1582440fb1edb0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.271284:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789263838.271293:0:19302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=280s v=(0 0) 00010000:00010000:2.0:1789263838.271297:0:19302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789263838.271301:0:19302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000817d1450/0xce1582440fb1edb0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.271324:0:19302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000817d1450/0xce1582440fb1edb0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.271333:0:19302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000817d1450/0xce1582440fb1edb0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789263838.271336:0:18699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789263838.271346:0:18699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000926f9a9d/0xce1582440fb1edb7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.271348:0:19302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000817d1450/0xce1582440fb1edb0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.271367:0:18699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=280s v=(0 0) 00010000:00010000:0.0:1789263838.271373:0:18699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789263838.271378:0:19302:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789263838.271378:0:18699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000926f9a9d/0xce1582440fb1edb7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.271391:0:18699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000926f9a9d/0xce1582440fb1edb7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.271401:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789263838.271402:0:18699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000926f9a9d/0xce1582440fb1edb7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.271409:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000817d1450/0xce1582440fb1edb0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.271413:0:18699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000926f9a9d/0xce1582440fb1edb7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.271428:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bb805a00 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263838.271434:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000817d1450/0xce1582440fb1edb0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.271445:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000817d1450/0xce1582440fb1edb0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.271459:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000817d1450/0xce1582440fb1edb0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.271467:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000817d1450/0xce1582440fb1edb0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.271476:0:18699:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789263838.271484:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263838.271489:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000926f9a9d/0xce1582440fb1edb7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.271497:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883e72200 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263838.271507:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000926f9a9d/0xce1582440fb1edb7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.271516:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000926f9a9d/0xce1582440fb1edb7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.271529:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000926f9a9d/0xce1582440fb1edb7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.271537:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000926f9a9d/0xce1582440fb1edb7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.271551:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263838.271552:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263838.271589:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263838.271589:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789263838.271773:0:18699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789263838.271779:0:18699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2b5897a/0xce1582440fb1edbe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789263838.271792:0:19302:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789263838.271803:0:19302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081dcba21/0xce1582440fb1edc5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.271804:0:18699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=280s v=(0 0) 00010000:00010000:0.0:1789263838.271808:0:18699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789263838.271812:0:18699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b5897a/0xce1582440fb1edbe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.271832:0:19302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=280s v=(0 0) 00010000:00010000:0.0:1789263838.271834:0:18699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2b5897a/0xce1582440fb1edbe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.271837:0:19302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789263838.271846:0:19302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081dcba21/0xce1582440fb1edc5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.271849:0:18699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2b5897a/0xce1582440fb1edbe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.271862:0:18699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b5897a/0xce1582440fb1edbe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.271867:0:19302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081dcba21/0xce1582440fb1edc5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.271882:0:18699:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789263838.271890:0:19302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081dcba21/0xce1582440fb1edc5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.271897:0:19302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081dcba21/0xce1582440fb1edc5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.271917:0:19302:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789263838.271924:0:17944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789263838.271940:0:17944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2b5897a/0xce1582440fb1edbe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.271943:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263838.271951:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081dcba21/0xce1582440fb1edc5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.271963:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bb805000 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263838.271969:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081dcba21/0xce1582440fb1edc5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.271972:0:17944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883e72800 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:3.0:1789263838.271978:0:17944:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b5897a/0xce1582440fb1edbe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.271983:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081dcba21/0xce1582440fb1edc5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.271986:0:17944:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b5897a/0xce1582440fb1edbe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.272002:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081dcba21/0xce1582440fb1edc5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.272008:0:17944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2b5897a/0xce1582440fb1edbe lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.272026:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263838.272027:0:17944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2b5897a/0xce1582440fb1edbe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.272029:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263838.272033:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263838.272047:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263838.272050:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263838.272051:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789263838.272110:0:19302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081dcba21/0xce1582440fb1edc5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789263838.272179:0:18699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789263838.272185:0:18699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cf4e937/0xce1582440fb1edcc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.272193:0:18699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=280s v=(0 0) 00010000:00010000:0.0:1789263838.272196:0:18699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789263838.272201:0:18699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004cf4e937/0xce1582440fb1edcc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.272210:0:18699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004cf4e937/0xce1582440fb1edcc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.272301:0:18699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cf4e937/0xce1582440fb1edcc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.272308:0:18699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004cf4e937/0xce1582440fb1edcc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.272325:0:18699:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789263838.272349:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263838.272356:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004cf4e937/0xce1582440fb1edcc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.272366:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883e72000 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263838.272370:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004cf4e937/0xce1582440fb1edcc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.272377:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004cf4e937/0xce1582440fb1edcc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.272389:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004cf4e937/0xce1582440fb1edcc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.272396:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004cf4e937/0xce1582440fb1edcc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789263838.272404:0:19302:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789263838.272412:0:19302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4c8d12a/0xce1582440fb1edd3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.272412:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263838.272416:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263838.272419:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789263838.272427:0:19302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=280s v=(0 0) 00010000:00010000:2.0:1789263838.272432:0:19302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789263838.272436:0:19302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4c8d12a/0xce1582440fb1edd3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.272459:0:19302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4c8d12a/0xce1582440fb1edd3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.272468:0:19302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4c8d12a/0xce1582440fb1edd3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.272477:0:19302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d4c8d12a/0xce1582440fb1edd3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.272500:0:19302:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789263838.272577:0:18699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789263838.272583:0:18699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff3deb5b/0xce1582440fb1edda lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.272591:0:18699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=280s v=(0 0) 00010000:00010000:0.0:1789263838.272595:0:18699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789263838.272599:0:18699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff3deb5b/0xce1582440fb1edda lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.272608:0:18699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ff3deb5b/0xce1582440fb1edda lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.272616:0:18699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff3deb5b/0xce1582440fb1edda lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.272623:0:18699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ff3deb5b/0xce1582440fb1edda lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.272633:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263838.272640:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d4c8d12a/0xce1582440fb1edd3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.272660:0:18699:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789263838.272666:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981683000 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263838.272671:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4c8d12a/0xce1582440fb1edd3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.272679:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4c8d12a/0xce1582440fb1edd3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.272689:0:17944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263838.272694:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d4c8d12a/0xce1582440fb1edd3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.272703:0:17944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ff3deb5b/0xce1582440fb1edda lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.272705:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4c8d12a/0xce1582440fb1edd3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.272727:0:17944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883e73400 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:3.0:1789263838.272733:0:17944:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff3deb5b/0xce1582440fb1edda lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.272741:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263838.272742:0:17944:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff3deb5b/0xce1582440fb1edda lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.272745:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263838.272748:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263838.272764:0:17944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ff3deb5b/0xce1582440fb1edda lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.272772:0:17944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff3deb5b/0xce1582440fb1edda lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.272789:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263838.272791:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263838.272793:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789263838.272828:0:19302:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789263838.272835:0:19302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008450f9a9/0xce1582440fb1ede1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.272843:0:19302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=280s v=(0 0) 00010000:00010000:2.0:1789263838.272846:0:19302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789263838.272850:0:19302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008450f9a9/0xce1582440fb1ede1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.272859:0:19302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008450f9a9/0xce1582440fb1ede1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.272866:0:19302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008450f9a9/0xce1582440fb1ede1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.272883:0:19302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008450f9a9/0xce1582440fb1ede1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789263838.272923:0:18699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789263838.272927:0:19302:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789263838.272930:0:18699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e268ea9/0xce1582440fb1ede8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.272940:0:18699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=280s v=(0 0) 00010000:00010000:0.0:1789263838.272943:0:18699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789263838.272949:0:18699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e268ea9/0xce1582440fb1ede8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.272959:0:18699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e268ea9/0xce1582440fb1ede8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.272967:0:18699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e268ea9/0xce1582440fb1ede8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.272975:0:18699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e268ea9/0xce1582440fb1ede8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.273177:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789263838.273183:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008450f9a9/0xce1582440fb1ede1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.273194:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981683a00 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263838.273198:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008450f9a9/0xce1582440fb1ede1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.273207:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008450f9a9/0xce1582440fb1ede1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.273214:0:18699:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789263838.273220:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789263838.273237:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e268ea9/0xce1582440fb1ede8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.273241:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008450f9a9/0xce1582440fb1ede1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.273249:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd987f51400 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263838.273254:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008450f9a9/0xce1582440fb1ede1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.273256:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e268ea9/0xce1582440fb1ede8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.273272:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e268ea9/0xce1582440fb1ede8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.273277:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263838.273281:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263838.273283:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263838.273287:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e268ea9/0xce1582440fb1ede8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789263838.273293:0:19302:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789263838.273296:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e268ea9/0xce1582440fb1ede8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.273302:0:19302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078915044/0xce1582440fb1edef lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.273319:0:19302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=280s v=(0 0) 00010000:00010000:2.0:1789263838.273325:0:19302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789263838.273330:0:19302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078915044/0xce1582440fb1edef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.273332:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263838.273336:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263838.273339:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789263838.273346:0:19302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078915044/0xce1582440fb1edef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.273356:0:19302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078915044/0xce1582440fb1edef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.273364:0:19302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078915044/0xce1582440fb1edef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.273380:0:19302:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789263838.273396:0:17944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789263838.273402:0:17944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078915044/0xce1582440fb1edef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.273410:0:17944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981683e00 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:3.0:1789263838.273415:0:17944:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078915044/0xce1582440fb1edef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.273424:0:17944:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078915044/0xce1582440fb1edef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.273441:0:17944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078915044/0xce1582440fb1edef lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.273448:0:17944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078915044/0xce1582440fb1edef lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789263838.273471:0:18699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789263838.273474:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263838.273477:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263838.273479:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263838.273480:0:18699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3db4415/0xce1582440fb1edf6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.273490:0:18699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=280s v=(0 0) 00010000:00010000:0.0:1789263838.273498:0:18699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789263838.273503:0:18699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3db4415/0xce1582440fb1edf6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.273512:0:18699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f3db4415/0xce1582440fb1edf6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.273520:0:18699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3db4415/0xce1582440fb1edf6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.273527:0:18699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f3db4415/0xce1582440fb1edf6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.273543:0:18699:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789263838.273563:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263838.273569:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f3db4415/0xce1582440fb1edf6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.273577:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd987f50000 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263838.273581:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3db4415/0xce1582440fb1edf6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.273590:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3db4415/0xce1582440fb1edf6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.273602:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f3db4415/0xce1582440fb1edf6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.273611:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3db4415/0xce1582440fb1edf6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789263838.273635:0:19302:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789263838.273637:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263838.273641:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789263838.273642:0:19302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085a6aae7/0xce1582440fb1edfd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.273643:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789263838.273659:0:19302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=280s v=(0 0) 00010000:00010000:2.0:1789263838.273662:0:19302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789263838.273667:0:19302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085a6aae7/0xce1582440fb1edfd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.273677:0:19302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085a6aae7/0xce1582440fb1edfd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.273686:0:19302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085a6aae7/0xce1582440fb1edfd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.273693:0:19302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000085a6aae7/0xce1582440fb1edfd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.273713:0:19302:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789263838.273762:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789263838.273769:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000085a6aae7/0xce1582440fb1edfd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.273788:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981683c00 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:3.0:1789263838.273792:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000085a6aae7/0xce1582440fb1edfd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.273799:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000085a6aae7/0xce1582440fb1edfd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.273810:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000085a6aae7/0xce1582440fb1edfd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.273817:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085a6aae7/0xce1582440fb1edfd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.273836:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263838.273838:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263838.273840:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789263838.273868:0:18699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789263838.273874:0:18699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005dc3a247/0xce1582440fb1ee04 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.273883:0:18699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=280s v=(0 0) 00010000:00010000:0.0:1789263838.273886:0:18699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789263838.273890:0:18699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005dc3a247/0xce1582440fb1ee04 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.273899:0:18699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005dc3a247/0xce1582440fb1ee04 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.273906:0:18699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005dc3a247/0xce1582440fb1ee04 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789263838.273912:0:19302:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789263838.273917:0:19302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048d4fbec/0xce1582440fb1ee0b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.273919:0:18699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005dc3a247/0xce1582440fb1ee04 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.273925:0:19302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=280s v=(0 0) 00010000:00010000:2.0:1789263838.273927:0:19302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789263838.273930:0:19302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000048d4fbec/0xce1582440fb1ee0b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.273939:0:19302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000048d4fbec/0xce1582440fb1ee0b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.273953:0:18699:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789263838.273957:0:19302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048d4fbec/0xce1582440fb1ee0b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.273964:0:19302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000048d4fbec/0xce1582440fb1ee0b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.273981:0:19302:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789263838.274025:0:17944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789263838.274027:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789263838.274032:0:17944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005dc3a247/0xce1582440fb1ee04 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.274035:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000048d4fbec/0xce1582440fb1ee0b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.274051:0:17944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd987f50400 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263838.274054:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981683200 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:3.0:1789263838.274057:0:17944:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005dc3a247/0xce1582440fb1ee04 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.274060:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000048d4fbec/0xce1582440fb1ee0b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.274098:0:17944:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005dc3a247/0xce1582440fb1ee04 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.274102:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000048d4fbec/0xce1582440fb1ee0b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.274129:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000048d4fbec/0xce1582440fb1ee0b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.274132:0:17944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005dc3a247/0xce1582440fb1ee04 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.274146:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000048d4fbec/0xce1582440fb1ee0b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.274147:0:17944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005dc3a247/0xce1582440fb1ee04 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.274179:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789263838.274183:0:19302:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789263838.274184:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263838.274185:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263838.274191:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263838.274192:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789263838.274192:0:18699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789263838.274193:0:19302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f6138d7/0xce1582440fb1ee12 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.274195:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263838.274199:0:18699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012367ff8/0xce1582440fb1ee19 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.274204:0:19302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=280s v=(0 0) 00010000:00010000:0.0:1789263838.274206:0:18699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=280s v=(0 0) 00010000:00010000:2.0:1789263838.274207:0:19302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789263838.274209:0:18699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789263838.274211:0:19302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f6138d7/0xce1582440fb1ee12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.274212:0:18699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012367ff8/0xce1582440fb1ee19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.274233:0:19302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f6138d7/0xce1582440fb1ee12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.274234:0:18699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000012367ff8/0xce1582440fb1ee19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.274244:0:19302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f6138d7/0xce1582440fb1ee12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.274244:0:18699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012367ff8/0xce1582440fb1ee19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.274252:0:19302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f6138d7/0xce1582440fb1ee12 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.274252:0:18699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000012367ff8/0xce1582440fb1ee19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.274271:0:18699:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789263838.274276:0:19302:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789263838.274282:0:17944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789263838.274288:0:17944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000012367ff8/0xce1582440fb1ee19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.274299:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789263838.274307:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f6138d7/0xce1582440fb1ee12 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.274314:0:17944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd987f51000 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263838.274321:0:17944:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000012367ff8/0xce1582440fb1ee19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.274323:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981682600 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:3.0:1789263838.274330:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f6138d7/0xce1582440fb1ee12 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.274334:0:17944:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000012367ff8/0xce1582440fb1ee19 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.274347:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f6138d7/0xce1582440fb1ee12 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.274354:0:17944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000012367ff8/0xce1582440fb1ee19 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.274366:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f6138d7/0xce1582440fb1ee12 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.274366:0:17944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000012367ff8/0xce1582440fb1ee19 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.274389:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f6138d7/0xce1582440fb1ee12 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.274396:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263838.274399:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263838.274400:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263838.274421:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263838.274423:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263838.274425:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789263838.274680:0:19302:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789263838.274685:0:19302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000029952b1/0xce1582440fb1ee20 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.274693:0:19302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=280s v=(0 0) 00010000:00010000:2.0:1789263838.274696:0:19302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789263838.274700:0:19302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000029952b1/0xce1582440fb1ee20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.274709:0:19302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000029952b1/0xce1582440fb1ee20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.274718:0:19302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000029952b1/0xce1582440fb1ee20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.274726:0:19302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000029952b1/0xce1582440fb1ee20 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.274749:0:19302:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789263838.274836:0:18699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789263838.274842:0:18699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000323a167/0xce1582440fb1ee27 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.274856:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789263838.274856:0:18699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=280s v=(0 0) 00010000:00010000:0.0:1789263838.274859:0:18699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789263838.274860:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000029952b1/0xce1582440fb1ee20 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.274863:0:18699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000323a167/0xce1582440fb1ee27 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.274868:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981683400 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263838.274872:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000029952b1/0xce1582440fb1ee20 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.274873:0:18699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000323a167/0xce1582440fb1ee27 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.274881:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000029952b1/0xce1582440fb1ee20 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.274881:0:18699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000323a167/0xce1582440fb1ee27 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.274890:0:18699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000323a167/0xce1582440fb1ee27 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.274896:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000029952b1/0xce1582440fb1ee20 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.274903:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000029952b1/0xce1582440fb1ee20 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.274912:0:18699:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789263838.274919:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263838.274922:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000323a167/0xce1582440fb1ee27 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.274929:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd987f51e00 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263838.274932:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000323a167/0xce1582440fb1ee27 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.274939:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000323a167/0xce1582440fb1ee27 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.274949:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000323a167/0xce1582440fb1ee27 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.274957:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000323a167/0xce1582440fb1ee27 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.274969:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263838.274970:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263838.274976:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789263838.275046:0:19302:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789263838.275052:0:19302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f22cf00f/0xce1582440fb1ee2e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.275059:0:19302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=280s v=(0 0) 00010000:00010000:2.0:1789263838.275067:0:19302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789263838.275071:0:19302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f22cf00f/0xce1582440fb1ee2e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.275172:0:19302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f22cf00f/0xce1582440fb1ee2e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.275181:0:19302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f22cf00f/0xce1582440fb1ee2e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.275188:0:19302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f22cf00f/0xce1582440fb1ee2e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.275247:0:19302:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789263838.275248:0:18699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789263838.275253:0:18699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014dcc16d/0xce1582440fb1ee35 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.275261:0:18699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=280s v=(0 0) 00010000:00010000:0.0:1789263838.275264:0:18699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789263838.275267:0:18699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014dcc16d/0xce1582440fb1ee35 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.275276:0:18699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014dcc16d/0xce1582440fb1ee35 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.275294:0:18699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014dcc16d/0xce1582440fb1ee35 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.275313:0:18699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014dcc16d/0xce1582440fb1ee35 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.275337:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789263838.275342:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f22cf00f/0xce1582440fb1ee2e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.275349:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981682000 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263838.275353:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f22cf00f/0xce1582440fb1ee2e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.275360:0:17944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263838.275360:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f22cf00f/0xce1582440fb1ee2e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.275364:0:17944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014dcc16d/0xce1582440fb1ee35 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.275371:0:17944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd987f51200 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263838.275372:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f22cf00f/0xce1582440fb1ee2e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.275375:0:17944:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014dcc16d/0xce1582440fb1ee35 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.275382:0:17944:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014dcc16d/0xce1582440fb1ee35 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.275389:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f22cf00f/0xce1582440fb1ee2e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.275393:0:17944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014dcc16d/0xce1582440fb1ee35 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.275400:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263838.275401:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263838.275402:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263838.275403:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263838.275404:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263838.275405:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263838.275574:0:18699:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789263838.275578:0:18699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014dcc16d/0xce1582440fb1ee35 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789263838.275679:0:19302:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789263838.275685:0:19302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003cca28ac/0xce1582440fb1ee3c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.275690:0:19302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=280s v=(0 0) 00010000:00010000:2.0:1789263838.275692:0:19302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789263838.275695:0:19302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003cca28ac/0xce1582440fb1ee3c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.275701:0:19302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003cca28ac/0xce1582440fb1ee3c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.275706:0:19302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003cca28ac/0xce1582440fb1ee3c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.275715:0:19302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003cca28ac/0xce1582440fb1ee3c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.275727:0:19302:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789263838.275745:0:17944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789263838.275750:0:17944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003cca28ac/0xce1582440fb1ee3c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.275757:0:17944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981682200 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:3.0:1789263838.275760:0:17944:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003cca28ac/0xce1582440fb1ee3c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.275780:0:17944:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003cca28ac/0xce1582440fb1ee3c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.275793:0:17944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003cca28ac/0xce1582440fb1ee3c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.275800:0:17944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003cca28ac/0xce1582440fb1ee3c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.275817:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263838.275819:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263838.275821:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263838.275828:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789263838.275833:0:18699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789263838.275839:0:18699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c511f185/0xce1582440fb1ee43 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.275846:0:18699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=280s v=(0 0) 00010000:00010000:0.0:1789263838.275848:0:18699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789263838.275851:0:18699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c511f185/0xce1582440fb1ee43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.275858:0:18699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c511f185/0xce1582440fb1ee43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.275863:0:18699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c511f185/0xce1582440fb1ee43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.275875:0:18699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c511f185/0xce1582440fb1ee43 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.275888:0:18699:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789263838.275942:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263838.275947:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c511f185/0xce1582440fb1ee43 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.275953:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd987f50600 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263838.275955:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c511f185/0xce1582440fb1ee43 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.275973:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c511f185/0xce1582440fb1ee43 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.275985:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c511f185/0xce1582440fb1ee43 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.275993:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c511f185/0xce1582440fb1ee43 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789263838.275994:0:19302:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789263838.276006:0:19302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000878f705/0xce1582440fb1ee4a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.276014:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789263838.276017:0:19302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=280s v=(0 0) 00010000:00010000:1.0:1789263838.276018:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263838.276021:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789263838.276023:0:19302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789263838.276029:0:19302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000878f705/0xce1582440fb1ee4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.276038:0:19302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000878f705/0xce1582440fb1ee4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.276046:0:19302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000878f705/0xce1582440fb1ee4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.276053:0:19302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000878f705/0xce1582440fb1ee4a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.276074:0:19302:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789263838.276159:0:17944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789263838.276165:0:17944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000878f705/0xce1582440fb1ee4a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.276172:0:17944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981683800 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:3.0:1789263838.276176:0:17944:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000878f705/0xce1582440fb1ee4a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.276193:0:17944:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000878f705/0xce1582440fb1ee4a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789263838.276234:0:18699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789263838.276242:0:18699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086271342/0xce1582440fb1ee51 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.276250:0:17944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000878f705/0xce1582440fb1ee4a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.276251:0:18699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=280s v=(0 0) 00010000:00010000:0.0:1789263838.276259:0:18699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789263838.276266:0:18699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000086271342/0xce1582440fb1ee51 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.276283:0:18699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000086271342/0xce1582440fb1ee51 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.276284:0:17944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000878f705/0xce1582440fb1ee4a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.276302:0:18699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086271342/0xce1582440fb1ee51 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.276308:0:18699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000086271342/0xce1582440fb1ee51 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.276312:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263838.276315:0:17944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789263838.276319:0:17944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000086271342/0xce1582440fb1ee51 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.276326:0:17944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd987f51600 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:3.0:1789263838.276329:0:17944:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000086271342/0xce1582440fb1ee51 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.276337:0:17944:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000086271342/0xce1582440fb1ee51 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.276354:0:17944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000086271342/0xce1582440fb1ee51 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.276362:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263838.276364:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263838.276368:0:18699:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789263838.276372:0:18699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000086271342/0xce1582440fb1ee51 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789263838.276454:0:19302:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789263838.276460:0:19302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003788306f/0xce1582440fb1ee58 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.276475:0:19302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=280s v=(0 0) 00010000:00010000:2.0:1789263838.276478:0:19302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789263838.276483:0:19302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003788306f/0xce1582440fb1ee58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.276493:0:19302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003788306f/0xce1582440fb1ee58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.276497:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263838.276497:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789263838.276504:0:19302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003788306f/0xce1582440fb1ee58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.276511:0:19302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003788306f/0xce1582440fb1ee58 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.276525:0:19302:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789263838.276534:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263838.276540:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003788306f/0xce1582440fb1ee58 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.276549:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981683600 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263838.276553:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003788306f/0xce1582440fb1ee58 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.276562:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003788306f/0xce1582440fb1ee58 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.276576:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003788306f/0xce1582440fb1ee58 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.276596:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003788306f/0xce1582440fb1ee58 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.276612:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263838.276614:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263838.276617:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789263838.276675:0:18699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789263838.276679:0:18699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059e7522e/0xce1582440fb1ee5f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.276685:0:18699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=280s v=(0 0) 00010000:00010000:0.0:1789263838.276687:0:18699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789263838.276690:0:18699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059e7522e/0xce1582440fb1ee5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.276697:0:18699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059e7522e/0xce1582440fb1ee5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.276705:0:18699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059e7522e/0xce1582440fb1ee5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.276712:0:18699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000059e7522e/0xce1582440fb1ee5f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.276725:0:18699:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789263838.276821:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263838.276825:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000059e7522e/0xce1582440fb1ee5f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.276833:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd987f50200 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263838.276837:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000059e7522e/0xce1582440fb1ee5f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.276845:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000059e7522e/0xce1582440fb1ee5f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.276856:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000059e7522e/0xce1582440fb1ee5f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.276860:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059e7522e/0xce1582440fb1ee5f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.276870:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263838.276871:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263838.276872:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789263838.277335:0:19302:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789263838.277347:0:19302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028307810/0xce1582440fb1ee66 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.277357:0:19302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=280s v=(0 0) 00010000:00010000:2.0:1789263838.277361:0:19302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00002000:00010000:0.0:1789263838.277364:0:18699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789263838.277365:0:19302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028307810/0xce1582440fb1ee66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.277373:0:18699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000644b5758/0xce1582440fb1ee6d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.277379:0:19302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028307810/0xce1582440fb1ee66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.277384:0:18699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=280s v=(0 0) 00010000:00010000:0.0:1789263838.277390:0:18699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789263838.277403:0:18699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000644b5758/0xce1582440fb1ee6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.277409:0:19302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028307810/0xce1582440fb1ee66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.277412:0:18699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000644b5758/0xce1582440fb1ee6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.277427:0:19302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028307810/0xce1582440fb1ee66 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.277431:0:18699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000644b5758/0xce1582440fb1ee6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.277443:0:18699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000644b5758/0xce1582440fb1ee6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.277448:0:19302:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789263838.277475:0:17944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789263838.277481:0:17944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028307810/0xce1582440fb1ee66 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.277490:0:17944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bfa22200 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263838.277494:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263838.277500:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000644b5758/0xce1582440fb1ee6d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.277508:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd987f51c00 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263838.277511:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000644b5758/0xce1582440fb1ee6d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.277519:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000644b5758/0xce1582440fb1ee6d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.277531:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000644b5758/0xce1582440fb1ee6d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.277539:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263838.277542:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263838.277544:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263838.277564:0:18699:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789263838.277570:0:18699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000644b5758/0xce1582440fb1ee6d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.277833:0:17944:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028307810/0xce1582440fb1ee66 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.277843:0:17944:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028307810/0xce1582440fb1ee66 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.277859:0:17944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028307810/0xce1582440fb1ee66 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789263838.277867:0:19302:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789263838.277869:0:17944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028307810/0xce1582440fb1ee66 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.277875:0:19302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034151765/0xce1582440fb1ee74 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.277888:0:19302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=280s v=(0 0) 00010000:00010000:2.0:1789263838.277891:0:19302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789263838.277896:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789263838.277896:0:19302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034151765/0xce1582440fb1ee74 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.277902:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789263838.277907:0:18699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789263838.277909:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789263838.277909:0:19302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034151765/0xce1582440fb1ee74 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.277917:0:18699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099a0cc86/0xce1582440fb1ee7b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.277923:0:19302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034151765/0xce1582440fb1ee74 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.277932:0:18699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=280s v=(0 0) 00010000:00010000:2.0:1789263838.277935:0:19302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000034151765/0xce1582440fb1ee74 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.277937:0:18699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789263838.277947:0:18699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099a0cc86/0xce1582440fb1ee7b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.277972:0:18699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099a0cc86/0xce1582440fb1ee7b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.277978:0:19302:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789263838.277993:0:18699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099a0cc86/0xce1582440fb1ee7b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.278000:0:18699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000099a0cc86/0xce1582440fb1ee7b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.278024:0:18699:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789263838.278047:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789263838.278053:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000034151765/0xce1582440fb1ee74 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.278060:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bfa22800 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:3.0:1789263838.278064:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000034151765/0xce1582440fb1ee74 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.278094:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263838.278100:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000099a0cc86/0xce1582440fb1ee7b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.278102:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000034151765/0xce1582440fb1ee74 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.278119:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd987f50a00 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263838.278125:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000099a0cc86/0xce1582440fb1ee7b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.278126:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000034151765/0xce1582440fb1ee74 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.278134:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000099a0cc86/0xce1582440fb1ee7b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.278153:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034151765/0xce1582440fb1ee74 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.278181:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000099a0cc86/0xce1582440fb1ee7b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.278182:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263838.278185:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263838.278189:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263838.278193:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099a0cc86/0xce1582440fb1ee7b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.278209:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263838.278211:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263838.278213:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789263838.278445:0:18699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789263838.278451:0:18699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005996e1f5/0xce1582440fb1ee82 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.278459:0:18699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=280s v=(0 0) 00010000:00010000:0.0:1789263838.278462:0:18699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789263838.278466:0:18699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005996e1f5/0xce1582440fb1ee82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.278475:0:18699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005996e1f5/0xce1582440fb1ee82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.278482:0:18699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005996e1f5/0xce1582440fb1ee82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.278488:0:18699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005996e1f5/0xce1582440fb1ee82 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.278529:0:18699:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789263838.278691:0:19302:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789263838.278697:0:19302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061f5ee43/0xce1582440fb1ee89 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.278705:0:19302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=280s v=(0 0) 00010000:00010000:2.0:1789263838.278708:0:19302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789263838.278711:0:19302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061f5ee43/0xce1582440fb1ee89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.278721:0:19302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061f5ee43/0xce1582440fb1ee89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.278728:0:19302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061f5ee43/0xce1582440fb1ee89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.278735:0:19302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061f5ee43/0xce1582440fb1ee89 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.278751:0:19302:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789263838.278903:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789263838.278907:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005996e1f5/0xce1582440fb1ee82 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.278913:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd987f50c00 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263838.278916:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005996e1f5/0xce1582440fb1ee82 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.278921:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005996e1f5/0xce1582440fb1ee82 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.279003:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005996e1f5/0xce1582440fb1ee82 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.279012:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005996e1f5/0xce1582440fb1ee82 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.279019:0:17944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789263838.279024:0:17944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061f5ee43/0xce1582440fb1ee89 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789263838.279032:0:18699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789263838.279045:0:17944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bfa23c00 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:0.0:1789263838.279045:0:18699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048bbc908/0xce1582440fb1ee90 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.279051:0:17944:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061f5ee43/0xce1582440fb1ee89 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.279055:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263838.279059:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263838.279063:0:18699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=280s v=(0 0) 00010000:00010000:3.0:1789263838.279066:0:17944:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061f5ee43/0xce1582440fb1ee89 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.279068:0:18699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789263838.279069:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263838.279099:0:18699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048bbc908/0xce1582440fb1ee90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.279110:0:18699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048bbc908/0xce1582440fb1ee90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.279119:0:18699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048bbc908/0xce1582440fb1ee90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.279126:0:18699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048bbc908/0xce1582440fb1ee90 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.279142:0:18699:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789263838.279148:0:17944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061f5ee43/0xce1582440fb1ee89 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.279157:0:17944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061f5ee43/0xce1582440fb1ee89 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.279176:0:17944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789263838.279179:0:17944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048bbc908/0xce1582440fb1ee90 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.279189:0:17944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd987f50e00 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263838.279190:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263838.279192:0:17944:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048bbc908/0xce1582440fb1ee90 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.279199:0:17944:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048bbc908/0xce1582440fb1ee90 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.279206:0:17944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048bbc908/0xce1582440fb1ee90 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.279211:0:17944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048bbc908/0xce1582440fb1ee90 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.279219:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263838.279220:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263838.279229:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789263838.279312:0:19302:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789263838.279317:0:19302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016612680/0xce1582440fb1ee97 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.279325:0:19302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=280s v=(0 0) 00010000:00010000:2.0:1789263838.279332:0:19302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789263838.279343:0:19302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016612680/0xce1582440fb1ee97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.279352:0:19302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016612680/0xce1582440fb1ee97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.279360:0:19302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016612680/0xce1582440fb1ee97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.279366:0:19302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016612680/0xce1582440fb1ee97 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.279384:0:19302:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789263838.279650:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263838.279655:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016612680/0xce1582440fb1ee97 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.279663:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bfa23400 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263838.279667:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016612680/0xce1582440fb1ee97 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.279674:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016612680/0xce1582440fb1ee97 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.279686:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016612680/0xce1582440fb1ee97 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.279694:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016612680/0xce1582440fb1ee97 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.279708:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263838.279710:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263838.279712:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789263838.279850:0:19302:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789263838.279857:0:19302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b144379/0xce1582440fb1ee9e lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.279866:0:19302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=280s v=(0 0) 00010000:00010000:2.0:1789263838.279869:0:19302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789263838.279873:0:19302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b144379/0xce1582440fb1ee9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.279881:0:19302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b144379/0xce1582440fb1ee9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.279889:0:19302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b144379/0xce1582440fb1ee9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.279903:0:19302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b144379/0xce1582440fb1ee9e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.279923:0:19302:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789263838.279955:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263838.279961:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b144379/0xce1582440fb1ee9e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.279976:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bfa23e00 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263838.279982:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b144379/0xce1582440fb1ee9e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.279990:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b144379/0xce1582440fb1ee9e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.280003:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b144379/0xce1582440fb1ee9e lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.280012:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b144379/0xce1582440fb1ee9e lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.280027:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263838.280029:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263838.280030:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789263838.280179:0:18699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789263838.280192:0:18699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e4ff603/0xce1582440fb1eea5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.280208:0:18699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=280s v=(0 0) 00010000:00010000:0.0:1789263838.280245:0:18699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789263838.280256:0:18699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e4ff603/0xce1582440fb1eea5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.280273:0:18699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e4ff603/0xce1582440fb1eea5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.280286:0:18699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e4ff603/0xce1582440fb1eea5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.280295:0:18699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e4ff603/0xce1582440fb1eea5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789263838.280300:0:19302:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789263838.280309:0:19302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d93a4d24/0xce1582440fb1eeac lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.280318:0:19302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=280s v=(0 0) 00010000:00010000:0.0:1789263838.280320:0:18699:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789263838.280324:0:19302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789263838.280331:0:19302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d93a4d24/0xce1582440fb1eeac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.280372:0:17944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789263838.280377:0:17944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e4ff603/0xce1582440fb1eea5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.280382:0:17944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd987f50800 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:3.0:1789263838.280385:0:17944:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e4ff603/0xce1582440fb1eea5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.280401:0:17944:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e4ff603/0xce1582440fb1eea5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.280405:0:19302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d93a4d24/0xce1582440fb1eeac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.280429:0:19302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d93a4d24/0xce1582440fb1eeac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.280436:0:17944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e4ff603/0xce1582440fb1eea5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.280439:0:19302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d93a4d24/0xce1582440fb1eeac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.280456:0:17944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e4ff603/0xce1582440fb1eea5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.280469:0:19302:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789263838.280478:0:17944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789263838.280484:0:17944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d93a4d24/0xce1582440fb1eeac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.280489:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263838.280490:0:17944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bfa22000 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:3.0:1789263838.280495:0:17944:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d93a4d24/0xce1582440fb1eeac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.280502:0:17944:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d93a4d24/0xce1582440fb1eeac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.280512:0:17944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d93a4d24/0xce1582440fb1eeac lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.280519:0:17944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d93a4d24/0xce1582440fb1eeac lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263838.280533:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263838.280535:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263838.280543:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789263838.280723:0:18699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789263838.280732:0:18699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e55a6a6f/0xce1582440fb1eeb3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.280742:0:18699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=280s v=(0 0) 00010000:00010000:0.0:1789263838.280746:0:18699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789263838.280750:0:18699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e55a6a6f/0xce1582440fb1eeb3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.280760:0:18699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e55a6a6f/0xce1582440fb1eeb3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.280768:0:18699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e55a6a6f/0xce1582440fb1eeb3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.280782:0:18699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e55a6a6f/0xce1582440fb1eeb3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263838.280808:0:18699:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1789263838.280846:0:18699:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00000100:00100000:0.0:1789263838.280983:0:18699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17218:x1876178898135040:12345-0@lo:5:osp-pre-1-0.0 Request processed in 24561us (25003us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263838.280995:0:18699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00002000:00010000:2.0:1789263838.280999:0:19302:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789263838.281007:0:19302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002bd8a9f/0xce1582440fb1eeba lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263838.281013:0:17218:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaaf100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17218:1876178898135040:0@lo:5:osp-pre-1-0.0 00010000:00010000:2.0:1789263838.281029:0:19302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=280s v=(0 0) 00010000:00010000:2.0:1789263838.281033:0:19302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00000004:00080000:3.0:1789263838.281034:0:17218:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x5:0x0] 00010000:00010000:2.0:1789263838.281041:0:19302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002bd8a9f/0xce1582440fb1eeba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.281053:0:19302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000002bd8a9f/0xce1582440fb1eeba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.281062:0:19302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002bd8a9f/0xce1582440fb1eeba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.281071:0:19302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000002bd8a9f/0xce1582440fb1eeba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.281116:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1789263838.281118:0:17218:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaaf100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17218:1876178898135680:0@lo:5:osp-pre-1-0.0 00010000:00010000:1.0:1789263838.281126:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e55a6a6f/0xce1582440fb1eeb3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.281163:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd987f51800 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263838.281168:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e55a6a6f/0xce1582440fb1eeb3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.281170:0:19302:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789263838.281190:0:17218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789263838.281192:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e55a6a6f/0xce1582440fb1eeb3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263838.281234:0:17218:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9872a5b40 going to sleep for 11 seconds 00010000:00010000:1.0:1789263838.281236:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e55a6a6f/0xce1582440fb1eeb3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.281251:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e55a6a6f/0xce1582440fb1eeb3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263838.281269:0:18696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898135680 00000100:00100000:3.0:1789263838.281279:0:18696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898135680 00010000:00010000:1.0:1789263838.281285:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263838.281291:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000002bd8a9f/0xce1582440fb1eeba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.281300:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bfa22400 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263838.281304:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000002bd8a9f/0xce1582440fb1eeba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.281314:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000002bd8a9f/0xce1582440fb1eeba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.281324:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000002bd8a9f/0xce1582440fb1eeba lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.281332:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002bd8a9f/0xce1582440fb1eeba lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.281350:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263838.281352:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263838.281364:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263838.281394:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789263838.281449:0:18696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789263838.281463:0:18696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:17218:x1876178898135680:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1789263838.281506:0:18696:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00002000:00010000:2.0:1789263838.281774:0:19302:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789263838.281781:0:19302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072b2bf42/0xce1582440fb1eec1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.281791:0:19302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=280s v=(0 0) 00010000:00010000:2.0:1789263838.281795:0:19302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789263838.281799:0:19302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072b2bf42/0xce1582440fb1eec1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.281810:0:19302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072b2bf42/0xce1582440fb1eec1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.281831:0:19302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072b2bf42/0xce1582440fb1eec1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.281840:0:19302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072b2bf42/0xce1582440fb1eec1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.281862:0:19302:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789263838.281889:0:17944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263838.281898:0:17944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072b2bf42/0xce1582440fb1eec1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.281908:0:17944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bfa23000 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263838.281912:0:17944:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072b2bf42/0xce1582440fb1eec1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.281922:0:17944:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072b2bf42/0xce1582440fb1eec1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.281935:0:17944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072b2bf42/0xce1582440fb1eec1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.281943:0:17944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072b2bf42/0xce1582440fb1eec1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.282070:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263838.282073:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263838.282149:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789263838.282427:0:19302:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789263838.282435:0:19302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084cf433d/0xce1582440fb1eec8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.282444:0:19302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=280s v=(0 0) 00010000:00010000:2.0:1789263838.282446:0:19302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789263838.282450:0:19302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084cf433d/0xce1582440fb1eec8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.282459:0:19302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084cf433d/0xce1582440fb1eec8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.282467:0:19302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084cf433d/0xce1582440fb1eec8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.282474:0:19302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000084cf433d/0xce1582440fb1eec8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.282516:0:19302:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789263838.282650:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263838.282657:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000084cf433d/0xce1582440fb1eec8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.282666:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bfa22c00 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263838.282670:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000084cf433d/0xce1582440fb1eec8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.282687:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000084cf433d/0xce1582440fb1eec8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.282717:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000084cf433d/0xce1582440fb1eec8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.282726:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084cf433d/0xce1582440fb1eec8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.282748:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263838.282751:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263838.282754:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789263838.284412:0:19302:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789263838.284422:0:19302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef135b26/0xce1582440fb1eecf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.284436:0:19302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=280s v=(0 0) 00010000:00010000:2.0:1789263838.284440:0:19302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789263838.284446:0:19302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef135b26/0xce1582440fb1eecf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.284459:0:19302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef135b26/0xce1582440fb1eecf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.284469:0:19302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef135b26/0xce1582440fb1eecf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.284477:0:19302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef135b26/0xce1582440fb1eecf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.284498:0:19302:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789263838.284522:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263838.284530:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef135b26/0xce1582440fb1eecf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.284539:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bfa23200 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263838.284543:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef135b26/0xce1582440fb1eecf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.284550:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef135b26/0xce1582440fb1eecf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.284575:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef135b26/0xce1582440fb1eecf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.284598:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef135b26/0xce1582440fb1eecf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.284627:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263838.284629:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263838.284631:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789263838.284822:0:19302:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789263838.284829:0:19302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f99f3b2/0xce1582440fb1eed6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.284838:0:19302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=280s v=(0 0) 00010000:00010000:2.0:1789263838.284847:0:19302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789263838.284852:0:19302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f99f3b2/0xce1582440fb1eed6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.284861:0:19302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f99f3b2/0xce1582440fb1eed6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.284870:0:19302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f99f3b2/0xce1582440fb1eed6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.284878:0:19302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004f99f3b2/0xce1582440fb1eed6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.284896:0:19302:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789263838.284929:0:17944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263838.284937:0:17944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004f99f3b2/0xce1582440fb1eed6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.284948:0:17944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bfa22600 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263838.284951:0:17944:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004f99f3b2/0xce1582440fb1eed6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.284960:0:17944:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004f99f3b2/0xce1582440fb1eed6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.284973:0:17944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004f99f3b2/0xce1582440fb1eed6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.284980:0:17944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f99f3b2/0xce1582440fb1eed6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.284998:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263838.285000:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263838.285002:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789263838.286015:0:19302:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789263838.286024:0:19302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004723ee36/0xce1582440fb1eedd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.286036:0:19302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=280s v=(0 0) 00010000:00010000:2.0:1789263838.286040:0:19302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789263838.286045:0:19302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004723ee36/0xce1582440fb1eedd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.286055:0:19302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004723ee36/0xce1582440fb1eedd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.286063:0:19302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004723ee36/0xce1582440fb1eedd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.286112:0:19302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004723ee36/0xce1582440fb1eedd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.286134:0:19302:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1789263838.286202:0:19302:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00010000:00010000:1.0:1789263838.286213:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263838.286220:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004723ee36/0xce1582440fb1eedd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263838.286326:0:19302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88397e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17216:x1876178898135296:12345-0@lo:5:osp-pre-0-0.0 Request processed in 29561us (29842us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263838.286339:0:19302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:1.0:1789263838.286374:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bfa22e00 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263838.286379:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004723ee36/0xce1582440fb1eedd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.286390:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004723ee36/0xce1582440fb1eedd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.286406:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004723ee36/0xce1582440fb1eedd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.286413:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004723ee36/0xce1582440fb1eedd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263838.286433:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263838.286434:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263838.286436:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789263838.286451:0:17216:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17216:1876178898135296:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1789263838.286471:0:17216:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:3.0:1789263838.286532:0:17216:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaaca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17216:1876178898135808:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1789263838.286587:0:17216:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263838.286616:0:17216:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9872a56c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789263838.286753:0:18698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898135808 00000100:00100000:1.0:1789263838.286762:0:18698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898135808 00000100:00100000:1.0:1789263838.286816:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789263838.286829:0:18698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17216:x1876178898135808:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1789263838.286862:0:18698:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00000001:00080000:0.0:1789263838.287253:0:19510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000001:00100000:0.0:1789263838.287417:0:19510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1789263838.287602:0:18696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:17218:x1876178898135680:12345-0@lo:5:osp-pre-1-0.0 Request processed in 6141us (6419us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1789263838.287613:0:18696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789263838.287663:0:17218:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:0.0:1789263838.287676:0:17218:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaaf100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17218:1876178898135680:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1789263838.287701:0:17218:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00000100:00100000:1.0:1789263838.290307:0:18698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17216:x1876178898135808:12345-0@lo:5:osp-pre-0-0.0 Request processed in 3477us (3713us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1789263838.290319:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789263838.290429:0:17216:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaaca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17216:1876178898135808:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1789263838.290444:0:17216:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00010000:00010000:1.0:1789263838.510246:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789263838.652129:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263838.652181:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263838.652233:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263838.652293:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888662784 00000100:00100000:0.0:1789263838.652317:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888662784 00000100:00100000:1.0:1789263838.652338:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888663040 00000100:00100000:1.0:1789263838.652344:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888663040 00000100:00100000:0.0:1789263838.652388:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 125 00000100:00100000:1.0:1789263838.652392:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888662912 00000100:00100000:1.0:1789263838.652396:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888662912 00000100:00100000:0.0:1789263838.652405:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd987341450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9c31cd1-b03c-4865-98dc-92dea6862336+10:2399:x1876178888662784:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1789263838.652421:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 24 00000100:00100000:1.0:1789263838.652433:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+5:2400:x1876178888663040:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1789263838.652452:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 10 00000100:00100000:3.0:1789263838.652470:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2396:x1876178888662912:12345-192.168.203.20@tcp:38:kworker.0 00000100:00080000:2.0:1789263838.652484:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789263838.652497:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd987341450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9c31cd1-b03c-4865-98dc-92dea6862336+10:2399:x1876178888662784:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 93us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263838.652501:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+5:2400:x1876178888663040:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 60us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263838.652511:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 125 00000100:00100000:1.0:1789263838.652513:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 24 00010000:00080000:3.0:1789263838.652517:0:17191:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from aea5b0bf-5091-4b59-8387-6d6e4df18cfc@192.168.203.20@tcp t0 exp 0000000000000000 cur 280 last 0 00000020:00000080:3.0:1789263838.652628:0:17191:0:(genops.c:1385:class_connect()) connect: client aea5b0bf-5091-4b59-8387-6d6e4df18cfc, cookie 0xce1582440fb1eee4 00000004:00100000:3.0:1789263838.652721:0:17191:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789263838.652972:0:17191:0:(import.c:65:import_set_state_nolock()) ffff9dd883810000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789263838.653053:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+6:2396:x1876178888662912:12345-192.168.203.20@tcp:38:kworker.0 Request processed in 586us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263838.653062:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 10 00000100:00100000:2.0:1789263838.655666:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263838.655718:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263838.655735:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888662272 00000100:00100000:0.0:1789263838.655745:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888662272 00000100:00080000:2.0:1789263838.655794:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789263838.655806:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888662656 00000100:00100000:0.0:1789263838.655810:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888662656 00000100:00100000:0.0:1789263838.655839:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 11 00000100:00100000:1.0:1789263838.655856:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 12 00000100:00100000:0.0:1789263838.655861:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+7:0:x1876178888662272:12345-192.168.203.20@tcp:41:mount.lustre.0 00000100:00100000:1.0:1789263838.655874:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+7:14868:x1876178888662656:12345-192.168.203.20@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789263838.655900:0:17192:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000004:00000024:0.0:1789263838.655901:0:17193:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789263838.656170:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+7:0:x1876178888662272:12345-192.168.203.20@tcp:41:mount.lustre.0 Request processed in 314us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263838.656181:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 11 00000100:00100000:1.0:1789263838.656182:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+7:14868:x1876178888662656:12345-192.168.203.20@tcp:41:mount.lustre.0 Request processed in 311us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263838.656193:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 12 00000100:00100000:2.0:1789263838.657610:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263838.657717:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888663168 00000100:00100000:3.0:1789263838.657723:0:18722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888663168 00000100:00100000:3.0:1789263838.657803:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 13 00000100:00100000:3.0:1789263838.657813:0:18722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+6:14868:x1876178888663168:12345-192.168.203.20@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789263838.657874:0:18722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+6:14868:x1876178888663168:12345-192.168.203.20@tcp:40:mount.lustre.0 Request processed in 62us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263838.657881:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 13 00000100:00100000:2.0:1789263838.659470:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263838.659516:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263838.659548:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263838.659611:0:19302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888663296 00000100:00100000:0.0:1789263838.659614:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888663552 00000100:00100000:3.0:1789263838.659619:0:19302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888663296 00000100:00100000:0.0:1789263838.659620:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888663552 00000100:00100000:1.0:1789263838.659624:0:19981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888663424 00000100:00100000:1.0:1789263838.659630:0:19981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888663424 00000100:00100000:3.0:1789263838.659669:0:19302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 18 00000100:00100000:3.0:1789263838.659678:0:19302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2396:x1876178888663296:12345-192.168.203.20@tcp:8:mount.lustre.0 00000100:00100000:0.0:1789263838.659690:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 3 00000100:00100000:0.0:1789263838.659702:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+6:14868:x1876178888663552:12345-192.168.203.20@tcp:900:mount.lustre.0 00000100:00100000:1.0:1789263838.659715:0:19981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 19 00000100:00100000:1.0:1789263838.659722:0:19981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2396:x1876178888663424:12345-192.168.203.20@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789263838.659745:0:19302:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from aea5b0bf-5091-4b59-8387-6d6e4df18cfc@192.168.203.20@tcp t0 exp 0000000000000000 cur 280 last 0 00010000:00080000:1.0:1789263838.659745:0:19981:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from aea5b0bf-5091-4b59-8387-6d6e4df18cfc@192.168.203.20@tcp t0 exp 0000000000000000 cur 280 last 0 00000100:00100000:0.0:1789263838.659760:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+6:14868:x1876178888663552:12345-192.168.203.20@tcp:900:mount.lustre.0 Request processed in 59us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263838.659769:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 3 00000020:00000080:1.0:1789263838.659789:0:19981:0:(genops.c:1385:class_connect()) connect: client aea5b0bf-5091-4b59-8387-6d6e4df18cfc, cookie 0xce1582440fb1eef2 00002000:00100000:1.0:1789263838.659801:0:19981:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli aea5b0bf-5091-4b59-8387-6d6e4df18cfc/ffff9dd8810d4800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000020:00000080:3.0:1789263838.659805:0:19302:0:(genops.c:1385:class_connect()) connect: client aea5b0bf-5091-4b59-8387-6d6e4df18cfc, cookie 0xce1582440fb1eeeb 00002000:00100000:1.0:1789263838.659812:0:19981:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00100000:3.0:1789263838.659815:0:19302:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli aea5b0bf-5091-4b59-8387-6d6e4df18cfc/ffff9dd883817000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789263838.659824:0:19302:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789263838.659977:0:19981:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789263838.660007:0:19981:0:(import.c:65:import_set_state_nolock()) ffff9dd8810d4000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789263838.660057:0:19981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+6:2396:x1876178888663424:12345-192.168.203.20@tcp:8:mount.lustre.0 Request processed in 332us (538us total) trans 0 rc 0/0 00002000:00080000:3.0:1789263838.660061:0:19302:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:1.0:1789263838.660066:0:19981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 19 00000100:00080000:3.0:1789263838.660113:0:19302:0:(import.c:65:import_set_state_nolock()) ffff9dd883811000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789263838.660147:0:19302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+6:2396:x1876178888663296:12345-192.168.203.20@tcp:8:mount.lustre.0 Request processed in 469us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263838.660163:0:19302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 18 00000100:00100000:2.0:1789263838.660954:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263838.661059:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888663680 00000100:00100000:3.0:1789263838.661065:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888663680 00000100:00100000:3.0:1789263838.661120:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 0 00000100:00100000:3.0:1789263838.661129:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+6:14868:x1876178888663680:12345-192.168.203.20@tcp:33:mount.lustre.0 00000004:00080000:0.0:1789263838.661763:0:17194:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 564us 00000004:00200000:1.0:1789263838.668070:0:17194:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1789263838.668312:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+6:14868:x1876178888663680:12345-192.168.203.20@tcp:33:mount.lustre.0 Request processed in 7180us (7357us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263838.668325:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 0 00000100:00100000:0.0:1789263838.751060:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263838.751215:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888663808 00000100:00100000:2.0:1789263838.751236:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888663808 00000100:00100000:2.0:1789263838.751285:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 14 00000100:00100000:2.0:1789263838.751294:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88397f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+6:14915:x1876178888663808:12345-192.168.203.20@tcp:101:mkdir.0 00010000:00010000:2.0:1789263838.751313:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263838.751332:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23a00/0xce1582440fb1eef9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d120eb expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.751398:0:17193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23800/0xce1582440fb1ef00 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.751411:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23800/0xce1582440fb1ef00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.751423:0:17193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23800/0xce1582440fb1ef00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789263838.751464:0:17193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789263838.751466:0:17193:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789263838.751496:0:17193:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23800/0xce1582440fb1ef00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.751515:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23a00/0xce1582440fb1eef9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d120eb expref: 8 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.751524:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23800/0xce1582440fb1ef00 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d120eb expref: 7 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263838.751530:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd9ba858300) 00010000:00010000:2.0:1789263838.751532:0:17193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789263838.751542:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bfa23800, rc 0) 00000100:00100000:2.0:1789263838.751627:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88397f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+7:14915:x1876178888663808:12345-192.168.203.20@tcp:101:mkdir.0 Request processed in 334us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263838.751632:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 14 00000100:00100000:0.0:1789263838.766287:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789263838.766319:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989aeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898136064:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789263838.766320:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898135936:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789263838.766405:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263838.766418:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263838.766492:0:19982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898135936 00000100:00100000:1.0:1789263838.766494:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898136064 00000100:00100000:2.0:1789263838.766503:0:19982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898135936 00000100:00100000:1.0:1789263838.766506:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898136064 00000100:00100000:1.0:1789263838.766625:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789263838.766640:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88397c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1876178898136064:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789263838.766652:0:19982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789263838.766668:0:19982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1876178898135936:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789263838.766694:0:19982:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000004:00000024:1.0:1789263838.766694:0:17197:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789263838.766782:0:19982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1876178898135936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 116us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263838.766792:0:19982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789263838.766817:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88397c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1876178898136064:12345-0@lo:41:osp-pre-1-0.0 Request processed in 175us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263838.766830:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789263838.766852:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898135936:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789263838.766863:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989aeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898136064:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789263839.533462:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789263839.789448:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789263839.789481:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898136192:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789263839.789583:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263839.789646:0:18524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898136192 00000100:00100000:2.0:1789263839.789657:0:18524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898136192 00000100:00100000:2.0:1789263839.789730:0:18524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789263839.789743:0:18524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88397d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898136192:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789263839.789789:0:18524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789263839.789861:0:18524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88397d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898136192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 120us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263839.789870:0:18524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789263839.789925:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898136192:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789263840.175233:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263840.175372:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888663936 00000100:00100000:3.0:1789263840.175386:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888663936 00000100:00100000:3.0:1789263840.175510:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 15 00000100:00100000:3.0:1789263840.175523:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+7:14967:x1876178888663936:12345-192.168.203.20@tcp:41:lfs.0 00000004:00000024:3.0:1789263840.175560:0:17191:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00080000:2.0:1789263840.175607:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789263840.175668:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+7:14967:x1876178888663936:12345-192.168.203.20@tcp:41:lfs.0 Request processed in 148us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263840.175676:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 15 00000100:00100000:0.0:1789263840.177179:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263840.177249:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888664064 00000100:00100000:1.0:1789263840.177257:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888664064 00000100:00100000:1.0:1789263840.177321:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 16 00000100:00100000:1.0:1789263840.177332:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88397dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+5:14967:x1876178888664064:12345-192.168.203.20@tcp:41:lfs.0 00000004:00000024:1.0:1789263840.177367:0:17192:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789263840.177445:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88397dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+5:14967:x1876178888664064:12345-192.168.203.20@tcp:41:lfs.0 Request processed in 117us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263840.177451:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 16 00000100:00080000:2.0:1789263840.177521:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789263840.180314:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263840.180372:0:18701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888664192 00000100:00100000:3.0:1789263840.180382:0:18701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888664192 00000100:00100000:3.0:1789263840.180454:0:18701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 6 00000100:00100000:3.0:1789263840.180463:0:18701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+6:14967:x1876178888664192:12345-192.168.203.20@tcp:13:lfs.0 00002000:00000024:3.0:1789263840.180502:0:18701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789263840.180589:0:18701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+6:14967:x1876178888664192:12345-192.168.203.20@tcp:13:lfs.0 Request processed in 127us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263840.180595:0:18701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 6 00000100:00080000:2.0:1789263840.180706:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789263840.182773:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263840.182849:0:19982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888664320 00000100:00100000:2.0:1789263840.182862:0:19982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888664320 00000100:00100000:2.0:1789263840.182953:0:19982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 7 00000100:00100000:2.0:1789263840.182969:0:19982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+6:14967:x1876178888664320:12345-192.168.203.20@tcp:13:lfs.0 00002000:00000024:2.0:1789263840.183001:0:19982:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789263840.183135:0:19982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+6:14967:x1876178888664320:12345-192.168.203.20@tcp:13:lfs.0 Request processed in 172us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263840.183142:0:19982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 7 00000100:00080000:3.0:1789263840.183206:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789263840.272037:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263840.272178:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888664448 00000100:00100000:2.0:1789263840.272189:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888664448 00000100:00100000:2.0:1789263840.272257:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 126 00000100:00100000:2.0:1789263840.272268:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd987340850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9c31cd1-b03c-4865-98dc-92dea6862336+10:15001:x1876178888664448:12345-192.168.203.20@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789263840.272285:0:17185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263840.272303:0:17185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd9bfa23600/0xce1582440fb1ef07 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b612752c1d120f2 expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263840.272345:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd9bfa23600/0xce1582440fb1ef07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d120f2 expref: 11 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263840.272357:0:17185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd9bfa23600/0xce1582440fb1ef07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d120f2 expref: 11 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263840.272898:0:17185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bfa23600, rc 0) 00000100:00100000:2.0:1789263840.272960:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd987340850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9c31cd1-b03c-4865-98dc-92dea6862336+11:15001:x1876178888664448:12345-192.168.203.20@tcp:101:mount.lustre.0 Request processed in 694us (935us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263840.272967:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 126 00000100:00100000:0.0:1789263840.274753:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263840.274929:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888664576 00000100:00100000:2.0:1789263840.274938:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888664576 00000100:00100000:2.0:1789263840.274985:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 127 00000100:00100000:2.0:1789263840.274993:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd987343450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9c31cd1-b03c-4865-98dc-92dea6862336+11:15001:x1876178888664576:12345-192.168.203.20@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789263840.275205:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd987343450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9c31cd1-b03c-4865-98dc-92dea6862336+11:15001:x1876178888664576:12345-192.168.203.20@tcp:501:mount.lustre.0 Request processed in 213us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263840.275223:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 127 00000100:00100000:3.0:1789263840.277469:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263840.277601:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888664704 00000100:00100000:2.0:1789263840.277609:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888664704 00000100:00100000:2.0:1789263840.277678:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 128 00000100:00100000:2.0:1789263840.277696:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98fe86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9c31cd1-b03c-4865-98dc-92dea6862336+11:15001:x1876178888664704:12345-192.168.203.20@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789263840.277834:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98fe86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9c31cd1-b03c-4865-98dc-92dea6862336+11:15001:x1876178888664704:12345-192.168.203.20@tcp:503:mount.lustre.0 Request processed in 147us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263840.277842:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 128 00000100:00100000:0.0:1789263840.281311:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263840.281524:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888664832 00000100:00100000:3.0:1789263840.281534:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888664832 00000100:00100000:3.0:1789263840.281583:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 129 00000100:00100000:3.0:1789263840.281592:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98fe87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9c31cd1-b03c-4865-98dc-92dea6862336+11:15006:x1876178888664832:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789263840.281742:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98fe87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9c31cd1-b03c-4865-98dc-92dea6862336+11:15006:x1876178888664832:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 151us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263840.281750:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 129 00000100:00100000:1.0:1789263840.294359:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263840.294568:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888664960 00000100:00100000:0.0:1789263840.294578:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888664960 00000100:00100000:0.0:1789263840.294635:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 130 00000100:00100000:0.0:1789263840.294646:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98fe87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9c31cd1-b03c-4865-98dc-92dea6862336+11:15006:x1876178888664960:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789263840.294841:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98fe87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9c31cd1-b03c-4865-98dc-92dea6862336+11:15006:x1876178888664960:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 195us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263840.294849:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 130 00000100:00100000:2.0:1789263840.300383:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263840.300957:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888665088 00000100:00100000:3.0:1789263840.300969:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888665088 00000100:00100000:3.0:1789263840.301026:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 131 00000100:00100000:3.0:1789263840.301034:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98fe85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9c31cd1-b03c-4865-98dc-92dea6862336+11:15006:x1876178888665088:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789263840.301286:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98fe85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9c31cd1-b03c-4865-98dc-92dea6862336+11:15006:x1876178888665088:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 250us (915us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263840.301295:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 131 00000100:00100000:3.0:1789263840.301387:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789263840.301400:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898136320:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789263840.301461:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263840.301516:0:18701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898136320 00000100:00100000:2.0:1789263840.301526:0:18701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898136320 00000100:00100000:2.0:1789263840.301599:0:18701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1789263840.301614:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789263840.301615:0:18701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1876178898136320:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789263840.301644:0:18701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789263840.301713:0:18701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1876178898136320:12345-0@lo:13:osp-pre-1-1.0 Request processed in 104us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263840.301721:0:18701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789263840.301780:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898136320:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789263840.303847:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263840.303933:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888665216 00000100:00100000:0.0:1789263840.303941:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888665216 00000100:00100000:0.0:1789263840.304017:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 132 00000100:00100000:0.0:1789263840.304025:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98fe86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9c31cd1-b03c-4865-98dc-92dea6862336+11:15001:x1876178888665216:12345-192.168.203.20@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789263840.304036:0:17187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263840.304050:0:17187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd987f51c00/0xce1582440fb1ef0e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b612752c1d12123 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263840.304070:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd987f51c00/0xce1582440fb1ef0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12123 expref: 12 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263840.304093:0:17187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd987f51c00/0xce1582440fb1ef0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12123 expref: 12 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263840.304100:0:17187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd987f51c00, rc 0) 00000100:00100000:0.0:1789263840.304144:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98fe86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9c31cd1-b03c-4865-98dc-92dea6862336+12:15001:x1876178888665216:12345-192.168.203.20@tcp:101:mount.lustre.0 Request processed in 121us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263840.304148:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 132 00000100:00100000:0.0:1789263840.305739:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263840.305773:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888665344 00000100:00100000:3.0:1789263840.305778:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888665344 00000100:00100000:3.0:1789263840.305804:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 133 00000100:00100000:3.0:1789263840.305809:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98fe87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9c31cd1-b03c-4865-98dc-92dea6862336+12:15001:x1876178888665344:12345-192.168.203.20@tcp:256:mount.lustre.0 20000000:01000000:3.0:1789263840.305829:0:17186:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789263840.305841:0:17186:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789263840.305844:0:17186:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789263840.305846:0:17186:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789263840.305848:0:17186:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1789263840.305849:0:17186:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:2.0:1789263840.306535:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98fe87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9c31cd1-b03c-4865-98dc-92dea6862336+12:15001:x1876178888665344:12345-192.168.203.20@tcp:256:mount.lustre.0 Request processed in 722us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263840.306544:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 133 00000100:00100000:2.0:1789263840.308878:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263840.308929:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888665472 00000100:00100000:0.0:1789263840.308937:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888665472 00000100:00100000:0.0:1789263840.308982:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 134 00000100:00100000:0.0:1789263840.308992:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882aae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9c31cd1-b03c-4865-98dc-92dea6862336+12:15001:x1876178888665472:12345-192.168.203.20@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789263840.309006:0:17187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263840.309020:0:17187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd987f50e00/0xce1582440fb1ef15 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b612752c1d1212a expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263840.309051:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd987f50e00/0xce1582440fb1ef15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1212a expref: 13 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263840.309063:0:17187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd987f50e00/0xce1582440fb1ef15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1212a expref: 13 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263840.309073:0:17187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd987f50e00, rc 0) 00000100:00100000:0.0:1789263840.309149:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882aae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9c31cd1-b03c-4865-98dc-92dea6862336+13:15001:x1876178888665472:12345-192.168.203.20@tcp:101:mount.lustre.0 Request processed in 157us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263840.309155:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 134 00000100:00100000:0.0:1789263840.310385:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263840.310431:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888665600 00000100:00100000:2.0:1789263840.310438:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888665600 00000100:00100000:2.0:1789263840.310476:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 135 00000100:00100000:2.0:1789263840.310482:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882aac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9c31cd1-b03c-4865-98dc-92dea6862336+13:15001:x1876178888665600:12345-192.168.203.20@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789263840.310604:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882aac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9c31cd1-b03c-4865-98dc-92dea6862336+13:15001:x1876178888665600:12345-192.168.203.20@tcp:501:mount.lustre.0 Request processed in 121us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263840.310612:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 135 00000100:00100000:3.0:1789263840.311676:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263840.311748:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888665728 00000100:00100000:0.0:1789263840.311754:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888665728 00000100:00100000:0.0:1789263840.311791:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 136 00000100:00100000:0.0:1789263840.311802:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882aad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9c31cd1-b03c-4865-98dc-92dea6862336+13:15001:x1876178888665728:12345-192.168.203.20@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789263840.311897:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882aad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9c31cd1-b03c-4865-98dc-92dea6862336+13:15001:x1876178888665728:12345-192.168.203.20@tcp:503:mount.lustre.0 Request processed in 98us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263840.311905:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 136 00000100:00100000:0.0:1789263840.314047:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263840.314107:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888665856 00000100:00100000:2.0:1789263840.314115:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888665856 00000100:00100000:2.0:1789263840.314170:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 137 00000100:00100000:2.0:1789263840.314183:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882aadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9c31cd1-b03c-4865-98dc-92dea6862336+13:15010:x1876178888665856:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789263840.314311:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882aadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9c31cd1-b03c-4865-98dc-92dea6862336+13:15010:x1876178888665856:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 134us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263840.314318:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 137 00000100:00100000:1.0:1789263840.316163:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263840.316234:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888665984 00000100:00100000:0.0:1789263840.316242:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888665984 00000100:00100000:0.0:1789263840.316281:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 138 00000100:00100000:0.0:1789263840.316291:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882aac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9c31cd1-b03c-4865-98dc-92dea6862336+13:15010:x1876178888665984:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789263840.316390:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882aac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9c31cd1-b03c-4865-98dc-92dea6862336+13:15010:x1876178888665984:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 101us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263840.316398:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 138 00000100:00100000:3.0:1789263840.317574:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263840.317728:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888666112 00000100:00100000:2.0:1789263840.317735:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888666112 00000100:00100000:3.0:1789263840.317736:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263840.317827:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888666368 00000100:00100000:0.0:1789263840.317832:0:18722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888666368 00000100:00100000:2.0:1789263840.317834:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 17 00000100:00100000:2.0:1789263840.317842:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2396:x1876178888666112:12345-192.168.203.20@tcp:38:mount.lustre.0 00000100:00100000:0.0:1789263840.317864:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 18 00000100:00100000:0.0:1789263840.317871:0:18722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2396:x1876178888666368:12345-192.168.203.20@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789263840.317877:0:17191:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 9a1530e0-880b-4d94-ada1-a3a40d18af45@192.168.203.20@tcp t0 exp 0000000000000000 cur 282 last 0 00010000:00080000:0.0:1789263840.317893:0:18722:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 9a1530e0-880b-4d94-ada1-a3a40d18af45@192.168.203.20@tcp t0 exp 0000000000000000 cur 282 last 0 00000020:00000080:2.0:1789263840.317926:0:17191:0:(genops.c:1385:class_connect()) connect: client 9a1530e0-880b-4d94-ada1-a3a40d18af45, cookie 0xce1582440fb1ef1c 00000020:00000080:0.0:1789263840.317930:0:18722:0:(genops.c:1385:class_connect()) connect: client 9a1530e0-880b-4d94-ada1-a3a40d18af45, cookie 0xce1582440fb1ef23 00000004:00100000:2.0:1789263840.317953:0:17191:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000004:00100000:0.0:1789263840.317953:0:18722:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789263840.318051:0:17191:0:(import.c:65:import_set_state_nolock()) ffff9dd9862e3800 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1789263840.318051:0:18722:0:(import.c:65:import_set_state_nolock()) ffff9dd987d96000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789263840.318127:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a1530e0-880b-4d94-ada1-a3a40d18af45+6:2396:x1876178888666112:12345-192.168.203.20@tcp:38:mount.lustre.0 Request processed in 283us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263840.318134:0:18722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a1530e0-880b-4d94-ada1-a3a40d18af45+6:2396:x1876178888666368:12345-192.168.203.20@tcp:38:mount.lustre.0 Request processed in 259us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263840.318141:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 17 00000100:00100000:0.0:1789263840.318150:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 18 00000100:00100000:2.0:1789263840.319394:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263840.319523:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888666496 00000100:00100000:3.0:1789263840.319529:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888666496 00000100:00100000:3.0:1789263840.319579:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 19 00000100:00100000:3.0:1789263840.319585:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a1530e0-880b-4d94-ada1-a3a40d18af45+6:0:x1876178888666496:12345-192.168.203.20@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789263840.319602:0:17193:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789263840.319656:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a1530e0-880b-4d94-ada1-a3a40d18af45+6:0:x1876178888666496:12345-192.168.203.20@tcp:41:mount.lustre.0 Request processed in 70us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263840.319663:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 19 00000100:00080000:2.0:1789263840.319715:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789263840.320244:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263840.320277:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263840.320496:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888666240 00000100:00100000:1.0:1789263840.320500:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888666240 00000100:00080000:2.0:1789263840.320538:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789263840.320579:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888666624 00000100:00100000:1.0:1789263840.320584:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888666624 00000100:00100000:1.0:1789263840.320608:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 20 00000100:00100000:1.0:1789263840.320616:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a1530e0-880b-4d94-ada1-a3a40d18af45+7:0:x1876178888666240:12345-192.168.203.20@tcp:41:mount.lustre.0 00000100:00100000:2.0:1789263840.320623:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 21 00000100:00100000:2.0:1789263840.320632:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a1530e0-880b-4d94-ada1-a3a40d18af45+7:15001:x1876178888666624:12345-192.168.203.20@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789263840.320642:0:17192:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000004:00000024:2.0:1789263840.320645:0:17191:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789263840.320684:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a1530e0-880b-4d94-ada1-a3a40d18af45+7:15001:x1876178888666624:12345-192.168.203.20@tcp:41:mount.lustre.0 Request processed in 49us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263840.320685:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a1530e0-880b-4d94-ada1-a3a40d18af45+7:0:x1876178888666240:12345-192.168.203.20@tcp:41:mount.lustre.0 Request processed in 65us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263840.320695:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 20 00000100:00100000:2.0:1789263840.320754:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 21 00000100:00100000:1.0:1789263840.321495:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263840.321534:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888666752 00000100:00100000:2.0:1789263840.321540:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888666752 00000100:00100000:2.0:1789263840.321575:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 22 00000100:00100000:2.0:1789263840.321583:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989aed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a1530e0-880b-4d94-ada1-a3a40d18af45+6:15001:x1876178888666752:12345-192.168.203.20@tcp:40:mount.lustre.0 00000100:00100000:2.0:1789263840.321637:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989aed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a1530e0-880b-4d94-ada1-a3a40d18af45+6:15001:x1876178888666752:12345-192.168.203.20@tcp:40:mount.lustre.0 Request processed in 54us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263840.321644:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 22 00000100:00100000:1.0:1789263840.322850:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263840.322879:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263840.322908:0:18698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888666880 00000100:00100000:1.0:1789263840.322915:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263840.322915:0:18698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888666880 00000100:00100000:2.0:1789263840.322931:0:18699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888667008 00000100:00100000:2.0:1789263840.322937:0:18699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888667008 00000100:00100000:0.0:1789263840.322949:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 20 00000100:00100000:0.0:1789263840.322956:0:18698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989aece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2396:x1876178888666880:12345-192.168.203.20@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789263840.322981:0:18698:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 9a1530e0-880b-4d94-ada1-a3a40d18af45@192.168.203.20@tcp t0 exp 0000000000000000 cur 282 last 0 00000020:00000080:0.0:1789263840.323009:0:18698:0:(genops.c:1385:class_connect()) connect: client 9a1530e0-880b-4d94-ada1-a3a40d18af45, cookie 0xce1582440fb1ef2a 00000100:00100000:2.0:1789263840.323022:0:18699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 21 00002000:00100000:0.0:1789263840.323022:0:18698:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 9a1530e0-880b-4d94-ada1-a3a40d18af45/ffff9dd987d93000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:2.0:1789263840.323027:0:18699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989aed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2396:x1876178888667008:12345-192.168.203.20@tcp:8:mount.lustre.0 00002000:00100000:0.0:1789263840.323046:0:18698:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00010000:00080000:2.0:1789263840.323052:0:18699:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 9a1530e0-880b-4d94-ada1-a3a40d18af45@192.168.203.20@tcp t0 exp 0000000000000000 cur 282 last 0 00000100:00100000:3.0:1789263840.323072:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888667136 00000020:00000080:2.0:1789263840.323112:0:18699:0:(genops.c:1385:class_connect()) connect: client 9a1530e0-880b-4d94-ada1-a3a40d18af45, cookie 0xce1582440fb1ef31 00000100:00100000:3.0:1789263840.323119:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888667136 00002000:00100000:2.0:1789263840.323122:0:18699:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 9a1530e0-880b-4d94-ada1-a3a40d18af45/ffff9dd98850c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789263840.323131:0:18699:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789263840.323149:0:18698:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00002000:00080000:2.0:1789263840.323179:0:18699:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789263840.323183:0:18698:0:(import.c:65:import_set_state_nolock()) ffff9dd987d90800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789263840.323192:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 4 00000100:00080000:2.0:1789263840.323200:0:18699:0:(import.c:65:import_set_state_nolock()) ffff9dd9ac8ff800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789263840.323231:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989aef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:9a1530e0-880b-4d94-ada1-a3a40d18af45+6:15001:x1876178888667136:12345-192.168.203.20@tcp:900:mount.lustre.0 00000100:00100000:2.0:1789263840.323253:0:18699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989aed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9a1530e0-880b-4d94-ada1-a3a40d18af45+6:2396:x1876178888667008:12345-192.168.203.20@tcp:8:mount.lustre.0 Request processed in 223us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263840.323253:0:18698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989aece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9a1530e0-880b-4d94-ada1-a3a40d18af45+6:2396:x1876178888666880:12345-192.168.203.20@tcp:8:mount.lustre.0 Request processed in 291us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263840.323270:0:18699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 21 00000100:00100000:0.0:1789263840.323278:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 20 00000100:00100000:3.0:1789263840.323309:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989aef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:9a1530e0-880b-4d94-ada1-a3a40d18af45+6:15001:x1876178888667136:12345-192.168.203.20@tcp:900:mount.lustre.0 Request processed in 103us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263840.323317:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 4 00000100:00100000:3.0:1789263840.324186:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263840.324266:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888667264 00000100:00100000:0.0:1789263840.324271:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888667264 00000100:00100000:0.0:1789263840.324305:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 1 00000100:00100000:0.0:1789263840.324313:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a1530e0-880b-4d94-ada1-a3a40d18af45+6:15001:x1876178888667264:12345-192.168.203.20@tcp:33:mount.lustre.0 00000004:00200000:0.0:1789263840.324380:0:17195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1789263840.324431:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a1530e0-880b-4d94-ada1-a3a40d18af45+6:15001:x1876178888667264:12345-192.168.203.20@tcp:33:mount.lustre.0 Request processed in 119us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263840.324436:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 1 00000100:00100000:1.0:1789263840.400129:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263840.400323:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888667392 00000100:00100000:0.0:1789263840.400332:0:18722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888667392 00000100:00100000:0.0:1789263840.400392:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 23 00000100:00100000:0.0:1789263840.400402:0:18722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989aeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a1530e0-880b-4d94-ada1-a3a40d18af45+6:15033:x1876178888667392:12345-192.168.203.20@tcp:101:mkdir.0 00010000:00010000:0.0:1789263840.400428:0:18722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263840.400451:0:18722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50c00/0xce1582440fb1ef38 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d1215b expref: -99 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263840.400519:0:18722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50a00/0xce1582440fb1ef3f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263840.400533:0:18722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50a00/0xce1582440fb1ef3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263840.400559:0:18722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50a00/0xce1582440fb1ef3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789263840.400610:0:18722:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789263840.400615:0:18722:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789263840.400647:0:18722:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50a00/0xce1582440fb1ef3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263840.400674:0:18722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50c00/0xce1582440fb1ef38 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1215b expref: 8 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263840.400692:0:18722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50a00/0xce1582440fb1ef3f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1215b expref: 7 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263840.400701:0:18722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd9ba858300) 00010000:00010000:0.0:1789263840.400704:0:18722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789263840.400707:0:18722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd987f50a00, rc 0) 00000100:00100000:0.0:1789263840.400863:0:18722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989aeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a1530e0-880b-4d94-ada1-a3a40d18af45+7:15033:x1876178888667392:12345-192.168.203.20@tcp:101:mkdir.0 Request processed in 462us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263840.400870:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 23 00010000:00010000:1.0:1789263840.557470:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789263841.542371:0:20069:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1789263841.582467:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789263841.582714:0:17950:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789263842.605667:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789263842.924263:0:20216:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc38d399f0 20000000:00000080:2.0:1789263842.924280:0:20216:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9dd988e43800 uarg=0000000000000000 20000000:01000000:2.0:1789263842.924327:0:20216:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789263842.924334:0:20216:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789263842.924338:0:20216:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1789263842.924714:0:20217:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:1.0:1789263842.924806:0:20216:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789263842.929308:0:20216:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789263842.929337:0:20216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dd8841a2800/0xce1582440fb1ef46 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263842.929355:0:20216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd9bb805e00/0xce1582440fb1ebd4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1ebcd expref: 23 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263842.929363:0:20216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd883e73600/0xce1582440fb1ebe2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1ebdb expref: 23 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263842.929386:0:20216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd883f58000/0xce1582440fb1ec28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1ec21 expref: 23 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263842.929392:0:20216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd9bb804000/0xce1582440fb1ecc2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1ecbb expref: 23 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263842.929400:0:20216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd8841a3a00/0xce1582440fb1ed40 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d120ba expref: 12 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263842.929407:0:20216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd987f50e00/0xce1582440fb1ef15 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1212a expref: 12 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263842.929414:0:20216:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dd8841a2800/0xce1582440fb1ef46 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263842.929453:0:20216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd987f50e00/0xce1582440fb1ef15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1212a expref: 12 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263842.929480:0:20216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dd987f50e00/0xce1582440fb1ef15 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1212a expref: 12 pid: 17187 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263842.929495:0:20216:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989aeea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20216:1876178898136448:192.168.203.20@tcp:104: 00010000:00010000:1.0:1789263842.929598:0:20216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd8841a3a00/0xce1582440fb1ed40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d120ba expref: 12 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263842.929608:0:20216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dd8841a3a00/0xce1582440fb1ed40 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d120ba expref: 12 pid: 17185 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263842.929617:0:20216:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989aee300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20216:1876178898136576:192.168.203.20@tcp:104: 00010000:00010000:1.0:1789263842.929661:0:20216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd9bb804000/0xce1582440fb1ecc2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce1582440fb1ecbb expref: 23 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263842.929670:0:20216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dd9bb804000/0xce1582440fb1ecc2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce1582440fb1ecbb expref: 23 pid: 17185 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263842.929680:0:20216:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989aedc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20216:1876178898136704:0@lo:104: 00000100:00100000:1.0:1789263842.929719:0:20216:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789263842.929750:0:20216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd883f58000/0xce1582440fb1ec28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce1582440fb1ec21 expref: 23 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263842.929755:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898136704 00010000:00010000:1.0:1789263842.929760:0:20216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dd883f58000/0xce1582440fb1ec28 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce1582440fb1ec21 expref: 23 pid: 17185 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263842.929762:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898136704 00000100:00100000:1.0:1789263842.929773:0:20216:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989aed880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20216:1876178898136832:0@lo:104: 00000100:00100000:1.0:1789263842.929812:0:20216:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263842.929816:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789263842.929828:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989aefb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de026c8f-6636-4fc7-8061-42c8092f00f0+3:20216:x1876178898136704:12345-0@lo:104: 00010000:00010000:2.0:1789263842.929843:0:17175:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff9dd883f58a00/0xce1582440fb1ecbb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1ecc2 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263842.929843:0:20216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd883e73600/0xce1582440fb1ebe2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce1582440fb1ebdb expref: 23 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263842.929862:0:20216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dd883e73600/0xce1582440fb1ebe2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce1582440fb1ebdb expref: 23 pid: 17187 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263842.929873:0:20216:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882a6ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20216:1876178898136960:0@lo:104: 00000100:00100000:3.0:1789263842.929896:0:19527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898136832 00000100:00100000:3.0:1789263842.929902:0:19527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898136832 00000100:00100000:1.0:1789263842.929908:0:20216:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789263842.929910:0:17175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789263842.929919:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989aefb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de026c8f-6636-4fc7-8061-42c8092f00f0+4:20216:x1876178898136704:12345-0@lo:104: Request processed in 93us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263842.929927:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:1.0:1789263842.929932:0:20216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd9bb805e00/0xce1582440fb1ebd4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce1582440fb1ebcd expref: 23 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263842.929942:0:20216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dd9bb805e00/0xce1582440fb1ebd4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce1582440fb1ebcd expref: 23 pid: 17185 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263842.929945:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898136960 00000100:00100000:2.0:1789263842.929950:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898136960 00000100:00100000:2.0:1789263842.929966:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789263842.929968:0:20216:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882a6d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20216:1876178898137088:0@lo:104: 00000100:00100000:2.0:1789263842.929988:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882a6f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de026c8f-6636-4fc7-8061-42c8092f00f0+4:20216:x1876178898136960:12345-0@lo:104: 00010000:00010000:2.0:1789263842.929997:0:17175:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff9dd981531c00/0xce1582440fb1ebdb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1ebe2 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263842.929997:0:20216:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263842.930013:0:20216:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd989758f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789263842.930035:0:20216:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989aedc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20216:1876178898136704:0@lo:104: 00000100:00100000:1.0:1789263842.930051:0:20216:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882a6ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20216:1876178898136960:0@lo:104: 00010000:00010000:2.0:1789263842.930056:0:17175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789263842.930063:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882a6f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de026c8f-6636-4fc7-8061-42c8092f00f0+4:20216:x1876178898136960:12345-0@lo:104: Request processed in 89us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263842.930069:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789263842.930106:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898137088 00000100:00100000:2.0:1789263842.930110:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898137088 00010000:00010000:1.0:1789263842.930120:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789263842.930127:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd883f58a00/0xce1582440fb1ecbb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1ecc2 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263842.930136:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1789263842.930138:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883f58a00 already unused, calling callback (ffffffffc12b1c20) 00000100:00100000:3.0:1789263842.930152:0:19527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789263842.930153:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882a6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de026c8f-6636-4fc7-8061-42c8092f00f0+4:20216:x1876178898137088:12345-0@lo:104: 00010000:00010000:2.0:1789263842.930164:0:17175:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff9dd981530600/0xce1582440fb1ebcd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1ebd4 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263842.930167:0:19527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989aec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:de026c8f-6636-4fc7-8061-42c8092f00f0+4:20216:x1876178898136832:12345-0@lo:104: 00010000:00010000:3.0:1789263842.930184:0:19527:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff9dd9bb804c00/0xce1582440fb1ec21 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1ec28 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263842.930236:0:17175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789263842.930243:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882a6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de026c8f-6636-4fc7-8061-42c8092f00f0+4:20216:x1876178898137088:12345-0@lo:104: Request processed in 93us (246us total) trans 0 rc 0/0 00010000:00010000:3.0:1789263842.930248:0:19527:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789263842.930255:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789263842.930257:0:19527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989aec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:de026c8f-6636-4fc7-8061-42c8092f00f0+4:20216:x1876178898136832:12345-0@lo:104: Request processed in 94us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263842.930267:0:19527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1789263842.930275:0:17944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789263842.930281:0:17944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd981531c00/0xce1582440fb1ebdb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1ebe2 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263842.930290:0:17944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981531c00 already unused, calling callback (ffffffffc12b1c20) 10000000:00010000:2.0:1789263842.930294:0:17944:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd981531c00/0xce1582440fb1ebdb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xce1582440fb1ebe2 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263842.930302:0:17944:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd981531c00/0xce1582440fb1ebdb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xce1582440fb1ebe2 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789263842.930308:0:17944:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd981531c00/0xce1582440fb1ebdb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xce1582440fb1ebe2 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789263842.930313:0:17944:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789263842.930340:0:17944:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff9dd981531c00/0xce1582440fb1ebdb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1ebe2 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263842.930346:0:17944:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789263842.930363:0:17944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd981531c00/0xce1582440fb1ebdb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1ebe2 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263842.930377:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789263842.930378:0:17944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd981531c00/0xce1582440fb1ebdb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1ebe2 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263842.930396:0:17944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789263842.930399:0:17944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd9bb804c00/0xce1582440fb1ec21 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1ec28 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263842.930405:0:17944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bb804c00 already unused, calling callback (ffffffffc12b1c20) 00000100:00100000:0.0:1789263842.930407:0:20216:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989aed880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20216:1876178898136832:0@lo:104: 10000000:00010000:2.0:1789263842.930409:0:17944:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd9bb804c00/0xce1582440fb1ec21 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xce1582440fb1ec28 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263842.930420:0:17944:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd9bb804c00/0xce1582440fb1ec21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xce1582440fb1ec28 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263842.930424:0:20216:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882a6d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20216:1876178898137088:0@lo:104: 10000000:00010000:2.0:1789263842.930442:0:17944:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd9bb804c00/0xce1582440fb1ec21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xce1582440fb1ec28 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789263842.930448:0:17944:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1789263842.930458:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88297f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:de026c8f-6636-4fc7-8061-42c8092f00f0:3619:1876178898137216:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789263842.930466:0:17944:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff9dd9bb804c00/0xce1582440fb1ec21 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1ec28 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263842.930474:0:17944:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789263842.930493:0:17944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd9bb804c00/0xce1582440fb1ec21 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1ec28 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263842.930502:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789263842.930503:0:17944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd9bb804c00/0xce1582440fb1ec21 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1ec28 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263842.930525:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789263842.930534:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789263842.930537:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789263842.930557:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88297f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de026c8f-6636-4fc7-8061-42c8092f00f0:3620:1876178898137344:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789263842.930584:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898137216 00000100:00100000:2.0:1789263842.930591:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263842.930591:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898137216 00010000:00010000:3.0:1789263842.930598:0:20218:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263842.930609:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd981530600/0xce1582440fb1ebcd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1ebd4 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263842.930617:0:17177:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd883e73600/0xce1582440fb1ebe2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1ebdb expref: 24 pid: 17187 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263842.930620:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981530600 already unused, calling callback (ffffffffc12b1c20) 10000000:00010000:3.0:1789263842.930625:0:17180:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd981530600/0xce1582440fb1ebcd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xce1582440fb1ebd4 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263842.930634:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898137344 00000100:00100000:2.0:1789263842.930640:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898137344 00010000:00010000:3.0:1789263842.930645:0:17180:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd981530600/0xce1582440fb1ebcd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xce1582440fb1ebd4 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789263842.930654:0:17180:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd981530600/0xce1582440fb1ebcd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xce1582440fb1ebd4 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263842.930656:0:17178:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd883f58000/0xce1582440fb1ec28 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1ec21 expref: 25 pid: 17185 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263842.930664:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 10000000:01000000:3.0:1789263842.930673:0:17180:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1789263842.930679:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88397c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de026c8f-6636-4fc7-8061-42c8092f00f0+25:3619:x1876178898137216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789263842.930692:0:17177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789263842.930695:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1789263842.930701:0:17177:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd883e73600/0xce1582440fb1ebe2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1ebdb expref: 25 pid: 17187 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263842.930703:0:17180:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff9dd981530600/0xce1582440fb1ebcd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1ebd4 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263842.930707:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:de026c8f-6636-4fc7-8061-42c8092f00f0+25:3620:x1876178898137344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789263842.930721:0:17178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789263842.930724:0:17177:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd883e73600/0xce1582440fb1ebe2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce1582440fb1ebdb expref: 25 pid: 17187 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263842.930730:0:17178:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd883f58000/0xce1582440fb1ec28 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1ec21 expref: 25 pid: 17185 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263842.930746:0:17180:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789263842.930765:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd883e73600/0xce1582440fb1ebe2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce1582440fb1ebdb expref: 25 pid: 17187 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263842.930766:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd981530600/0xce1582440fb1ebcd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1ebd4 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263842.930784:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd981530600/0xce1582440fb1ebcd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1ebd4 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263842.930797:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263842.930799:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263842.930801:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263842.930808:0:20218:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:1.0:1789263842.930808:0:17181:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd883f58a00/0xce1582440fb1ecbb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xce1582440fb1ecc2 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263842.930812:0:20218:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263842.930821:0:17181:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd883f58a00/0xce1582440fb1ecbb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xce1582440fb1ecc2 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263842.930824:0:17178:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd883f58000/0xce1582440fb1ec28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce1582440fb1ec21 expref: 24 pid: 17185 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789263842.930835:0:17181:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd883f58a00/0xce1582440fb1ecbb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xce1582440fb1ecc2 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263842.930836:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1789263842.930843:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd883f58000/0xce1582440fb1ec28 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce1582440fb1ec21 expref: 24 pid: 17185 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789263842.930848:0:17181:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1789263842.930850:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de026c8f-6636-4fc7-8061-42c8092f00f0:3620:1876178898137472:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789263842.930862:0:17178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789263842.930874:0:17181:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff9dd883f58a00/0xce1582440fb1ecbb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1ecc2 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263842.930882:0:17181:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789263842.930900:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd883f58a00/0xce1582440fb1ecbb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1ecc2 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263842.930901:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263842.930901:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:de026c8f-6636-4fc7-8061-42c8092f00f0+23:3620:x1876178898137344:12345-0@lo:103:ldlm_bl.0 Request processed in 194us (308us total) trans 0 rc 0/0 00010000:00010000:1.0:1789263842.930917:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd883f58a00/0xce1582440fb1ecbb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1ecc2 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263842.930919:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789263842.930937:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88297f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de026c8f-6636-4fc7-8061-42c8092f00f0:3620:1876178898137344:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789263842.930937:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898137472 00010000:00010000:1.0:1789263842.930941:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789263842.930944:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898137472 00010000:00010000:1.0:1789263842.930946:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263842.930950:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789263842.930960:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:2.0:1789263842.930961:0:17178:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd9bb805e00/0xce1582440fb1ebd4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1ebcd expref: 23 pid: 17185 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263842.930972:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882a6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:de026c8f-6636-4fc7-8061-42c8092f00f0:3619:1876178898137600:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789263842.931001:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789263842.931007:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263842.931010:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa91f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:de026c8f-6636-4fc7-8061-42c8092f00f0+23:3620:x1876178898137472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789263842.931018:0:17178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789263842.931022:0:17178:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd9bb805e00/0xce1582440fb1ebd4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1ebcd expref: 23 pid: 17185 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263842.931030:0:17178:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd9bb805e00/0xce1582440fb1ebd4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce1582440fb1ebcd expref: 23 pid: 17185 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263842.931049:0:17177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789263842.931055:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd9bb805e00/0xce1582440fb1ebd4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce1582440fb1ebcd expref: 23 pid: 17185 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263842.931065:0:17178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789263842.931113:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88397c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de026c8f-6636-4fc7-8061-42c8092f00f0+22:3619:x1876178898137216:12345-0@lo:103:ldlm_bl.0 Request processed in 437us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263842.931120:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789263842.931136:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa91f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:de026c8f-6636-4fc7-8061-42c8092f00f0+21:3620:x1876178898137472:12345-0@lo:103:ldlm_bl.0 Request processed in 127us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263842.931143:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789263842.931203:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88297f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:de026c8f-6636-4fc7-8061-42c8092f00f0:3619:1876178898137216:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789263842.931317:0:20216:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989aeea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20216:1876178898136448:192.168.203.20@tcp:104: 00000100:00100000:1.0:1789263842.931349:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de026c8f-6636-4fc7-8061-42c8092f00f0:3620:1876178898137472:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789263842.932481:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898137600 00000100:00100000:0.0:1789263842.932487:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898137600 00010000:00010000:0.0:1789263842.932510:0:17177:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd9bb804000/0xce1582440fb1ecc2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1ecbb expref: 21 pid: 17185 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263842.932538:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789263842.932546:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882a6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de026c8f-6636-4fc7-8061-42c8092f00f0+21:3619:x1876178898137600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789263842.932557:0:17177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789263842.932561:0:17177:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd9bb804000/0xce1582440fb1ecc2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1ecbb expref: 21 pid: 17185 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263842.932571:0:17177:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd9bb804000/0xce1582440fb1ecc2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce1582440fb1ecbb expref: 21 pid: 17185 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263842.932593:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd9bb804000/0xce1582440fb1ecc2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce1582440fb1ecbb expref: 21 pid: 17185 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263842.932603:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00010000:00010000:0.0:1789263842.932605:0:17177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789263842.932618:0:20216:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989aee300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20216:1876178898136576:192.168.203.20@tcp:104: 00000100:00100000:2.0:1789263842.932630:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263842.932652:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888667520 00000100:00100000:2.0:1789263842.932657:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888667520 00000100:00100000:0.0:1789263842.932657:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882a6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de026c8f-6636-4fc7-8061-42c8092f00f0+20:3619:x1876178898137600:12345-0@lo:103:ldlm_bl.0 Request processed in 111us (1649us total) trans 0 rc 0/0 00010000:00010000:3.0:1789263842.932665:0:20216:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dd8841a2800/0xce1582440fb1ef46 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263842.932669:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1789263842.932677:0:17179:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd987f50e00/0xce1582440fb1ef15 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1212a expref: 13 pid: 17187 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263842.932689:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888667648 00000100:00100000:0.0:1789263842.932694:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888667648 00000100:00100000:2.0:1789263842.932701:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 13 00010000:00010000:0.0:1789263842.932709:0:17177:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd8841a3a00/0xce1582440fb1ed40 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d120ba expref: 14 pid: 17185 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263842.932714:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa63c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9c31cd1-b03c-4865-98dc-92dea6862336+14:2397:x1876178888667520:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789263842.932727:0:17179:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789263842.932732:0:17179:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd987f50e00/0xce1582440fb1ef15 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1212a expref: 14 pid: 17187 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263842.932737:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882a6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:de026c8f-6636-4fc7-8061-42c8092f00f0:3619:1876178898137600:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789263842.932741:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 14 00000100:00100000:0.0:1789263842.932755:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9c31cd1-b03c-4865-98dc-92dea6862336+14:2397:x1876178888667648:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789263842.932763:0:17177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789263842.932768:0:17177:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd8841a3a00/0xce1582440fb1ed40 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d120ba expref: 14 pid: 17185 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263842.932771:0:17179:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd987f50e00/0xce1582440fb1ef15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1212a expref: 14 pid: 17187 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263842.932838:0:17177:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd8841a3a00/0xce1582440fb1ed40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d120ba expref: 14 pid: 17185 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263842.932854:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd987f50e00/0xce1582440fb1ef15 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1212a expref: 14 pid: 17187 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263842.932859:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd8841a3a00/0xce1582440fb1ed40 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d120ba expref: 14 pid: 17185 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263842.932872:0:17179:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dd8841a2800/0xce1582440fb1ef46 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263842.932883:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd8841a2800/0xce1582440fb1ef46 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263842.932890:0:17177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789263842.932896:0:17179:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd8841a2800/0xce1582440fb1ef46 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263842.932905:0:17179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd8841a2800/0xce1582440fb1ef46 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263842.932913:0:17179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dd8841a2800/0xce1582440fb1ef46 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263842.932921:0:17179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dd8841a2800/0xce1582440fb1ef46 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263842.932926:0:17179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd8841a2800 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:2.0:1789263842.932929:0:17179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dd8841a2800/0xce1582440fb1ef46 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263842.932936:0:17179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dd8841a2800/0xce1582440fb1ef46 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263842.932939:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9c31cd1-b03c-4865-98dc-92dea6862336+12:2397:x1876178888667648:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 180us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263842.932951:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 14 00010000:00010000:2.0:1789263842.932965:0:17179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dd8841a2800/0xce1582440fb1ef46 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263842.932978:0:17179:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789263842.932991:0:20216:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dd8841a2800/0xce1582440fb1ef46 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263842.933000:0:20216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dd8841a2800/0xce1582440fb1ef46 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263842.933004:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa63c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9c31cd1-b03c-4865-98dc-92dea6862336+11:2397:x1876178888667520:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 294us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263842.933016:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 13 00010000:00010000:3.0:1789263842.933027:0:20216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd8841a2800/0xce1582440fb1ef46 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263843.373735:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876178898137728:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789263843.373843:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263843.373899:0:19982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898137728 00000100:00100000:3.0:1789263843.373906:0:19982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898137728 00000100:00100000:1.0:1789263843.373915:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882a6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898137856:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789263843.373973:0:19982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789263843.373987:0:19982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1876178898137728:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789263843.374001:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1789263843.374033:0:19982:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789263843.374124:0:19982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1876178898137728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 139us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263843.374134:0:19982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789263843.374161:0:18701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898137856 00000100:00100000:1.0:1789263843.374169:0:18701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898137856 00000100:00100000:1.0:1789263843.374233:0:18701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789263843.374245:0:18701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882a6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1876178898137856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789263843.374276:0:18701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789263843.374333:0:18701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882a6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1876178898137856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263843.374341:0:18701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1789263843.374547:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789263843.374553:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789263843.374614:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882a6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876178898138112:0@lo:400:kworker.0 00000100:00100000:1.0:1789263843.374646:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263843.374664:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882a6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876178898138624:0@lo:400:kworker.0 00000100:00100000:1.0:1789263843.374679:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263843.374699:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882a6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1876178898139136:0@lo:400:kworker.0 00000100:00100000:1.0:1789263843.374714:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263843.374727:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789263843.374731:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882a6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1876178898138752:0@lo:400:kworker.0 00000100:00100000:1.0:1789263843.374742:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263843.374761:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898138112 00000100:00100000:1.0:1789263843.374764:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898138112 00000100:00100000:1.0:1789263843.374781:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898138624 00000100:00100000:1.0:1789263843.374783:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898138624 00000100:00100000:1.0:1789263843.374792:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898139136 00000100:00100000:1.0:1789263843.374795:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898139136 00000100:00100000:1.0:1789263843.374817:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898138752 00000100:00100000:1.0:1789263843.374820:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898138752 00000100:00100000:1.0:1789263843.374848:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789263843.374858:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882a6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876178898138112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789263843.374908:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882a6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876178898138112:12345-0@lo:400:kworker.0 Request processed in 52us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263843.374916:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789263843.374934:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789263843.374942:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882a6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876178898138624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263843.374945:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882a6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898138240:0@lo:400:kworker.0 00000100:00100000:1.0:1789263843.374990:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882a6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876178898138624:12345-0@lo:400:kworker.0 Request processed in 50us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263843.374998:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263843.375003:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789263843.375023:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789263843.375033:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882a6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1876178898139136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263843.375056:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876178898137728:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789263843.375172:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789263843.375184:0:18722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882a6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876178898138752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263843.375238:0:18722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882a6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876178898138752:12345-0@lo:400:kworker.0 Request processed in 57us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263843.375246:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789263843.375280:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882a6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898137984:0@lo:400:kworker.0 00000100:00100000:1.0:1789263843.375287:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882a6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1876178898139136:12345-0@lo:400:kworker.0 Request processed in 48us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263843.375307:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789263843.375326:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263843.375336:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898138240 00000100:00100000:1.0:1789263843.375341:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898138240 00000100:00100000:3.0:1789263843.375348:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882a6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898138496:0@lo:400:kworker.0 00000100:00100000:3.0:1789263843.375370:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263843.375377:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898137984 00000100:00100000:1.0:1789263843.375382:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898137984 00000100:00100000:3.0:1789263843.375390:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882a6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3621:1876178898139008:0@lo:400:kworker.0 00000100:00100000:1.0:1789263843.375406:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789263843.375414:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263843.375418:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1876178898138240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263843.375436:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789263843.375445:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882a6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898138368:0@lo:400:kworker.0 00000100:00100000:1.0:1789263843.375470:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1876178898138240:12345-0@lo:400:kworker.0 Request processed in 55us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263843.375477:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263843.375485:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789263843.375500:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882a6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3621:1876178898138880:0@lo:400:kworker.0 00000100:00100000:1.0:1789263843.375505:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789263843.375515:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1876178898137984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263843.375522:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263843.375542:0:19302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898138496 00000100:00100000:3.0:1789263843.375545:0:19302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898138496 00000100:00100000:1.0:1789263843.375560:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1876178898137984:12345-0@lo:400:kworker.0 Request processed in 47us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263843.375567:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789263843.375572:0:19302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898138368 00000100:00100000:3.0:1789263843.375575:0:19302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898138368 00000100:00100000:3.0:1789263843.375596:0:19302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789263843.375602:0:19302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1876178898138496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789263843.375612:0:19981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789263843.375623:0:19981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3621:x1876178898138368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263843.375629:0:19302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1876178898138496:12345-0@lo:400:kworker.0 Request processed in 28us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263843.375634:0:19302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789263843.375648:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898139008 00000100:00100000:3.0:1789263843.375651:0:18722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898139008 00000100:00100000:1.0:1789263843.375668:0:19981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3621:x1876178898138368:12345-0@lo:400:kworker.0 Request processed in 47us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263843.375674:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898138880 00000100:00100000:3.0:1789263843.375676:0:18722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898138880 00000100:00100000:1.0:1789263843.375679:0:19981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789263843.375699:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1789263843.375704:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789263843.375707:0:18722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1876178898139008:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789263843.375710:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789263843.375715:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789263843.375717:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789263843.375734:0:18722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1876178898139008:12345-0@lo:400:kworker.0 Request processed in 29us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263843.375747:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882a6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1876178898138752:0@lo:400:kworker.0 00000100:00100000:3.0:1789263843.375749:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789263843.375764:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789263843.375769:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882a6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876178898138112:0@lo:400:kworker.0 00000100:00100000:3.0:1789263843.375772:0:18722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1876178898138880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263843.375797:0:18722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1876178898138880:12345-0@lo:400:kworker.0 Request processed in 27us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263843.375801:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882a6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876178898138624:0@lo:400:kworker.0 00000100:00100000:3.0:1789263843.375805:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1789263843.375825:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd882a6c000 x1876178898139136/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263859 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789263843.375837:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882a6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1876178898139136:0@lo:400:kworker.0 00000100:00100000:3.0:1789263843.375845:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882a6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898137856:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789263843.375880:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882a6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898138240:0@lo:400:kworker.0 00000100:00100000:1.0:1789263843.375910:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882a6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898138368:0@lo:400:kworker.0 00010000:00080000:1.0:1789263843.375922:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd882a6d880 x1876178898138880/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263859 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789263843.375930:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882a6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3621:1876178898138880:0@lo:400:kworker.0 00000100:00100000:1.0:1789263843.375941:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882a6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898137984:0@lo:400:kworker.0 00000100:00100000:1.0:1789263843.375951:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882a6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898138496:0@lo:400:kworker.0 00000100:00100000:1.0:1789263843.375960:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882a6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3621:1876178898139008:0@lo:400:kworker.0 00010000:00010000:1.0:1789263843.630262:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789263843.885339:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789263843.885359:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898139264:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789263843.885379:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882a6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898139392:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789263843.885430:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263843.885435:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263843.885514:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898139392 00000100:00100000:1.0:1789263843.885516:0:18701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898139264 00000100:00100000:1.0:1789263843.885522:0:18701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898139264 00000100:00100000:0.0:1789263843.885522:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898139392 00000100:00100000:0.0:1789263843.885578:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789263843.885581:0:18701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789263843.885594:0:18701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882a6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876178898139264:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789263843.885597:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88397d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1876178898139392:12345-0@lo:41:osp-pre-1-0.0 00002000:00000024:1.0:1789263843.885625:0:18701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000004:00000024:0.0:1789263843.885627:0:17197:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789263843.885681:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88397d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1876178898139392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263843.885688:0:18701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882a6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876178898139264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263843.885695:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789263843.885711:0:18701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789263843.885741:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882a6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898139392:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789263843.885991:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898139264:0@lo:13:osp-pre-0-1.0 00000001:00100000:0.0:1789263843.887096:0:17172:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9a1530e0-880b-4d94-ada1-a3a40d18af45 00000001:00100000:2.0:1789263843.887101:0:18693:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9a1530e0-880b-4d94-ada1-a3a40d18af45 00000001:00100000:0.0:1789263843.887106:0:17172:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of aea5b0bf-5091-4b59-8387-6d6e4df18cfc 00000001:00100000:2.0:1789263843.887112:0:18693:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of aea5b0bf-5091-4b59-8387-6d6e4df18cfc 00000001:00080000:2.0:1789263843.887121:0:18693:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934595 is committed 00000100:00100000:1.0:1789263844.264675:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263844.264796:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888667776 00000100:00100000:3.0:1789263844.264807:0:18722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888667776 00000100:00080000:1.0:1789263844.264865:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789263844.264949:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 24 00000100:00100000:3.0:1789263844.264961:0:18722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882a6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+6:15546:x1876178888667776:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789263844.264981:0:18722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263844.265010:0:18722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1ef4d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d12162 expref: -99 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.265111:0:18722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1ef54 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.265126:0:18722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1ef54 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.265142:0:18722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1ef54 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.265169:0:18722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1ef5b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.265177:0:18722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1ef5b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.265194:0:18722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1ef5b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.265269:0:18722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531000/0xce1582440fb1ef62 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.265278:0:18722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531000/0xce1582440fb1ef62 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.265285:0:18722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531000/0xce1582440fb1ef62 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789263844.265313:0:18722:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789263844.265316:0:18722:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789263844.265361:0:18722:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531000/0xce1582440fb1ef62 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.265372:0:18722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1ef54 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.265379:0:18722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1ef54 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.265387:0:18722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1ef54 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.265403:0:18722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981530600 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263844.265407:0:18722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1ef54 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.265419:0:18722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1ef54 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.265432:0:18722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd9ba858300) 00010000:00010000:3.0:1789263844.265435:0:18722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789263844.265440:0:18722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1ef54 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.265446:0:18722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1ef54 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.265461:0:18722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1ef5b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.265467:0:18722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1ef5b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.265471:0:18722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1ef5b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.265474:0:18722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981530c00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263844.265476:0:18722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1ef5b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.265479:0:18722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1ef5b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.265502:0:18722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9dd9bb595b00) 00010000:00010000:3.0:1789263844.265504:0:18722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789263844.265507:0:18722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1ef5b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.265513:0:18722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1ef5b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.265544:0:18722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1ef4d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12162 expref: 8 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.265554:0:18722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531000/0xce1582440fb1ef62 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12162 expref: 7 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.265559:0:18722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9dd9bb595a00) 00010000:00010000:3.0:1789263844.265561:0:18722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789263844.265562:0:18722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981531000, rc 0) 00000100:00100000:3.0:1789263844.265612:0:18722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882a6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+7:15546:x1876178888667776:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 655us (947us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263844.265618:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 24 00000100:00100000:1.0:1789263844.266906:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263844.267105:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888667904 00000100:00100000:0.0:1789263844.267112:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888667904 00000100:00100000:0.0:1789263844.267157:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 5 00000100:00100000:0.0:1789263844.267165:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882a6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+7:15546:x1876178888667904:12345-192.168.203.20@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1789263844.267232:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882a6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+7:15546:x1876178888667904:12345-192.168.203.20@tcp:900:lhsmtool_posix.0 Request processed in 67us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263844.267251:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 5 00000100:00100000:2.0:1789263844.269169:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263844.269358:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888668160 00000100:00100000:3.0:1789263844.269366:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888668160 00000100:00100000:3.0:1789263844.269418:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 25 00000100:00100000:3.0:1789263844.269427:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+7:15546:x1876178888668160:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789263844.269443:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263844.269462:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1ef69 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d12169 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.269548:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1ef70 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.269562:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1ef70 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.269572:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1ef70 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.269631:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1ef77 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.269641:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1ef77 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.269648:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1ef77 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.269750:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530800/0xce1582440fb1ef7e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.269759:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530800/0xce1582440fb1ef7e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.269766:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530800/0xce1582440fb1ef7e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789263844.269775:0:17192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1789263844.269937:0:17192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1ef70 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.269955:0:17192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1ef70 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.269962:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1ef70 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.269968:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981531600 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263844.269972:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1ef70 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.269980:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1ef70 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.269992:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9dd9bb595a00) 00010000:00010000:3.0:1789263844.269995:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789263844.270000:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1ef70 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.270006:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1ef70 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.270019:0:17192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1ef77 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.270023:0:17192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1ef77 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.270028:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1ef77 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.270033:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981531a00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263844.270043:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1ef77 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.270049:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1ef77 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.270058:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9dd9bb595e00) 00010000:00010000:3.0:1789263844.270060:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789263844.270063:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1ef77 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.270069:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1ef77 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.270660:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1ef69 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12169 expref: 10 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.270679:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530800/0xce1582440fb1ef7e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12169 expref: 9 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.270687:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9dd9bb595f00) 00010000:00010000:3.0:1789263844.270689:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789263844.270691:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981530800, rc 0) 00000100:00100000:3.0:1789263844.270752:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+9:15546:x1876178888668160:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 1326us (1587us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1789263844.270759:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 25 00000100:00100000:1.0:1789263844.272653:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263844.273033:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888668288 00000100:00100000:0.0:1789263844.273052:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888668288 00000100:00100000:0.0:1789263844.273126:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 26 00000100:00100000:0.0:1789263844.273138:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882a6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+9:15546:x1876178888668288:12345-192.168.203.20@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789263844.273244:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882a6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+9:15546:x1876178888668288:12345-192.168.203.20@tcp:59:lhsmtool_posix.0 Request processed in 110us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263844.273269:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 26 00000100:00100000:1.0:1789263844.274175:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263844.274222:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888668416 00000100:00100000:2.0:1789263844.274229:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888668416 00000100:00100000:2.0:1789263844.274278:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 27 00000100:00080000:1.0:1789263844.274281:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789263844.274291:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882a6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+5:15546:x1876178888668416:12345-192.168.203.20@tcp:59:lhsmtool_posix.0 00000004:00080000:2.0:1789263844.274935:0:17191:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 621us 00000100:00100000:0.0:1789263844.282303:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882a6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+5:15546:x1876178888668416:12345-192.168.203.20@tcp:59:lhsmtool_posix.0 Request processed in 8008us (8125us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263844.282318:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 27 00000100:00100000:2.0:1789263844.291724:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263844.291818:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888668544 00000100:00100000:3.0:1789263844.291828:0:18722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888668544 00000100:00100000:3.0:1789263844.291888:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 28 00000100:00100000:3.0:1789263844.291900:0:18722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+9:15552:x1876178888668544:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:3.0:1789263844.291931:0:18722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263844.291949:0:18722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1ef8c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d12170 expref: -99 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.292005:0:18722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1ef93 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.292018:0:18722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1ef93 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.292030:0:18722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1ef93 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.292056:0:18722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1ef9a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.292063:0:18722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1ef9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.292070:0:18722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1ef9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.292132:0:18722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1ef93 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.292140:0:18722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1ef93 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.292146:0:18722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1ef93 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.292152:0:18722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981531a00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263844.292162:0:18722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1ef93 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.292169:0:18722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1ef93 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.292192:0:18722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd9ba858300) 00010000:00010000:3.0:1789263844.292195:0:18722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789263844.292200:0:18722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1ef93 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.292207:0:18722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1ef93 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.292222:0:18722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1ef9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.292229:0:18722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1ef9a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.292236:0:18722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1ef9a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.292241:0:18722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981531600 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263844.292244:0:18722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1ef9a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.292250:0:18722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1ef9a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.292257:0:18722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9dd9bb595e00) 00010000:00010000:3.0:1789263844.292259:0:18722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789263844.292269:0:18722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1ef9a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.292276:0:18722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1ef9a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.292304:0:18722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1ef8c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12170 expref: 10 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.292313:0:18722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd9ba858300) 00010000:00010000:3.0:1789263844.292315:0:18722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789263844.292319:0:18722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1ef8c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12170 expref: 10 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.292329:0:18722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981530e00, rc 0) 00000100:00100000:3.0:1789263844.292385:0:18722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+9:15552:x1876178888668544:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 488us (666us total) trans 0 rc 301/301 00000100:00100000:3.0:1789263844.292392:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 28 00000100:00100000:3.0:1789263844.295253:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263844.295342:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888668672 00000100:00100000:0.0:1789263844.295354:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888668672 00000100:00100000:0.0:1789263844.295451:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 0 00000100:00100000:0.0:1789263844.295459:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+9:15552:x1876178888668672:12345-192.168.203.20@tcp:700:lfs.0 00000100:00100000:0.0:1789263844.295521:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+9:15552:x1876178888668672:12345-192.168.203.20@tcp:700:lfs.0 Request processed in 63us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263844.295525:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 0 00000100:00100000:1.0:1789263844.296916:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263844.296970:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888668928 00000100:00100000:3.0:1789263844.296976:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888668928 00000100:00100000:3.0:1789263844.297025:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 29 00000100:00100000:3.0:1789263844.297034:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882a6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+9:15552:x1876178888668928:12345-192.168.203.20@tcp:36:lfs.0 00010000:00010000:3.0:1789263844.297257:0:17192:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789263844.297284:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23800/0xce1582440fb1ef00 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d120eb expref: 9 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.297301:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd9ba858300) 00010000:00010000:3.0:1789263844.297317:0:17192:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789263844.297370:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1efa1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.297384:0:17192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50a00/0xce1582440fb1ef3f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1215b expref: 5 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.297393:0:17192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1efa1 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.297426:0:17192:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50a00/0xce1582440fb1ef3f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1215b expref: 5 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.297453:0:17192:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50a00/0xce1582440fb1ef3f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1215b expref: 5 pid: 18722 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263844.297466:0:17192:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa93480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17192:1876178898139520:192.168.203.20@tcp:104: 00000100:00100000:3.0:1789263844.297537:0:17192:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd983164000 going to sleep for 11 seconds 00000100:00100000:3.0:1789263844.298897:0:17192:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa93480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17192:1876178898139520:192.168.203.20@tcp:104: 00010000:00010000:3.0:1789263844.298919:0:17192:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1efa1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263844.298927:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263844.298983:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888669056 00000100:00100000:2.0:1789263844.298989:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888669056 00010000:00010000:2.0:1789263844.299032:0:17178:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50a00/0xce1582440fb1ef3f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1215b expref: 6 pid: 18722 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789263844.299060:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789263844.299088:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 15 00000100:00100000:2.0:1789263844.299096:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882a6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9a1530e0-880b-4d94-ada1-a3a40d18af45+6:2397:x1876178888669056:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789263844.299107:0:17178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789263844.299123:0:17178:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50a00/0xce1582440fb1ef3f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1215b expref: 6 pid: 18722 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263844.299142:0:17178:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50a00/0xce1582440fb1ef3f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1215b expref: 6 pid: 18722 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263844.299158:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50a00/0xce1582440fb1ef3f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1215b expref: 6 pid: 18722 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263844.299170:0:17178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd9ba858300) 00010000:00010000:2.0:1789263844.299175:0:17178:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1efa1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263844.299193:0:17178:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1efa1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263844.299200:0:17178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1efa1 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263844.299215:0:17178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789263844.299249:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882a6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9a1530e0-880b-4d94-ada1-a3a40d18af45+5:2397:x1876178888669056:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 154us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263844.299256:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 15 00010000:00010000:3.0:1789263844.299516:0:17192:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1efa1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.299523:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1efa1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.299536:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1efa8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.299549:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1efa8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.299556:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1efa8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.300682:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1efaf lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.300694:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1efaf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.300700:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1efaf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789263844.300716:0:17192:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004a18af49 reply state 00000000e5637638 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1efaf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.300726:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1efaf lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.300732:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9dd9bb595c00) 00010000:00010000:3.0:1789263844.300735:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789263844.300738:0:17192:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789263844.300742:0:17192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789263844.300750:0:17192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1efa1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.300757:0:17192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1efa1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.300762:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1efa1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.300771:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981530a00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263844.300775:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1efa1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.300786:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1efa1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.300796:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd9ba858300) 00010000:00010000:3.0:1789263844.300798:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789263844.300802:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1efa1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.300809:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1efa1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789263844.300825:0:17192:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004a18af49 reply state 00000000e5637638 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1efa8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.300834:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1efa8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.300841:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9dd9bb595b00) 00010000:00010000:3.0:1789263844.300843:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789263844.300845:0:17192:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1789263844.300905:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882a6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+10:15552:x1876178888668928:12345-192.168.203.20@tcp:36:lfs.0 Request processed in 3872us (3989us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1789263844.300913:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 29 00000100:00100000:1.0:1789263844.338452:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263844.338544:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888669184 00000100:00100000:0.0:1789263844.338559:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888669184 00000100:00100000:0.0:1789263844.338626:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 30 00000100:00100000:0.0:1789263844.338636:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882a6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+10:15560:x1876178888669184:12345-192.168.203.20@tcp:101:lctl.0 00010000:00010000:0.0:1789263844.338664:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263844.338688:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51a00/0xce1582440fb1efb6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d12177 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.338752:0:17193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50a00/0xce1582440fb1efbd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.338766:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50a00/0xce1582440fb1efbd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.338777:0:17193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50a00/0xce1582440fb1efbd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789263844.338834:0:17193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789263844.338838:0:17193:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789263844.338874:0:17193:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50a00/0xce1582440fb1efbd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.338899:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51a00/0xce1582440fb1efb6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12177 expref: 12 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.338918:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50a00/0xce1582440fb1efbd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12177 expref: 11 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.338927:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd998414100) 00010000:00010000:0.0:1789263844.338930:0:17193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789263844.338934:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd987f50a00, rc 0) 00000100:00100000:0.0:1789263844.338998:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882a6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+11:15560:x1876178888669184:12345-192.168.203.20@tcp:101:lctl.0 Request processed in 363us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263844.339006:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 30 00000100:00100000:2.0:1789263844.350642:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263844.350753:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888669312 00000100:00100000:0.0:1789263844.350797:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888669312 00000100:00100000:0.0:1789263844.350870:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 31 00000100:00100000:0.0:1789263844.350880:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a1530e0-880b-4d94-ada1-a3a40d18af45+5:15561:x1876178888669312:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:0.0:1789263844.350899:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263844.350918:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51a00/0xce1582440fb1efc4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d1217e expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.350980:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51200/0xce1582440fb1efcb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.351013:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51200/0xce1582440fb1efcb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.351027:0:17191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51200/0xce1582440fb1efcb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789263844.351111:0:17191:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789263844.351114:0:17191:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789263844.351142:0:17191:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51200/0xce1582440fb1efcb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.351167:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51a00/0xce1582440fb1efc4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1217e expref: 7 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.351198:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51200/0xce1582440fb1efcb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1217e expref: 6 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.351207:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd998414100) 00010000:00010000:0.0:1789263844.351210:0:17191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789263844.351213:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd987f51200, rc 0) 00000100:00100000:0.0:1789263844.351288:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a1530e0-880b-4d94-ada1-a3a40d18af45+6:15561:x1876178888669312:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 409us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263844.351295:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 31 00000100:00100000:1.0:1789263844.353866:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263844.353923:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888669440 00000100:00100000:3.0:1789263844.353931:0:18722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888669440 00000100:00100000:3.0:1789263844.353986:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 32 00000100:00100000:3.0:1789263844.354006:0:18722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882a6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a1530e0-880b-4d94-ada1-a3a40d18af45+6:15561:x1876178888669440:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:3.0:1789263844.354023:0:18722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263844.354038:0:18722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1efd2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d12185 expref: -99 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.354123:0:18722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1efd9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.354136:0:18722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1efd9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.354146:0:18722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1efd9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.354157:0:18722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1efe0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.354164:0:18722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1efe0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.354171:0:18722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1efe0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.354251:0:18722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1efe7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.354260:0:18722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1efe7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.354267:0:18722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1efe7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789263844.354321:0:18722:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789263844.354325:0:18722:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789263844.354341:0:18722:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1efe7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.354353:0:18722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1efd9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.354359:0:18722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1efd9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.354366:0:18722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1efd9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.354372:0:18722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981530e00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263844.354375:0:18722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1efd9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.354383:0:18722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1efd9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.354395:0:18722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd998414100) 00010000:00010000:3.0:1789263844.354398:0:18722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789263844.354402:0:18722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1efd9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.354408:0:18722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1efd9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.354422:0:18722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1efe0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.354438:0:18722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1efe0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.354444:0:18722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1efe0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.354463:0:18722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981531600 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263844.354467:0:18722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1efe0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.354474:0:18722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1efe0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.354482:0:18722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9dd9bb595b00) 00010000:00010000:3.0:1789263844.354484:0:18722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789263844.354487:0:18722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1efe0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.354491:0:18722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1efe0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.354516:0:18722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1efd2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12185 expref: 8 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.354529:0:18722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1efe7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12185 expref: 7 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.354536:0:18722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9dd9bb595c00) 00010000:00010000:3.0:1789263844.354538:0:18722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789263844.354549:0:18722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981531a00, rc 0) 00000100:00100000:3.0:1789263844.354608:0:18722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882a6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a1530e0-880b-4d94-ada1-a3a40d18af45+7:15561:x1876178888669440:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 603us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263844.354615:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 32 00000100:00100000:1.0:1789263844.356455:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263844.356502:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888669568 00000100:00100000:3.0:1789263844.356511:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888669568 00000100:00080000:1.0:1789263844.356556:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789263844.356567:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 6 00000100:00100000:3.0:1789263844.356576:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882a6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:9a1530e0-880b-4d94-ada1-a3a40d18af45+6:15561:x1876178888669568:12345-192.168.203.20@tcp:900:lfs.0 00000100:00100000:3.0:1789263844.356645:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882a6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:9a1530e0-880b-4d94-ada1-a3a40d18af45+6:15561:x1876178888669568:12345-192.168.203.20@tcp:900:lfs.0 Request processed in 61us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263844.356652:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 6 00000100:00100000:2.0:1789263844.361390:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263844.361483:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888669824 00000100:00100000:3.0:1789263844.361500:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888669824 00000100:00100000:3.0:1789263844.361646:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 33 00000100:00100000:3.0:1789263844.361666:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a1530e0-880b-4d94-ada1-a3a40d18af45+7:15561:x1876178888669824:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:3.0:1789263844.361692:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263844.361720:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531200/0xce1582440fb1efee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d1218c expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789263844.361856:0:17192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789263844.361984:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531200/0xce1582440fb1efee lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1218c expref: 9 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.362000:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd998414100) 00010000:00010000:3.0:1789263844.362003:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789263844.362009:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531200/0xce1582440fb1efee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1218c expref: 9 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.362045:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981531200, rc 0) 00000100:00100000:3.0:1789263844.362140:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a1530e0-880b-4d94-ada1-a3a40d18af45+8:15561:x1876178888669824:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 476us (758us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1789263844.362149:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 33 00000100:00100000:3.0:1789263844.365279:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263844.365355:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888670080 00000100:00100000:0.0:1789263844.365367:0:18722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888670080 00000100:00100000:0.0:1789263844.365429:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 34 00000100:00100000:0.0:1789263844.365440:0:18722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a1530e0-880b-4d94-ada1-a3a40d18af45+8:15561:x1876178888670080:12345-192.168.203.20@tcp:36:lfs.0 00010000:00010000:0.0:1789263844.365497:0:18722:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789263844.365536:0:18722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1efe7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12185 expref: 8 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.365555:0:18722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9dd9bb595c00) 00010000:00010000:0.0:1789263844.365560:0:18722:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789263844.365581:0:18722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51a00/0xce1582440fb1effc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.365594:0:18722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51a00/0xce1582440fb1effc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.365604:0:18722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51a00/0xce1582440fb1effc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789263844.365812:0:18722:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cee7f298 reply state 000000005b012bb8 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51a00/0xce1582440fb1effc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.365826:0:18722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51a00/0xce1582440fb1effc lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.365832:0:18722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9dd9bb595c00) 00010000:00010000:0.0:1789263844.365835:0:18722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1789263844.365838:0:18722:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789263844.365845:0:18722:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1789263844.365928:0:18722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a1530e0-880b-4d94-ada1-a3a40d18af45+9:15561:x1876178888670080:12345-192.168.203.20@tcp:36:lfs.0 Request processed in 490us (659us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1789263844.365935:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 34 00000100:00100000:1.0:1789263844.367337:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263844.367412:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888670336 00000100:00100000:0.0:1789263844.367420:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888670336 00000100:00100000:0.0:1789263844.367472:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 2 00000100:00100000:0.0:1789263844.367481:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a1530e0-880b-4d94-ada1-a3a40d18af45+9:15561:x1876178888670336:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:0.0:1789263844.367652:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a1530e0-880b-4d94-ada1-a3a40d18af45+10:15561:x1876178888670336:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 172us (328us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1789263844.367660:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 2 00000100:00100000:2.0:1789263844.369659:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263844.369705:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888670592 00000100:00100000:0.0:1789263844.369713:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888670592 00000100:00100000:0.0:1789263844.369767:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 35 00000100:00100000:0.0:1789263844.369777:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a1530e0-880b-4d94-ada1-a3a40d18af45+10:15561:x1876178888670592:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:0.0:1789263844.369802:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263844.369824:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f003 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d12193 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.369893:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50800/0xce1582440fb1f00a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.369907:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50800/0xce1582440fb1f00a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.369918:0:17191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50800/0xce1582440fb1f00a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.369928:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51800/0xce1582440fb1f011 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.369936:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51800/0xce1582440fb1f011 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.369942:0:17191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51800/0xce1582440fb1f011 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789263844.370045:0:17191:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789263844.370132:0:17191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50800/0xce1582440fb1f00a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.370139:0:17191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50800/0xce1582440fb1f00a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.370143:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50800/0xce1582440fb1f00a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.370147:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd987f50800 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:0.0:1789263844.370152:0:17191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50800/0xce1582440fb1f00a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.370157:0:17191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50800/0xce1582440fb1f00a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.370166:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd998414100) 00010000:00010000:0.0:1789263844.370168:0:17191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789263844.370170:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50800/0xce1582440fb1f00a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.370174:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50800/0xce1582440fb1f00a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.370195:0:17191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51800/0xce1582440fb1f011 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.370199:0:17191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51800/0xce1582440fb1f011 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.370203:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51800/0xce1582440fb1f011 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.370213:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd987f51800 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:0.0:1789263844.370215:0:17191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51800/0xce1582440fb1f011 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.370219:0:17191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51800/0xce1582440fb1f011 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.370225:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9dd9bb595b00) 00010000:00010000:0.0:1789263844.370226:0:17191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789263844.370228:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51800/0xce1582440fb1f011 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.370231:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51800/0xce1582440fb1f011 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.370255:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f003 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12193 expref: 12 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.370261:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd998414100) 00010000:00010000:0.0:1789263844.370263:0:17191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789263844.370265:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f003 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12193 expref: 12 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.370271:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd987f51600, rc 0) 00000100:00100000:0.0:1789263844.370322:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a1530e0-880b-4d94-ada1-a3a40d18af45+11:15561:x1876178888670592:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 548us (670us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1789263844.370327:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 35 00000100:00100000:3.0:1789263844.371773:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263844.371866:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888670720 00000100:00100000:0.0:1789263844.371878:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888670720 00000100:00100000:0.0:1789263844.371916:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 36 00000100:00100000:0.0:1789263844.371924:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a1530e0-880b-4d94-ada1-a3a40d18af45+11:15561:x1876178888670720:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:0.0:1789263844.371939:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263844.371952:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50c00/0xce1582440fb1f01f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d1219a expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.372012:0:17193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50200/0xce1582440fb1f026 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.372022:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50200/0xce1582440fb1f026 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.372031:0:17193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50200/0xce1582440fb1f026 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789263844.372057:0:17193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789263844.372061:0:17193:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789263844.372096:0:17193:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50200/0xce1582440fb1f026 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.372116:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50c00/0xce1582440fb1f01f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1219a expref: 13 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.372140:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50200/0xce1582440fb1f026 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1219a expref: 12 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.372148:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9dd9bb595c00) 00010000:00010000:0.0:1789263844.372150:0:17193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789263844.372153:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd987f50200, rc 0) 00000100:00100000:0.0:1789263844.372214:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a1530e0-880b-4d94-ada1-a3a40d18af45+12:15561:x1876178888670720:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 290us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263844.372220:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 36 00000100:00100000:1.0:1789263844.374324:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263844.374377:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888670848 00000100:00100000:3.0:1789263844.374385:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888670848 00000100:00100000:3.0:1789263844.374432:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 3 00000100:00100000:3.0:1789263844.374443:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989ae2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a1530e0-880b-4d94-ada1-a3a40d18af45+12:15561:x1876178888670848:12345-192.168.203.20@tcp:37:lfs.0 00000100:00100000:3.0:1789263844.376776:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989ae2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a1530e0-880b-4d94-ada1-a3a40d18af45+12:15561:x1876178888670848:12345-192.168.203.20@tcp:37:lfs.0 Request processed in 2330us (2452us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263844.376786:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 3 00000100:00100000:1.0:1789263844.379222:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263844.379298:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888671104 00000100:00100000:0.0:1789263844.379307:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888671104 00000100:00100000:0.0:1789263844.379358:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 4 00000100:00100000:0.0:1789263844.379369:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c0ae4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a1530e0-880b-4d94-ada1-a3a40d18af45+12:15561:x1876178888671104:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:0.0:1789263844.379579:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c0ae4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a1530e0-880b-4d94-ada1-a3a40d18af45+13:15561:x1876178888671104:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 212us (365us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1789263844.379586:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 4 00000100:00100000:1.0:1789263844.399065:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263844.399174:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888671232 00000100:00100000:3.0:1789263844.399194:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888671232 00000100:00100000:3.0:1789263844.399261:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 37 00000100:00100000:3.0:1789263844.399272:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989ae2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+11:15567:x1876178888671232:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:3.0:1789263844.399290:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263844.399308:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531200/0xce1582440fb1f02d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d121a1 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.399363:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1f034 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.399376:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1f034 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.399395:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1f034 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.399403:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1f03b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.399408:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1f03b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.399412:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1f03b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.399465:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1f042 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.399470:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1f042 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.399474:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1f042 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789263844.399496:0:17192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789263844.399499:0:17192:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789263844.399524:0:17192:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1f042 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.399532:0:17192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1f034 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.399536:0:17192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1f034 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.399547:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1f034 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.399551:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981530a00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263844.399554:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1f034 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.399558:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1f034 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.399566:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd998414100) 00010000:00010000:3.0:1789263844.399569:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789263844.399572:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1f034 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.399576:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1f034 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.399585:0:17192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1f03b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.399588:0:17192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1f03b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.399591:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1f03b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.399594:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981531600 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263844.399596:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1f03b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.399605:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1f03b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.399610:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9dd9bb595b00) 00010000:00010000:3.0:1789263844.399611:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789263844.399613:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1f03b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.399616:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1f03b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.399637:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531200/0xce1582440fb1f02d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d121a1 expref: 13 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.399648:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1f042 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d121a1 expref: 12 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.399655:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9dd9bb595c00) 00010000:00010000:3.0:1789263844.399657:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789263844.399659:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981530e00, rc 0) 00000100:00100000:3.0:1789263844.399713:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989ae2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+12:15567:x1876178888671232:12345-192.168.203.20@tcp:101:bash.0 Request processed in 444us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263844.399720:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 37 00000100:00100000:2.0:1789263844.400903:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263844.400953:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888671360 00000100:00100000:0.0:1789263844.400959:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888671360 00000100:00100000:0.0:1789263844.400998:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 7 00000100:00100000:0.0:1789263844.401007:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+5:15567:x1876178888671360:12345-192.168.203.20@tcp:900:bash.0 00000100:00100000:0.0:1789263844.401063:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+5:15567:x1876178888671360:12345-192.168.203.20@tcp:900:bash.0 Request processed in 58us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263844.401072:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 7 00000100:00100000:1.0:1789263844.402230:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263844.402290:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888671616 00000100:00100000:3.0:1789263844.402301:0:18722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888671616 00000100:00100000:3.0:1789263844.402361:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 38 00000100:00100000:3.0:1789263844.402373:0:18722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989ae1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+12:15567:x1876178888671616:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:3.0:1789263844.402412:0:18722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263844.402436:0:18722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1f049 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d121a8 expref: -99 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.402550:0:18722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1f050 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.402564:0:18722:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50200/0xce1582440fb1f026 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1219a expref: 12 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.402570:0:18722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1f050 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.402602:0:18722:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50200/0xce1582440fb1f026 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1219a expref: 12 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.402628:0:18722:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50200/0xce1582440fb1f026 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1219a expref: 12 pid: 17193 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263844.402639:0:18722:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa92a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18722:1876178898139648:192.168.203.20@tcp:104: 00000100:00100000:3.0:1789263844.402796:0:18722:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd983164480 going to sleep for 11 seconds 00000100:00100000:3.0:1789263844.404203:0:18722:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa92a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18722:1876178898139648:192.168.203.20@tcp:104: 00000100:00100000:1.0:1789263844.404216:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00010000:00010000:3.0:1789263844.404232:0:18722:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1f050 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263844.404450:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888671744 00000100:00100000:0.0:1789263844.404456:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888671744 00010000:00010000:0.0:1789263844.404483:0:17177:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50200/0xce1582440fb1f026 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1219a expref: 13 pid: 17193 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263844.404518:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 16 00000100:00100000:0.0:1789263844.404526:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989ae0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9a1530e0-880b-4d94-ada1-a3a40d18af45+13:2398:x1876178888671744:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789263844.404540:0:17177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789263844.404547:0:17177:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50200/0xce1582440fb1f026 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1219a expref: 13 pid: 17193 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.404583:0:17177:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50200/0xce1582440fb1f026 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1219a expref: 13 pid: 17193 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.404599:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50200/0xce1582440fb1f026 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1219a expref: 13 pid: 17193 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.404610:0:17177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9dd9bb595c00) 00010000:00010000:0.0:1789263844.404614:0:17177:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1f050 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.404621:0:17177:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1f050 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.404626:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1f050 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.404648:0:17177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789263844.404688:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989ae0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9a1530e0-880b-4d94-ada1-a3a40d18af45+12:2398:x1876178888671744:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 163us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263844.404699:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 16 00010000:00010000:3.0:1789263844.404754:0:18722:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1f050 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.404761:0:18722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1f050 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.404788:0:18722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531c00/0xce1582440fb1f057 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.404795:0:18722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531c00/0xce1582440fb1f057 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.404800:0:18722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531c00/0xce1582440fb1f057 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.405338:0:18722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683800/0xce1582440fb1f05e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.405345:0:18722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683800/0xce1582440fb1f05e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.405351:0:18722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683800/0xce1582440fb1f05e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789263844.405360:0:18722:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789263844.405385:0:18722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1f050 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.405392:0:18722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1f050 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.405398:0:18722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1f050 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.405404:0:18722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981531a00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263844.405409:0:18722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1f050 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.405428:0:18722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1f050 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.405437:0:18722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9dd9bb595c00) 00010000:00010000:3.0:1789263844.405440:0:18722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789263844.405444:0:18722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1f050 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.405450:0:18722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1f050 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789263844.405462:0:18722:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005571f226 reply state 00000000b1325e9d transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531c00/0xce1582440fb1f057 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.405472:0:18722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531c00/0xce1582440fb1f057 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.405478:0:18722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9dd9bb595e00) 00010000:00010000:3.0:1789263844.405480:0:18722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789263844.405483:0:18722:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789263844.405515:0:18722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1f049 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d121a8 expref: 15 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.405530:0:18722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683800/0xce1582440fb1f05e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d121a8 expref: 14 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.405537:0:18722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dd9bb595100) 00010000:00010000:3.0:1789263844.405539:0:18722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1789263844.405541:0:18722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981683800, rc 0) 00000100:00100000:3.0:1789263844.405586:0:18722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989ae1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+15:15567:x1876178888671616:12345-192.168.203.20@tcp:101:bash.0 Request processed in 3215us (3363us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1789263844.405594:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 38 00000100:00100000:1.0:1789263844.413535:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263844.413599:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888671872 00000100:00100000:0.0:1789263844.413610:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888671872 00000100:00100000:0.0:1789263844.413668:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 39 00000100:00100000:0.0:1789263844.413680:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989ae0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+15:15567:x1876178888671872:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:0.0:1789263844.413701:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263844.413720:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50200/0xce1582440fb1f06c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d121af expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.413806:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50c00/0xce1582440fb1f073 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.413819:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50c00/0xce1582440fb1f073 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.413830:0:17191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50c00/0xce1582440fb1f073 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789263844.413884:0:17191:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789263844.413889:0:17191:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789263844.413909:0:17191:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50c00/0xce1582440fb1f073 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.413920:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50c00/0xce1582440fb1f073 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.413943:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50200/0xce1582440fb1f06c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d121af expref: 17 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.413959:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50c00/0xce1582440fb1f073 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d121af expref: 16 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.413966:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dd9bb595100) 00010000:00010000:0.0:1789263844.413969:0:17191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789263844.413973:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd987f50c00, rc 0) 00000100:00100000:0.0:1789263844.414031:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989ae0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+16:15567:x1876178888671872:12345-192.168.203.20@tcp:101:bash.0 Request processed in 354us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263844.414038:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 39 00000100:00100000:2.0:1789263844.415505:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263844.415549:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888672128 00000100:00100000:3.0:1789263844.415556:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888672128 00000100:00100000:3.0:1789263844.415599:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 5 00000100:00100000:3.0:1789263844.415607:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+16:15567:x1876178888672128:12345-192.168.203.20@tcp:35:bash.0 00000100:00100000:3.0:1789263844.415844:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+17:15567:x1876178888672128:12345-192.168.203.20@tcp:35:bash.0 Request processed in 237us (342us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1789263844.415855:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 5 00000100:00100000:1.0:1789263844.448917:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263844.448988:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888672384 00000100:00100000:0.0:1789263844.448999:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888672384 00000100:00100000:0.0:1789263844.449055:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 40 00000100:00100000:0.0:1789263844.449064:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989ae1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+17:15577:x1876178888672384:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:0.0:1789263844.449111:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263844.449130:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50200/0xce1582440fb1f07a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d121b6 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789263844.449254:0:17193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789263844.449359:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50200/0xce1582440fb1f07a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d121b6 expref: 19 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.449371:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd998414100) 00010000:00010000:0.0:1789263844.449373:0:17193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789263844.449376:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50200/0xce1582440fb1f07a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d121b6 expref: 19 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.449386:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd987f50200, rc 0) 00000100:00100000:0.0:1789263844.449445:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989ae1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+18:15577:x1876178888672384:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 382us (536us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1789263844.449452:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 40 00000100:00100000:1.0:1789263844.451280:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263844.451338:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888672640 00000100:00100000:0.0:1789263844.451348:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888672640 00000100:00100000:1.0:1789263844.451624:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 6 00000100:00100000:1.0:1789263844.451636:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989ae0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+18:15577:x1876178888672640:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:1.0:1789263844.451877:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989ae0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+19:15577:x1876178888672640:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 243us (602us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1789263844.451902:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 6 00000100:00100000:2.0:1789263844.471926:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263844.472039:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888672896 00000100:00100000:3.0:1789263844.472050:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888672896 00000100:00100000:3.0:1789263844.472191:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 41 00000100:00100000:3.0:1789263844.472204:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+19:15580:x1876178888672896:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:3.0:1789263844.472234:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263844.472255:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683600/0xce1582440fb1f088 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d121bd expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.472358:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981682200/0xce1582440fb1f08f lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.472373:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981682200/0xce1582440fb1f08f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.472385:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981682200/0xce1582440fb1f08f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789263844.472395:0:17192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789263844.472510:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683600/0xce1582440fb1f088 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d121bd expref: 22 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.472526:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981682200/0xce1582440fb1f08f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d121bd expref: 21 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.472534:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dd9bb595100) 00010000:00010000:3.0:1789263844.472537:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789263844.472541:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981682200, rc 0) 00000100:00100000:3.0:1789263844.472597:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+21:15580:x1876178888672896:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 396us (680us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1789263844.472604:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 41 00000100:00100000:3.0:1789263844.474273:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263844.474350:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888673024 00000100:00100000:0.0:1789263844.474361:0:18722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888673024 00000100:00100000:0.0:1789263844.474443:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 42 00000100:00100000:0.0:1789263844.474452:0:18722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+21:15580:x1876178888673024:12345-192.168.203.20@tcp:54:lfs.0 00010000:00010000:0.0:1789263844.474500:0:18722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50200/0xce1582440fb1f09d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.474525:0:18722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50200/0xce1582440fb1f09d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.474536:0:18722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50200/0xce1582440fb1f09d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.474562:0:18722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50200/0xce1582440fb1f09d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.474569:0:18722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50200/0xce1582440fb1f09d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.474576:0:18722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50200/0xce1582440fb1f09d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.474582:0:18722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd987f50200 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:0.0:1789263844.474586:0:18722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50200/0xce1582440fb1f09d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.474593:0:18722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50200/0xce1582440fb1f09d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.474602:0:18722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dd9bb595100) 00010000:00010000:0.0:1789263844.474605:0:18722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789263844.474609:0:18722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50200/0xce1582440fb1f09d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.474615:0:18722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50200/0xce1582440fb1f09d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263844.474672:0:18722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+21:15580:x1876178888673024:12345-192.168.203.20@tcp:54:lfs.0 Request processed in 218us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263844.474685:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 42 00000100:00100000:1.0:1789263844.610867:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263844.610925:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888673280 00000100:00100000:0.0:1789263844.610934:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888673280 00000100:00100000:0.0:1789263844.610991:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 43 00000100:00100000:0.0:1789263844.611000:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989ae3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+21:15617:x1876178888673280:12345-192.168.203.20@tcp:101:dd.0 00010000:00010000:0.0:1789263844.611018:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263844.611037:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50200/0xce1582440fb1f0a4 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d121c4 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.611162:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f0ab lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.611176:0:17191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683800/0xce1582440fb1f05e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d121a8 expref: 22 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.611198:0:17191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50c00/0xce1582440fb1f073 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d121af expref: 22 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.611206:0:17191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f0ab lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.611236:0:17191:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50c00/0xce1582440fb1f073 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d121af expref: 22 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.611268:0:17191:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50c00/0xce1582440fb1f073 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d121af expref: 22 pid: 17191 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263844.611282:0:17191:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17191:1876178898139776:192.168.203.20@tcp:104: 00010000:00010000:0.0:1789263844.611382:0:17191:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683800/0xce1582440fb1f05e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d121a8 expref: 22 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.611390:0:17191:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683800/0xce1582440fb1f05e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d121a8 expref: 22 pid: 18722 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263844.611405:0:17191:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17191:1876178898139904:192.168.203.20@tcp:104: 00000100:00100000:0.0:1789263844.611426:0:17191:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd98a6fb540 going to sleep for 11 seconds 00000100:00100000:0.0:1789263844.612583:0:17191:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17191:1876178898139776:192.168.203.20@tcp:104: 00000100:00100000:0.0:1789263844.613276:0:17191:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17191:1876178898139904:192.168.203.20@tcp:104: 00010000:00010000:0.0:1789263844.613297:0:17191:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f0ab lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263844.613423:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263844.613478:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888673408 00000100:00100000:2.0:1789263844.613492:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888673408 00010000:00010000:2.0:1789263844.613521:0:17178:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50c00/0xce1582440fb1f073 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d121af expref: 23 pid: 17191 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263844.613549:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 17 00000100:00100000:2.0:1789263844.613555:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa91f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+23:2397:x1876178888673408:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789263844.613565:0:17178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789263844.613570:0:17178:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50c00/0xce1582440fb1f073 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d121af expref: 23 pid: 17191 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263844.613586:0:17178:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50c00/0xce1582440fb1f073 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d121af expref: 23 pid: 17191 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263844.613600:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50c00/0xce1582440fb1f073 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d121af expref: 23 pid: 17191 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263844.613612:0:17178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dd9bb595100) 00010000:00010000:2.0:1789263844.613617:0:17178:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f0ab lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263844.613624:0:17178:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f0ab lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263844.613630:0:17178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789263844.613671:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa91f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+22:2397:x1876178888673408:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 115us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263844.613678:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 17 00000100:00100000:1.0:1789263844.613837:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263844.613874:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888673536 00000100:00100000:2.0:1789263844.613884:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888673536 00010000:00010000:2.0:1789263844.613898:0:17179:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683800/0xce1582440fb1f05e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d121a8 expref: 22 pid: 18722 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263844.613931:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 18 00000100:00100000:2.0:1789263844.613939:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989ae0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+22:2398:x1876178888673536:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789263844.613946:0:17179:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789263844.613951:0:17179:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683800/0xce1582440fb1f05e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d121a8 expref: 22 pid: 18722 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263844.613966:0:17179:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683800/0xce1582440fb1f05e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d121a8 expref: 22 pid: 18722 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263844.613978:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683800/0xce1582440fb1f05e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d121a8 expref: 22 pid: 18722 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263844.613988:0:17179:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dd9bb595100) 00010000:00010000:2.0:1789263844.613992:0:17179:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f0ab lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263844.613999:0:17179:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f0ab lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263844.614006:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f0ab lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263844.614028:0:17179:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789263844.614055:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989ae0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+21:2398:x1876178888673536:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 117us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263844.614072:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 18 00010000:00010000:0.0:1789263844.614072:0:17191:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f0ab lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.614111:0:17191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f0ab lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789263844.614129:0:17191:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789263844.614338:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50200/0xce1582440fb1f0a4 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d121c4 expref: 22 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.614353:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f0ab lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d121c4 expref: 21 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.614360:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dd9bb595100) 00010000:00010000:0.0:1789263844.614369:0:17191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789263844.614372:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd987f51600, rc 0) 00000100:00100000:0.0:1789263844.614405:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989ae3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+21:15617:x1876178888673280:12345-192.168.203.20@tcp:101:dd.0 Request processed in 3405us (3545us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1789263844.614412:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 43 00000100:00100000:1.0:1789263844.615815:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263844.615863:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888673664 00000100:00100000:3.0:1789263844.615872:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888673664 00000100:00100000:3.0:1789263844.615917:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 44 00000100:00100000:3.0:1789263844.615927:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989ae0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+21:15617:x1876178888673664:12345-192.168.203.20@tcp:101:dd.0 00010000:00010000:3.0:1789263844.615947:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263844.615962:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981682000/0xce1582440fb1f0b9 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d121cb expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.615991:0:17193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683600/0xce1582440fb1f0c0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.616003:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683600/0xce1582440fb1f0c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.616023:0:17193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683600/0xce1582440fb1f0c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.616155:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981682000/0xce1582440fb1f0b9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d121cb expref: 23 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.616173:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683600/0xce1582440fb1f0c0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d121cb expref: 22 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.616191:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dd9bb595100) 00010000:00010000:3.0:1789263844.616194:0:17193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789263844.616198:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981683600, rc 0) 00000100:00100000:3.0:1789263844.616241:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989ae0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+22:15617:x1876178888673664:12345-192.168.203.20@tcp:101:dd.0 Request processed in 316us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263844.616246:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 44 00000100:00100000:2.0:1789263844.617441:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263844.617531:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888673920 00000100:00100000:3.0:1789263844.617538:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888673920 00000100:00100000:3.0:1789263844.617577:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 45 00000100:00100000:3.0:1789263844.617585:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+22:15617:x1876178888673920:12345-192.168.203.20@tcp:36:dd.0 00010000:00010000:3.0:1789263844.617896:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683400/0xce1582440fb1f0c7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.617910:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683400/0xce1582440fb1f0c7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.617919:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683400/0xce1582440fb1f0c7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789263844.617961:0:17192:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934606 00000004:00010000:3.0:1789263844.617981:0:17192:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e4cf1394 reply state 000000007af27ac7 transno 8589934607 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683400/0xce1582440fb1f0c7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.618006:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683400/0xce1582440fb1f0c7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.618012:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dd9bb595100) 00010000:00010000:3.0:1789263844.618014:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789263844.618017:0:17192:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789263844.618360:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+25:15617:x1876178888673920:12345-192.168.203.20@tcp:36:dd.0 Request processed in 773us (921us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1789263844.618369:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 45 00000020:00080000:3.0:1789263844.618373:0:17192:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 10000000:01000000:1.0:1789263844.653160:0:17189:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789263844.653167:0:17189:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dd9bf6c0800 from 13 10000000:01000000:1.0:1789263844.653173:0:17189:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789263844.653230:0:17189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd8841a3a00/0xce1582440fb1f0ce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263844.653242:0:17189:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd8841a3a00/0xce1582440fb1f0ce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263844.653253:0:17189:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd8841a3a00/0xce1582440fb1f0ce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263844.653279:0:17189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989ae3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de026c8f-6636-4fc7-8061-42c8092f00f0:17189:1876178898140032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789263844.653343:0:17189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263844.653394:0:17189:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9872a5300 going to sleep for 11 seconds 00000100:00100000:3.0:1789263844.653464:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898140032 00000100:00100000:3.0:1789263844.653471:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898140032 00000100:00100000:3.0:1789263844.653518:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789263844.653528:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882aaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+20:17189:x1876178898140032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789263844.653540:0:17185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263844.653554:0:17185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd981682000/0xce1582440fb1f0d5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1f0ce expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.653579:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd981682000/0xce1582440fb1f0d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1f0ce expref: 21 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.653591:0:17185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd981682000/0xce1582440fb1f0d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1f0ce expref: 21 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.653599:0:17185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981682000, rc 0) 00000100:00100000:3.0:1789263844.653698:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882aaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+21:17189:x1876178898140032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 171us (353us total) trans 0 rc 0/0 00010000:00010000:0.0:1789263844.653704:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789263844.653706:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000040:00080000:2.0:1789263844.653737:0:17950:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789263844.653808:0:17189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989ae3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de026c8f-6636-4fc7-8061-42c8092f00f0:17189:1876178898140032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789263844.653823:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd8841a3a00/0xce1582440fb1f0ce lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f0d5 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263844.653833:0:17189:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd8841a3a00/0xce1582440fb1f0ce lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1f0d5 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263844.653887:0:17189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989ae3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de026c8f-6636-4fc7-8061-42c8092f00f0:17189:1876178898140160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789263844.653913:0:17189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263844.653939:0:17189:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9872a5300 going to sleep for 11 seconds 00000100:00100000:0.0:1789263844.653973:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898140160 00000100:00100000:0.0:1789263844.653979:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898140160 00000100:00100000:0.0:1789263844.654010:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789263844.654018:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882aaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de026c8f-6636-4fc7-8061-42c8092f00f0+21:17189:x1876178898140160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789263844.654151:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882aaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de026c8f-6636-4fc7-8061-42c8092f00f0+21:17189:x1876178898140160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 134us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263844.654156:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789263844.654187:0:17189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989ae3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de026c8f-6636-4fc7-8061-42c8092f00f0:17189:1876178898140160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789263844.654217:0:17189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989ae3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de026c8f-6636-4fc7-8061-42c8092f00f0:17189:1876178898140288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789263844.654264:0:17189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263844.654290:0:17189:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9872a5300 going to sleep for 11 seconds 00000100:00100000:3.0:1789263844.654312:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898140288 00000100:00100000:3.0:1789263844.654318:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898140288 00000100:00100000:3.0:1789263844.654346:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789263844.654353:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882aaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+21:17189:x1876178898140288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789263844.654442:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882aaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+21:17189:x1876178898140288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 89us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263844.654449:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789263844.654534:0:17189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989ae3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de026c8f-6636-4fc7-8061-42c8092f00f0:17189:1876178898140288:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789263844.655451:0:20327:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1789263844.655535:0:17189:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1789263844.655555:0:17189:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789263844.655562:0:17189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd8841a3a00/0xce1582440fb1f0ce lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f0d5 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.655569:0:17189:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd8841a3a00/0xce1582440fb1f0ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f0d5 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789263844.655576:0:17189:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789263844.655577:0:17189:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dd9bfa35800 from 13 10000000:01000000:0.0:1789263844.655579:0:17189:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789263844.655595:0:17189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd987f50200/0xce1582440fb1f0dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.655608:0:17189:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd987f50200/0xce1582440fb1f0dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.655630:0:17189:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd987f50200/0xce1582440fb1f0dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263844.655646:0:17189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de026c8f-6636-4fc7-8061-42c8092f00f0:17189:1876178898140416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789263844.655681:0:17189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263844.655710:0:17189:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd98a6fb600 going to sleep for 11 seconds 00000100:00100000:2.0:1789263844.655738:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898140416 00000100:00100000:2.0:1789263844.655744:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898140416 00000100:00100000:2.0:1789263844.655781:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789263844.655788:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882aafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de026c8f-6636-4fc7-8061-42c8092f00f0+21:17189:x1876178898140416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789263844.655797:0:17187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263844.655807:0:17187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd9bfa22400/0xce1582440fb1f0e3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1f0dc expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263844.655825:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd9bfa22400/0xce1582440fb1f0e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1f0dc expref: 22 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263844.655834:0:17187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd9bfa22400/0xce1582440fb1f0e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1f0dc expref: 22 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263844.655839:0:17187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bfa22400, rc 0) 00000100:00100000:2.0:1789263844.655871:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882aafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de026c8f-6636-4fc7-8061-42c8092f00f0+22:17189:x1876178898140416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 84us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263844.655877:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789263844.655892:0:17189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de026c8f-6636-4fc7-8061-42c8092f00f0:17189:1876178898140416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789263844.655904:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd987f50200/0xce1582440fb1f0dc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f0e3 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263844.655913:0:17189:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd987f50200/0xce1582440fb1f0dc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1f0e3 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263844.655956:0:17189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989ae3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de026c8f-6636-4fc7-8061-42c8092f00f0:17189:1876178898140544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789263844.655977:0:17189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263844.655998:0:17189:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9872a5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789263844.656020:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898140544 00000100:00100000:3.0:1789263844.656024:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898140544 00000100:00100000:3.0:1789263844.656068:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789263844.656101:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882aac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+22:17189:x1876178898140544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789263844.656199:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882aac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+22:17189:x1876178898140544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 124us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263844.656207:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789263844.656215:0:17189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989ae3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de026c8f-6636-4fc7-8061-42c8092f00f0:17189:1876178898140544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789263844.656248:0:17189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989ae3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de026c8f-6636-4fc7-8061-42c8092f00f0:17189:1876178898140672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789263844.656287:0:17189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263844.656328:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898140672 00000100:00100000:0.0:1789263844.656333:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898140672 00000100:00100000:0.0:1789263844.656365:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789263844.656373:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882aae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de026c8f-6636-4fc7-8061-42c8092f00f0+22:17189:x1876178898140672:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789263844.656379:0:17189:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9872a5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789263844.656454:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882aae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de026c8f-6636-4fc7-8061-42c8092f00f0+22:17189:x1876178898140672:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 81us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263844.656461:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789263844.656483:0:17189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989ae3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de026c8f-6636-4fc7-8061-42c8092f00f0:17189:1876178898140672:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789263844.657614:0:20328:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1789263844.657700:0:17189:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1789263844.657730:0:17189:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789263844.657738:0:17189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd987f50200/0xce1582440fb1f0dc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f0e3 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.657750:0:17189:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd987f50200/0xce1582440fb1f0dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f0e3 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789263844.657760:0:17189:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789263844.657762:0:17189:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dd9b7a92000 from 13 10000000:01000000:0.0:1789263844.657765:0:17189:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789263844.657787:0:17189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd987f51800/0xce1582440fb1f0ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.657794:0:17189:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd987f51800/0xce1582440fb1f0ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.657812:0:17189:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd987f51800/0xce1582440fb1f0ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263844.657832:0:17189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de026c8f-6636-4fc7-8061-42c8092f00f0:17189:1876178898140800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789263844.657871:0:17189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263844.657897:0:17189:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd98a6fb600 going to sleep for 11 seconds 00000100:00100000:3.0:1789263844.657913:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898140800 00000100:00100000:3.0:1789263844.657920:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898140800 00000100:00100000:3.0:1789263844.657957:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789263844.657964:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882aae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+22:17189:x1876178898140800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789263844.657973:0:17185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263844.657986:0:17185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd981683200/0xce1582440fb1f0f1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1f0ea expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.658006:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd981683200/0xce1582440fb1f0f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1f0ea expref: 23 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.658016:0:17185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd981683200/0xce1582440fb1f0f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1f0ea expref: 23 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.658034:0:17185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981683200, rc 0) 00000100:00100000:3.0:1789263844.658099:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882aae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+23:17189:x1876178898140800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263844.658106:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789263844.658273:0:17189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de026c8f-6636-4fc7-8061-42c8092f00f0:17189:1876178898140800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789263844.658284:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd987f51800/0xce1582440fb1f0ea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f0f1 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.658293:0:17189:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd987f51800/0xce1582440fb1f0ea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1f0f1 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263844.658349:0:17189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de026c8f-6636-4fc7-8061-42c8092f00f0:17189:1876178898140928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789263844.658374:0:17189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263844.658398:0:17189:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd98a6fb600 going to sleep for 11 seconds 00000100:00100000:2.0:1789263844.658462:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898140928 00000100:00100000:2.0:1789263844.658467:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898140928 00000100:00100000:2.0:1789263844.658501:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789263844.658509:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882aad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de026c8f-6636-4fc7-8061-42c8092f00f0+23:17189:x1876178898140928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789263844.658612:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882aad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de026c8f-6636-4fc7-8061-42c8092f00f0+23:17189:x1876178898140928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 103us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263844.658630:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789263844.658638:0:17189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de026c8f-6636-4fc7-8061-42c8092f00f0:17189:1876178898140928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789263844.658728:0:17189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de026c8f-6636-4fc7-8061-42c8092f00f0:17189:1876178898141056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789263844.658768:0:17189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263844.658786:0:17189:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd98a6fb600 going to sleep for 11 seconds 00000100:00100000:3.0:1789263844.658811:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898141056 00000100:00100000:3.0:1789263844.658816:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898141056 00000100:00100000:3.0:1789263844.658840:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789263844.658847:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882aad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+23:17189:x1876178898141056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789263844.658922:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882aad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+23:17189:x1876178898141056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263844.658929:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789263844.658947:0:17189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de026c8f-6636-4fc7-8061-42c8092f00f0:17189:1876178898141056:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789263844.659846:0:20329:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1789263844.660124:0:17189:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1789263844.660153:0:17189:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789263844.660161:0:17189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd987f51800/0xce1582440fb1f0ea lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f0f1 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263844.660171:0:17189:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd987f51800/0xce1582440fb1f0ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f0f1 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789263844.660190:0:17189:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789263844.660192:0:17189:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dd882a35000 from 13 10000000:01000000:1.0:1789263844.660196:0:17189:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789263844.660223:0:17189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd8841a2600/0xce1582440fb1f0f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263844.660232:0:17189:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd8841a2600/0xce1582440fb1f0f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263844.660242:0:17189:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd8841a2600/0xce1582440fb1f0f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263844.660258:0:17189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989ae3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de026c8f-6636-4fc7-8061-42c8092f00f0:17189:1876178898141184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789263844.660297:0:17189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263844.660335:0:17189:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9872a5780 going to sleep for 11 seconds 00000100:00100000:2.0:1789263844.660407:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898141184 00000100:00100000:2.0:1789263844.660415:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898141184 00000100:00100000:2.0:1789263844.660457:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789263844.660465:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd990736450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de026c8f-6636-4fc7-8061-42c8092f00f0+23:17189:x1876178898141184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789263844.660478:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263844.660492:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd9bfa22200/0xce1582440fb1f0ff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1f0f8 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263844.660514:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd9bfa22200/0xce1582440fb1f0ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1f0f8 expref: 24 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263844.660524:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd9bfa22200/0xce1582440fb1f0ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1f0f8 expref: 24 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263844.660532:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bfa22200, rc 0) 00000100:00100000:2.0:1789263844.660576:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd990736450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de026c8f-6636-4fc7-8061-42c8092f00f0+24:17189:x1876178898141184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263844.660584:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789263844.660736:0:17189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989ae3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de026c8f-6636-4fc7-8061-42c8092f00f0:17189:1876178898141184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789263844.660749:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd8841a2600/0xce1582440fb1f0f8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f0ff expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263844.660759:0:17189:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd8841a2600/0xce1582440fb1f0f8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1f0ff expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263844.660805:0:17189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989ae3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de026c8f-6636-4fc7-8061-42c8092f00f0:17189:1876178898141312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789263844.660838:0:17189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263844.660857:0:17189:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9872a5780 going to sleep for 11 seconds 00000100:00100000:3.0:1789263844.660886:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898141312 00000100:00100000:3.0:1789263844.660891:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898141312 00000100:00100000:3.0:1789263844.660923:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789263844.660930:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd990736c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+24:17189:x1876178898141312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789263844.661025:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd990736c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+24:17189:x1876178898141312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 96us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263844.661034:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789263844.661053:0:17189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989ae3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de026c8f-6636-4fc7-8061-42c8092f00f0:17189:1876178898141312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789263844.661103:0:17189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989ae3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de026c8f-6636-4fc7-8061-42c8092f00f0:17189:1876178898141440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789263844.661139:0:17189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263844.661165:0:17189:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9872a5780 going to sleep for 11 seconds 00000100:00100000:2.0:1789263844.661200:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898141440 00000100:00100000:2.0:1789263844.661206:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898141440 00000100:00100000:2.0:1789263844.661232:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789263844.661238:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd990736050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de026c8f-6636-4fc7-8061-42c8092f00f0+24:17189:x1876178898141440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789263844.661305:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd990736050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de026c8f-6636-4fc7-8061-42c8092f00f0+24:17189:x1876178898141440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 66us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263844.661312:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789263844.661335:0:17189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989ae3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de026c8f-6636-4fc7-8061-42c8092f00f0:17189:1876178898141440:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789263844.661997:0:20330:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1789263844.662222:0:17189:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1789263844.662240:0:17189:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789263844.662250:0:17189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd8841a2600/0xce1582440fb1f0f8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f0ff expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.662257:0:17189:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd8841a2600/0xce1582440fb1f0f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f0ff expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789263844.717672:0:17227:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789263844.730212:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263844.730323:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888674048 00000100:00100000:3.0:1789263844.730332:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888674048 00000100:00100000:3.0:1789263844.730384:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 151 00000100:00100000:3.0:1789263844.730396:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd990735050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9c31cd1-b03c-4865-98dc-92dea6862336+11:14882:x1876178888674048:12345-192.168.203.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789263844.730413:0:17185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263844.730428:0:17185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd981682600/0xce1582440fb1f106 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b612752c1d121d2 expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.730464:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd981682600/0xce1582440fb1f106 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d121d2 expref: 12 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.730472:0:17185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd981682600/0xce1582440fb1f106 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d121d2 expref: 12 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.730481:0:17185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981682600, rc 0) 00000100:00100000:3.0:1789263844.730537:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd990735050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9c31cd1-b03c-4865-98dc-92dea6862336+12:14882:x1876178888674048:12345-192.168.203.20@tcp:101:ll_cfg_requeue.0 Request processed in 143us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263844.730543:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 151 00000100:00100000:1.0:1789263844.731635:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263844.731695:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888674176 00000100:00100000:0.0:1789263844.731702:0:18722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888674176 00000100:00100000:1.0:1789263844.731793:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263844.731839:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888674304 00000100:00100000:0.0:1789263844.731846:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 46 00000100:00100000:2.0:1789263844.731853:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888674304 00000100:00100000:0.0:1789263844.731857:0:18722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989ae3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+25:15632:x1876178888674176:12345-192.168.203.20@tcp:101:stat.0 00010000:00010000:0.0:1789263844.731873:0:18722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263844.731885:0:18722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50800/0xce1582440fb1f10d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d121d9 expref: -99 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263844.731894:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 152 00000100:00100000:2.0:1789263844.731904:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd990734c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9c31cd1-b03c-4865-98dc-92dea6862336+12:14882:x1876178888674304:12345-192.168.203.20@tcp:501:ll_cfg_requeue.0 00010000:00010000:0.0:1789263844.731938:0:18722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50e00/0xce1582440fb1f114 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.731952:0:18722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50e00/0xce1582440fb1f114 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.731972:0:18722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50e00/0xce1582440fb1f114 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.731986:0:18722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50600/0xce1582440fb1f11b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.731994:0:18722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50600/0xce1582440fb1f11b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.732002:0:18722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50600/0xce1582440fb1f11b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263844.732007:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd990734c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9c31cd1-b03c-4865-98dc-92dea6862336+12:14882:x1876178888674304:12345-192.168.203.20@tcp:501:ll_cfg_requeue.0 Request processed in 105us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263844.732019:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 152 00010000:00010000:0.0:1789263844.732193:0:18722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51e00/0xce1582440fb1f122 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.732207:0:18722:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f0ab lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d121c4 expref: 26 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.732215:0:18722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51e00/0xce1582440fb1f122 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.732246:0:18722:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f0ab lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d121c4 expref: 26 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.732271:0:18722:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f0ab lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d121c4 expref: 26 pid: 17191 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263844.732284:0:18722:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18722:1876178898141568:192.168.203.20@tcp:104: 00000100:00100000:0.0:1789263844.732348:0:18722:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9ba82e480 going to sleep for 11 seconds 00000100:00100000:1.0:1789263844.732799:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263844.732914:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888674432 00000100:00100000:3.0:1789263844.732919:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888674432 00000100:00100000:3.0:1789263844.732952:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 153 00000100:00100000:3.0:1789263844.732960:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd990735c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9c31cd1-b03c-4865-98dc-92dea6862336+12:14882:x1876178888674432:12345-192.168.203.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789263844.733047:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd990735c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9c31cd1-b03c-4865-98dc-92dea6862336+12:14882:x1876178888674432:12345-192.168.203.20@tcp:503:ll_cfg_requeue.0 Request processed in 87us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263844.733055:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 153 00000100:00100000:0.0:1789263844.733438:0:18722:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18722:1876178898141568:192.168.203.20@tcp:104: 00010000:00010000:0.0:1789263844.733456:0:18722:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51e00/0xce1582440fb1f122 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263844.733798:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263844.733841:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888674688 00000100:00100000:0.0:1789263844.733846:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888674688 00000100:00100000:0.0:1789263844.733881:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 7 00000100:00100000:0.0:1789263844.733889:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989ae2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+27:14880:x1876178888674688:12345-192.168.203.20@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789263844.734097:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989ae2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+28:14880:x1876178888674688:12345-192.168.203.20@tcp:35:ldlm_bl.0 Request processed in 188us (279us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1789263844.734112:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 7 00000100:00100000:1.0:1789263844.736344:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263844.736384:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263844.736430:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888674816 00000100:00100000:2.0:1789263844.736438:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888674816 00000100:00100000:0.0:1789263844.736460:0:18344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888674944 00000100:00100000:0.0:1789263844.736464:0:18344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888674944 00000100:00100000:2.0:1789263844.736486:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 154 00010000:00010000:0.0:1789263844.736486:0:18344:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f0ab lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d121c4 expref: 28 pid: 17191 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263844.736496:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd990737c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9c31cd1-b03c-4865-98dc-92dea6862336+12:14882:x1876178888674816:12345-192.168.203.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789263844.736508:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263844.736523:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd9bfa23800/0xce1582440fb1f129 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b612752c1d121e0 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263844.736550:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd9bfa23800/0xce1582440fb1f129 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d121e0 expref: 13 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263844.736557:0:18344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 19 00010000:00010000:2.0:1789263844.736562:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd9bfa23800/0xce1582440fb1f129 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d121e0 expref: 13 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263844.736564:0:18344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989ae1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+28:2397:x1876178888674944:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789263844.736571:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bfa23800, rc 0) 00010000:00010000:0.0:1789263844.736573:0:18344:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789263844.736579:0:18344:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f0ab lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d121c4 expref: 28 pid: 17191 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.736602:0:18344:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f0ab lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d121c4 expref: 28 pid: 17191 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.736621:0:18344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f0ab lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d121c4 expref: 28 pid: 17191 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263844.736630:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd990737c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9c31cd1-b03c-4865-98dc-92dea6862336+13:14882:x1876178888674816:12345-192.168.203.20@tcp:101:ll_cfg_requeue.0 Request processed in 136us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263844.736636:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 154 00010000:00010000:0.0:1789263844.736636:0:18344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dd9bb595100) 00010000:00010000:0.0:1789263844.736640:0:18344:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51e00/0xce1582440fb1f122 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.736649:0:18344:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51e00/0xce1582440fb1f122 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.736655:0:18344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51e00/0xce1582440fb1f122 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.736701:0:18344:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789263844.736809:0:18344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989ae1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+27:2397:x1876178888674944:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 245us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263844.736816:0:18344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 19 00010000:00010000:2.0:1789263844.736820:0:18722:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51e00/0xce1582440fb1f122 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263844.736828:0:18722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51e00/0xce1582440fb1f122 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789263844.736887:0:18722:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789263844.736892:0:18722:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789263844.736927:0:18722:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51e00/0xce1582440fb1f122 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263844.736938:0:18722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51e00/0xce1582440fb1f122 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263844.736945:0:18722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50e00/0xce1582440fb1f114 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263844.736949:0:18722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50e00/0xce1582440fb1f114 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263844.736954:0:18722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50e00/0xce1582440fb1f114 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263844.736957:0:18722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd987f50e00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263844.736960:0:18722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50e00/0xce1582440fb1f114 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263844.736965:0:18722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50e00/0xce1582440fb1f114 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263844.736972:0:18722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9dd9bb595c00) 00010000:00010000:2.0:1789263844.736974:0:18722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789263844.736977:0:18722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50e00/0xce1582440fb1f114 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263844.736981:0:18722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50e00/0xce1582440fb1f114 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263844.736995:0:18722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50600/0xce1582440fb1f11b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263844.736999:0:18722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50600/0xce1582440fb1f11b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263844.737004:0:18722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50600/0xce1582440fb1f11b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263844.737009:0:18722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd987f50600 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263844.737013:0:18722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50600/0xce1582440fb1f11b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263844.737019:0:18722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50600/0xce1582440fb1f11b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263844.737026:0:18722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9dd9bb595e00) 00010000:00010000:2.0:1789263844.737029:0:18722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789263844.737032:0:18722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50600/0xce1582440fb1f11b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263844.737037:0:18722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50600/0xce1582440fb1f11b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263844.737065:0:18722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50800/0xce1582440fb1f10d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d121d9 expref: 27 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263844.737111:0:18722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51e00/0xce1582440fb1f122 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d121d9 expref: 26 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263844.737129:0:18722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dd9bb595100) 00010000:00010000:2.0:1789263844.737131:0:18722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789263844.737134:0:18722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd987f51e00, rc 0) 00000100:00100000:2.0:1789263844.737189:0:18722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989ae3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+26:15632:x1876178888674176:12345-192.168.203.20@tcp:101:stat.0 Request processed in 5325us (5547us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263844.737196:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 46 00000100:00100000:3.0:1789263844.738012:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263844.738072:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888675072 00000100:00100000:1.0:1789263844.738101:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888675072 00000100:00100000:1.0:1789263844.738141:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 155 00000100:00100000:1.0:1789263844.738161:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd990734450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9c31cd1-b03c-4865-98dc-92dea6862336+13:14882:x1876178888675072:12345-192.168.203.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789263844.738286:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd990734450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9c31cd1-b03c-4865-98dc-92dea6862336+13:14882:x1876178888675072:12345-192.168.203.20@tcp:501:ll_cfg_requeue.0 Request processed in 128us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263844.738295:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 155 00000100:00100000:1.0:1789263844.739138:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263844.739172:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888675200 00000100:00100000:2.0:1789263844.739195:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888675200 00000100:00100000:2.0:1789263844.739227:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 156 00000100:00100000:2.0:1789263844.739236:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd990736850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9c31cd1-b03c-4865-98dc-92dea6862336+13:14882:x1876178888675200:12345-192.168.203.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789263844.739332:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd990736850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9c31cd1-b03c-4865-98dc-92dea6862336+13:14882:x1876178888675200:12345-192.168.203.20@tcp:503:ll_cfg_requeue.0 Request processed in 96us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263844.739339:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 156 00000100:00100000:2.0:1789263844.763949:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263844.764049:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888675456 00000100:00100000:0.0:1789263844.764059:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888675456 00000100:00100000:0.0:1789263844.764133:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 47 00000100:00100000:0.0:1789263844.764143:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+26:15640:x1876178888675456:12345-192.168.203.20@tcp:36:truncate.0 00010000:00010000:0.0:1789263844.764208:0:17191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789263844.764247:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51e00/0xce1582440fb1f122 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d121d9 expref: 26 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.764266:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dd9bb595100) 00010000:00010000:0.0:1789263844.764273:0:17191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789263844.764430:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f130 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.764444:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f130 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.764454:0:17191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f130 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789263844.764492:0:17191:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1789263844.764516:0:17191:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c270d8b8 reply state 0000000037ae5d53 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f130 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.764528:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f130 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.764548:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dd9bb595100) 00010000:00010000:0.0:1789263844.764551:0:17191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789263844.764554:0:17191:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789263844.764668:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+28:15640:x1876178888675456:12345-192.168.203.20@tcp:36:truncate.0 Request processed in 527us (726us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1789263844.764676:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 47 00000020:00080000:0.0:1789263844.764680:0:17191:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789263844.837048:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263844.837190:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888675584 00000100:00100000:0.0:1789263844.837200:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888675584 00000100:00100000:0.0:1789263844.837259:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 48 00000100:00100000:0.0:1789263844.837268:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+28:15654:x1876178888675584:12345-192.168.203.20@tcp:101:stat.0 00010000:00010000:0.0:1789263844.837291:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263844.837309:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51e00/0xce1582440fb1f137 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d121e7 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.837372:0:17193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51000/0xce1582440fb1f13e lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.837387:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51000/0xce1582440fb1f13e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.837397:0:17193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51000/0xce1582440fb1f13e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.837407:0:17193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f145 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.837413:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f145 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.837437:0:17193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f145 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.837503:0:17193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50400/0xce1582440fb1f14c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.837512:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50400/0xce1582440fb1f14c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.837519:0:17193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50400/0xce1582440fb1f14c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789263844.837559:0:17193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:0.0:1789263844.837563:0:17193:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789263844.837582:0:17193:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50400/0xce1582440fb1f14c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.837593:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50400/0xce1582440fb1f14c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.837602:0:17193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51000/0xce1582440fb1f13e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.837609:0:17193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51000/0xce1582440fb1f13e lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.837615:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51000/0xce1582440fb1f13e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.837621:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd987f51000 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:0.0:1789263844.837625:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51000/0xce1582440fb1f13e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.837638:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51000/0xce1582440fb1f13e lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.837650:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9dd9bb595c00) 00010000:00010000:0.0:1789263844.837653:0:17193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789263844.837658:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51000/0xce1582440fb1f13e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.837664:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51000/0xce1582440fb1f13e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.837677:0:17193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f145 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.837684:0:17193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f145 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.837689:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f145 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.837694:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd987f50000 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:0.0:1789263844.837697:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f145 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.837704:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f145 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.837711:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9dd9bb595e00) 00010000:00010000:0.0:1789263844.837714:0:17193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789263844.837717:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f145 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.837730:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f145 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.837752:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51e00/0xce1582440fb1f137 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d121e7 expref: 30 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.837760:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50400/0xce1582440fb1f14c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d121e7 expref: 29 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.837766:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dd9bb595100) 00010000:00010000:0.0:1789263844.837768:0:17193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789263844.837771:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd987f50400, rc 0) 00000100:00100000:0.0:1789263844.837833:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+29:15654:x1876178888675584:12345-192.168.203.20@tcp:101:stat.0 Request processed in 565us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263844.837840:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 48 00000100:00100000:1.0:1789263844.879582:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263844.879640:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888675840 00000100:00100000:3.0:1789263844.879659:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888675840 00000100:00100000:3.0:1789263844.879724:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 49 00000100:00100000:3.0:1789263844.879738:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989ae2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+29:15664:x1876178888675840:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:3.0:1789263844.879759:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263844.879786:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683a00/0xce1582440fb1f153 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d121ee expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789263844.879904:0:17192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789263844.879995:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683a00/0xce1582440fb1f153 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d121ee expref: 31 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.880017:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd998414100) 00010000:00010000:3.0:1789263844.880020:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789263844.880025:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683a00/0xce1582440fb1f153 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d121ee expref: 31 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.880039:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981683a00, rc 0) 00000100:00100000:3.0:1789263844.880125:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989ae2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+30:15664:x1876178888675840:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 389us (548us total) trans 8589934611 rc 301/301 00000100:00100000:3.0:1789263844.880134:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 49 00000100:00100000:1.0:1789263844.881647:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263844.881702:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888676096 00000100:00100000:3.0:1789263844.881709:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888676096 00000100:00100000:3.0:1789263844.881758:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 8 00000100:00100000:3.0:1789263844.881766:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989ae1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+30:15664:x1876178888676096:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:3.0:1789263844.881927:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989ae1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+31:15664:x1876178888676096:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 160us (283us total) trans 8589934612 rc 0/0 00000100:00100000:3.0:1789263844.881934:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 8 00000100:00100000:1.0:1789263844.909761:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989aee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898141696:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789263844.909837:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263844.910017:0:18524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898141696 00000100:00100000:2.0:1789263844.910026:0:18524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898141696 00000100:00100000:2.0:1789263844.910168:0:18524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789263844.910189:0:18524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989ae3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1876178898141696:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789263844.910220:0:18524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1789263844.910277:0:18524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989ae3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1876178898141696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263844.910284:0:18524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789263844.910376:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989aee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898141696:0@lo:41:osp-pre-0-1.0 00000001:00100000:3.0:1789263844.910806:0:19510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9a1530e0-880b-4d94-ada1-a3a40d18af45 00000001:00100000:3.0:1789263844.910819:0:19510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of aea5b0bf-5091-4b59-8387-6d6e4df18cfc 00000100:00100000:1.0:1789263844.913818:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263844.913939:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888676352 00000100:00100000:0.0:1789263844.913949:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888676352 00000100:00100000:0.0:1789263844.914006:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 50 00000100:00100000:0.0:1789263844.914018:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989ae1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+31:15670:x1876178888676352:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:0.0:1789263844.914041:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263844.914066:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51e00/0xce1582440fb1f161 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d121f5 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.914204:0:17193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f168 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.914218:0:17193:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50400/0xce1582440fb1f14c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d121e7 expref: 32 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.914238:0:17193:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f168 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.914272:0:17193:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50400/0xce1582440fb1f14c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d121e7 expref: 32 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.914297:0:17193:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50400/0xce1582440fb1f14c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d121e7 expref: 32 pid: 17193 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263844.914311:0:17193:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17193:1876178898141824:192.168.203.20@tcp:104: 00000100:00100000:0.0:1789263844.914426:0:17193:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9ba82e480 going to sleep for 11 seconds 00000100:00100000:0.0:1789263844.915627:0:17193:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17193:1876178898141824:192.168.203.20@tcp:104: 00010000:00010000:0.0:1789263844.915648:0:17193:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f168 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263844.915840:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263844.915925:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888676480 00000100:00100000:0.0:1789263844.915930:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888676480 00010000:00010000:0.0:1789263844.915958:0:17177:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50400/0xce1582440fb1f14c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d121e7 expref: 33 pid: 17193 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263844.915996:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 20 00000100:00100000:0.0:1789263844.916005:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa62450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+33:2398:x1876178888676480:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789263844.916016:0:17177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789263844.916023:0:17177:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50400/0xce1582440fb1f14c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d121e7 expref: 33 pid: 17193 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.916059:0:17177:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50400/0xce1582440fb1f14c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d121e7 expref: 33 pid: 17193 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.916100:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50400/0xce1582440fb1f14c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d121e7 expref: 33 pid: 17193 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.916115:0:17177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dd9bb595100) 00010000:00010000:0.0:1789263844.916119:0:17177:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f168 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.916128:0:17177:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f168 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.916136:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f168 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.916184:0:17177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789263844.916205:0:17193:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f168 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.916224:0:17193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f168 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263844.916235:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa62450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+32:2398:x1876178888676480:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 230us (395us total) trans 0 rc 0/0 00000004:00200000:3.0:1789263844.916240:0:17193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000100:00100000:0.0:1789263844.916245:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 20 00010000:00010000:3.0:1789263844.916359:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51e00/0xce1582440fb1f161 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d121f5 expref: 33 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.916374:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f168 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d121f5 expref: 32 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.916379:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dd9bb595100) 00010000:00010000:3.0:1789263844.916381:0:17193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789263844.916382:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd987f50000, rc 0) 00000100:00100000:3.0:1789263844.916408:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989ae1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+32:15670:x1876178888676352:12345-192.168.203.20@tcp:101:bash.0 Request processed in 2394us (2600us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1789263844.916412:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 50 00000100:00100000:1.0:1789263844.917853:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263844.917900:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888676736 00000100:00100000:0.0:1789263844.917907:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888676736 00000100:00100000:0.0:1789263844.917947:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 51 00000100:00100000:0.0:1789263844.917955:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989ae3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+32:15670:x1876178888676736:12345-192.168.203.20@tcp:36:bash.0 00010000:00010000:0.0:1789263844.918166:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51000/0xce1582440fb1f176 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.918191:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51000/0xce1582440fb1f176 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.918213:0:17191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51000/0xce1582440fb1f176 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789263844.918257:0:17191:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934614 00000004:00010000:0.0:1789263844.918281:0:17191:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c0e356c8 reply state 00000000416fc1d7 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51000/0xce1582440fb1f176 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.918293:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51000/0xce1582440fb1f176 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.918301:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dd9bb595100) 00010000:00010000:0.0:1789263844.918303:0:17191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789263844.918321:0:17191:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789263844.918388:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989ae3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+35:15670:x1876178888676736:12345-192.168.203.20@tcp:36:bash.0 Request processed in 434us (539us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1789263844.918394:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 51 00000020:00080000:0.0:1789263844.918397:0:17191:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789263844.922036:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263844.922156:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888676864 00000100:00100000:2.0:1789263844.922166:0:18722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888676864 00000100:00100000:2.0:1789263844.922302:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 52 00000100:00100000:2.0:1789263844.922325:0:18722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989ae0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+35:15670:x1876178888676864:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:2.0:1789263844.922348:0:18722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263844.922368:0:18722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22c00/0xce1582440fb1f17d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d121fc expref: -99 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263844.922461:0:18722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23200/0xce1582440fb1f184 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263844.922479:0:18722:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f168 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d121f5 expref: 36 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263844.922488:0:18722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23200/0xce1582440fb1f184 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263844.922523:0:18722:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f168 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d121f5 expref: 36 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263844.922551:0:18722:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f168 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d121f5 expref: 36 pid: 17193 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263844.922565:0:18722:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88297f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18722:1876178898141952:192.168.203.20@tcp:104: 00000100:00100000:2.0:1789263844.922646:0:18722:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9b7a8c180 going to sleep for 11 seconds 00000100:00100000:1.0:1789263844.924015:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263844.924128:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888676992 00000100:00100000:2.0:1789263844.924134:0:18722:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88297f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18722:1876178898141952:192.168.203.20@tcp:104: 00000100:00100000:3.0:1789263844.924136:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888676992 00010000:00010000:2.0:1789263844.924160:0:18722:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23200/0xce1582440fb1f184 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.924169:0:17178:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f168 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d121f5 expref: 37 pid: 17193 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263844.924210:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 21 00000100:00100000:3.0:1789263844.924219:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989ae0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+37:2397:x1876178888676992:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789263844.924230:0:17178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789263844.924235:0:17178:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f168 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d121f5 expref: 37 pid: 17193 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.924264:0:17178:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f168 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d121f5 expref: 37 pid: 17193 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.924286:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f168 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d121f5 expref: 37 pid: 17193 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.924297:0:17178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dd9bb595100) 00010000:00010000:3.0:1789263844.924302:0:17178:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23200/0xce1582440fb1f184 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.924311:0:17178:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23200/0xce1582440fb1f184 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.924318:0:17178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23200/0xce1582440fb1f184 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.924341:0:17178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789263844.924398:0:18722:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23200/0xce1582440fb1f184 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263844.924417:0:18722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23200/0xce1582440fb1f184 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263844.924439:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989ae0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+36:2397:x1876178888676992:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 219us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263844.924448:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 21 00000004:00200000:2.0:1789263844.924460:0:18722:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789263844.924466:0:18722:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789263844.924486:0:18722:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23200/0xce1582440fb1f184 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263844.924509:0:18722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22c00/0xce1582440fb1f17d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d121fc expref: 36 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263844.924524:0:18722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23200/0xce1582440fb1f184 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d121fc expref: 35 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263844.924532:0:18722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dd9bb595100) 00010000:00010000:2.0:1789263844.924534:0:18722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789263844.924538:0:18722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bfa23200, rc 0) 00000100:00100000:2.0:1789263844.924566:0:18722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989ae0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+35:15670:x1876178888676864:12345-192.168.203.20@tcp:101:bash.0 Request processed in 2245us (2549us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263844.924571:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 52 00000100:00100000:1.0:1789263844.925943:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263844.926000:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888677248 00000100:00100000:3.0:1789263844.926008:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888677248 00000100:00100000:3.0:1789263844.926051:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 9 00000100:00100000:3.0:1789263844.926060:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989ae1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+35:15670:x1876178888677248:12345-192.168.203.20@tcp:35:bash.0 00000100:00100000:3.0:1789263844.926281:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989ae1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+36:15670:x1876178888677248:12345-192.168.203.20@tcp:35:bash.0 Request processed in 221us (339us total) trans 8589934616 rc 0/0 00000100:00100000:3.0:1789263844.926289:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 9 00000100:00100000:1.0:1789263844.959122:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263844.959173:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888677504 00000100:00100000:3.0:1789263844.959195:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888677504 00000100:00100000:3.0:1789263844.959256:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 53 00000100:00100000:3.0:1789263844.959264:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989ae2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+36:15680:x1876178888677504:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:3.0:1789263844.959283:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263844.959299:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683a00/0xce1582440fb1f18b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d12203 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.959417:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683c00/0xce1582440fb1f192 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.959431:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683c00/0xce1582440fb1f192 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.959443:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683c00/0xce1582440fb1f192 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789263844.959453:0:17192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789263844.959544:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683a00/0xce1582440fb1f18b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12203 expref: 39 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.959561:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683c00/0xce1582440fb1f192 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12203 expref: 38 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.959569:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9dd9bb595c00) 00010000:00010000:3.0:1789263844.959572:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789263844.959575:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981683c00, rc 0) 00000100:00100000:3.0:1789263844.959628:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989ae2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+38:15680:x1876178888677504:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 364us (515us total) trans 8589934617 rc 0/0 00000100:00100000:3.0:1789263844.959645:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 53 00000100:00100000:1.0:1789263844.961162:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263844.961213:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888677632 00000100:00100000:3.0:1789263844.961221:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888677632 00000100:00100000:3.0:1789263844.961261:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 54 00000100:00100000:3.0:1789263844.961270:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+38:15680:x1876178888677632:12345-192.168.203.20@tcp:34:lfs.0 00010000:00010000:3.0:1789263844.961325:0:17193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683000/0xce1582440fb1f1a0 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.961350:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683000/0xce1582440fb1f1a0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.961361:0:17193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683000/0xce1582440fb1f1a0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.961373:0:17193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683e00/0xce1582440fb1f1a7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.961381:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683e00/0xce1582440fb1f1a7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.961387:0:17193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683e00/0xce1582440fb1f1a7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.961454:0:17193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683800/0xce1582440fb1f1ae lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.961463:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683800/0xce1582440fb1f1ae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.961471:0:17193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683800/0xce1582440fb1f1ae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789263844.961520:0:17193:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683800/0xce1582440fb1f1ae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.961529:0:17193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683000/0xce1582440fb1f1a0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.961534:0:17193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683000/0xce1582440fb1f1a0 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.961538:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683000/0xce1582440fb1f1a0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.961542:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981683000 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263844.961544:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683000/0xce1582440fb1f1a0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.961549:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683000/0xce1582440fb1f1a0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.961558:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9dd9bb595c00) 00010000:00010000:3.0:1789263844.961560:0:17193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789263844.961564:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683000/0xce1582440fb1f1a0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.961570:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683000/0xce1582440fb1f1a0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.961581:0:17193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683e00/0xce1582440fb1f1a7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.961587:0:17193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683e00/0xce1582440fb1f1a7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.961599:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683e00/0xce1582440fb1f1a7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.961604:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981683e00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263844.961607:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683e00/0xce1582440fb1f1a7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.961614:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683e00/0xce1582440fb1f1a7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.961622:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9dd9bb595e00) 00010000:00010000:3.0:1789263844.961624:0:17193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789263844.961626:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683e00/0xce1582440fb1f1a7 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.961630:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683e00/0xce1582440fb1f1a7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.961637:0:17193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683800/0xce1582440fb1f1ae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.961641:0:17193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683800/0xce1582440fb1f1ae lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.961644:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683800/0xce1582440fb1f1ae lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.961647:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981683800 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263844.961648:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683800/0xce1582440fb1f1ae lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.961659:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683800/0xce1582440fb1f1ae lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.961664:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dd9bb595100) 00010000:00010000:3.0:1789263844.961665:0:17193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789263844.961666:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683800/0xce1582440fb1f1ae lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263844.961670:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683800/0xce1582440fb1f1ae lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263844.961732:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+38:15680:x1876178888677632:12345-192.168.203.20@tcp:34:lfs.0 Request processed in 463us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263844.961740:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 54 00000100:00100000:1.0:1789263844.980598:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263844.980666:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888677888 00000100:00100000:0.0:1789263844.980683:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888677888 00000100:00100000:0.0:1789263844.980809:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 55 00000100:00100000:0.0:1789263844.980820:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+38:15683:x1876178888677888:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:0.0:1789263844.980847:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263844.980867:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50400/0xce1582440fb1f1b5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d1220a expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.980960:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51400/0xce1582440fb1f1bc lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.980976:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51400/0xce1582440fb1f1bc lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.980999:0:17191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51400/0xce1582440fb1f1bc lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.981013:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f1c3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.981022:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f1c3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.981029:0:17191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f1c3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.981158:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51e00/0xce1582440fb1f1ca lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.981169:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51e00/0xce1582440fb1f1ca lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.981191:0:17191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51e00/0xce1582440fb1f1ca lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789263844.981202:0:17191:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789263844.981276:0:17191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51400/0xce1582440fb1f1bc lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.981284:0:17191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51400/0xce1582440fb1f1bc lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.981292:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51400/0xce1582440fb1f1bc lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.981299:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd987f51400 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:0.0:1789263844.981310:0:17191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51400/0xce1582440fb1f1bc lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.981319:0:17191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51400/0xce1582440fb1f1bc lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.981331:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9dd9bb595c00) 00010000:00010000:0.0:1789263844.981335:0:17191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789263844.981338:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51400/0xce1582440fb1f1bc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.981344:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51400/0xce1582440fb1f1bc lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.981358:0:17191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f1c3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.981363:0:17191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f1c3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.981369:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f1c3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.981375:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd987f50000 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:0.0:1789263844.981378:0:17191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f1c3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.981383:0:17191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f1c3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.981391:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9dd9bb595e00) 00010000:00010000:0.0:1789263844.981393:0:17191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789263844.981401:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f1c3 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.981406:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f1c3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.981438:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50400/0xce1582440fb1f1b5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1220a expref: 41 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.981449:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51e00/0xce1582440fb1f1ca lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1220a expref: 40 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263844.981456:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dd9bb595100) 00010000:00010000:0.0:1789263844.981459:0:17191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789263844.981461:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd987f51e00, rc 0) 00000100:00100000:0.0:1789263844.981518:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+40:15683:x1876178888677888:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 700us (928us total) trans 8589934618 rc 0/0 00000100:00100000:0.0:1789263844.981525:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 55 00000100:00100000:1.0:1789263844.984237:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263844.984282:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263844.984346:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888678144 00000100:00100000:2.0:1789263844.984353:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888678144 00000100:00100000:2.0:1789263844.984407:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 0 00000100:00100000:2.0:1789263844.984417:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e31880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+40:2398:x1876178888678144:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789263844.984431:0:17177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789263844.984453:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51e00/0xce1582440fb1f1ca lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1220a expref: 40 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263844.984487:0:17177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dd9bb595100) 00010000:00010000:2.0:1789263844.984492:0:17177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789263844.984535:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888678272 00000100:00100000:0.0:1789263844.984541:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888678272 00000100:00100000:2.0:1789263844.984543:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e31880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+39:2398:x1876178888678144:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 126us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263844.984553:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 0 00000100:00100000:0.0:1789263844.984578:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 10 00000100:00100000:0.0:1789263844.984589:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c0ae6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+39:15683:x1876178888678272:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:0.0:1789263844.984775:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c0ae6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+40:15683:x1876178888678272:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 189us (545us total) trans 8589934619 rc 0/0 00000100:00100000:0.0:1789263844.984783:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 10 00000100:00100000:1.0:1789263844.985914:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263844.985972:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888678400 00000100:00100000:2.0:1789263844.985979:0:18722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888678400 00000100:00100000:2.0:1789263844.986029:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 56 00000100:00100000:2.0:1789263844.986040:0:18722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+40:15683:x1876178888678400:12345-192.168.203.20@tcp:54:lfs.0 00010000:00010000:2.0:1789263844.986148:0:18722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22c00/0xce1582440fb1f1d8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263844.986164:0:18722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22c00/0xce1582440fb1f1d8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263844.986185:0:18722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22c00/0xce1582440fb1f1d8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263844.986214:0:18722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22c00/0xce1582440fb1f1d8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263844.986222:0:18722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22c00/0xce1582440fb1f1d8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263844.986228:0:18722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22c00/0xce1582440fb1f1d8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263844.986234:0:18722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bfa22c00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263844.986248:0:18722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22c00/0xce1582440fb1f1d8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263844.986255:0:18722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22c00/0xce1582440fb1f1d8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263844.986266:0:18722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dd9bb595100) 00010000:00010000:2.0:1789263844.986269:0:18722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789263844.986272:0:18722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22c00/0xce1582440fb1f1d8 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263844.986278:0:18722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22c00/0xce1582440fb1f1d8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263844.986325:0:18722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+40:15683:x1876178888678400:12345-192.168.203.20@tcp:54:lfs.0 Request processed in 288us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263844.986332:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 56 00000100:00100000:1.0:1789263845.064630:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263845.065437:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888678528 00000100:00100000:3.0:1789263845.065451:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888678528 00000100:00100000:3.0:1789263845.065780:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 57 00000100:00100000:3.0:1789263845.065794:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+40:15702:x1876178888678528:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:3.0:1789263845.065821:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263845.065847:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683800/0xce1582440fb1f1df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d12211 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.065931:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683e00/0xce1582440fb1f1e6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.065949:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683e00/0xce1582440fb1f1e6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.065964:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683e00/0xce1582440fb1f1e6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789263845.066040:0:17192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789263845.066044:0:17192:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789263845.066068:0:17192:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683e00/0xce1582440fb1f1e6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.066130:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683800/0xce1582440fb1f1df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12211 expref: 42 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.066150:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683e00/0xce1582440fb1f1e6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12211 expref: 41 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.066159:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9dd9bb595c00) 00010000:00010000:3.0:1789263845.066162:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789263845.066166:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981683e00, rc 0) 00000100:00100000:3.0:1789263845.066263:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+41:15702:x1876178888678528:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 468us (1641us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263845.066271:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 57 00000100:00100000:1.0:1789263845.070319:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263845.070409:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888678912 00000100:00100000:3.0:1789263845.070422:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888678912 00000100:00100000:3.0:1789263845.070498:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 11 00000100:00100000:3.0:1789263845.070510:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+41:15702:x1876178888678912:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:3.0:1789263845.070883:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+42:15702:x1876178888678912:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 374us (573us total) trans 8589934620 rc 0/0 00000100:00100000:3.0:1789263845.070890:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 11 00000100:00100000:1.0:1789263845.072395:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263845.072475:0:18344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888679040 00000100:00100000:0.0:1789263845.072487:0:18344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888679040 00000100:00100000:0.0:1789263845.072563:0:18344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 1 00000100:00100000:0.0:1789263845.072575:0:18344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e30e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+42:15702:x1876178888679040:12345-192.168.203.20@tcp:103:lfs.0 00010000:00010000:0.0:1789263845.072611:0:18344:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1789263845.072644:0:18344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23200/0xce1582440fb1f184 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d121fc expref: 42 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263845.072669:0:18344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981682200/0xce1582440fb1f08f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d121bd expref: 41 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263845.072701:0:18344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dd9bb595100) 00010000:00010000:0.0:1789263845.072707:0:18344:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789263845.072768:0:18344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e30e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+40:15702:x1876178888679040:12345-192.168.203.20@tcp:103:lfs.0 Request processed in 196us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263845.072777:0:18344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 1 00000100:00100000:1.0:1789263845.074063:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263845.074188:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888679168 00000100:00100000:3.0:1789263845.074198:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888679168 00000100:00100000:3.0:1789263845.074266:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 58 00000100:00100000:3.0:1789263845.074276:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+40:15702:x1876178888679168:12345-192.168.203.20@tcp:58:lfs.0 00010000:00010000:3.0:1789263845.074377:0:17193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683800/0xce1582440fb1f1ed lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.074389:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683800/0xce1582440fb1f1ed lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.074397:0:17193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683800/0xce1582440fb1f1ed lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789263845.075071:0:17193:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789263845.075107:0:17193:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:3.0:1789263845.075254:0:17193:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:3.0:1789263845.075326:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+40:15702:x1876178888679168:12345-192.168.203.20@tcp:58:lfs.0 Request processed in 1051us (1266us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263845.075335:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 58 00000100:00100000:1.0:1789263845.085748:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263845.085800:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888679296 00000100:00100000:0.0:1789263845.085811:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888679296 00000100:00100000:0.0:1789263845.085867:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 59 00000100:00100000:0.0:1789263845.085877:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+40:15704:x1876178888679296:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:0.0:1789263845.085897:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263845.085916:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50400/0xce1582440fb1f1f4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d12218 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263845.085976:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f1fb lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263845.085988:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f1fb lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263845.085997:0:17191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f1fb lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263845.086033:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51400/0xce1582440fb1f202 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263845.086042:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51400/0xce1582440fb1f202 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263845.086048:0:17191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51400/0xce1582440fb1f202 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263845.086142:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50800/0xce1582440fb1f209 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263845.086164:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50800/0xce1582440fb1f209 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263845.086171:0:17191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50800/0xce1582440fb1f209 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789263845.086222:0:17191:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789263845.086227:0:17191:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789263845.086253:0:17191:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50800/0xce1582440fb1f209 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263845.086264:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50800/0xce1582440fb1f209 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263845.086272:0:17191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f1fb lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263845.086278:0:17191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f1fb lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263845.086296:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f1fb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263845.086302:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd987f50000 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:0.0:1789263845.086305:0:17191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f1fb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263845.086318:0:17191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f1fb lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263845.086329:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9dd9bb595c00) 00010000:00010000:0.0:1789263845.086333:0:17191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789263845.086338:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f1fb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263845.086344:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f1fb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263845.086368:0:17191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51400/0xce1582440fb1f202 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263845.086373:0:17191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51400/0xce1582440fb1f202 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263845.086379:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51400/0xce1582440fb1f202 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263845.086384:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd987f51400 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:0.0:1789263845.086387:0:17191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51400/0xce1582440fb1f202 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263845.086402:0:17191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51400/0xce1582440fb1f202 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263845.086412:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9dd9bb595e00) 00010000:00010000:0.0:1789263845.086414:0:17191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789263845.086418:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51400/0xce1582440fb1f202 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263845.086423:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51400/0xce1582440fb1f202 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263845.086449:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50400/0xce1582440fb1f1f4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12218 expref: 42 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263845.086459:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50800/0xce1582440fb1f209 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12218 expref: 41 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263845.086463:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dd9bb595100) 00010000:00010000:0.0:1789263845.086465:0:17191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789263845.086467:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd987f50800, rc 0) 00000100:00100000:0.0:1789263845.086522:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+41:15704:x1876178888679296:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 646us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263845.086529:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 59 00000100:00100000:3.0:1789263845.421206:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989aeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898142080:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789263845.421360:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263845.421408:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898142080 00000100:00100000:2.0:1789263845.421416:0:18700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898142080 00000100:00100000:2.0:1789263845.421479:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1789263845.421498:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789263845.421580:0:18700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989aed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876178898142080:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789263845.421625:0:18700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789263845.421681:0:18700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989aed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876178898142080:12345-0@lo:13:osp-pre-1-1.0 Request processed in 192us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263845.421689:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000001:00100000:1.0:1789263845.422036:0:17923:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 9a1530e0-880b-4d94-ada1-a3a40d18af45 00000100:00100000:3.0:1789263845.422102:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989aeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898142080:0@lo:13:osp-pre-1-1.0 00000040:00080000:2.0:1789263845.427524:0:20368:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789263845.427535:0:20368:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789263845.427577:0:20368:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1789263845.427583:0:20368:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1789263845.677277:0:20218:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789263845.741299:0:17227:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789263845.741308:0:17227:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789263845.741341:0:17227:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1789263845.741350:0:17227:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1789263845.741474:0:17227:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397c000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17227:1876178898142208:192.168.203.20@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789263845.741570:0:17227:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9c09d7d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789263845.743041:0:17227:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397c000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17227:1876178898142208:192.168.203.20@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789263845.743308:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263845.743367:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888679424 00000100:00100000:2.0:1789263845.743381:0:18722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888679424 00000100:00100000:2.0:1789263845.743432:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 60 00000100:00100000:2.0:1789263845.743442:0:18722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+41:15716:x1876178888679424:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789263845.743469:0:18722:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789263845.743564:0:18722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+41:15716:x1876178888679424:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 Request processed in 123us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263845.743572:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 60 00000100:00100000:1.0:1789263845.744648:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263845.744693:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888679552 00000100:00100000:3.0:1789263845.744698:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888679552 00000100:00100000:3.0:1789263845.744726:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 61 00000100:00100000:3.0:1789263845.744732:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+41:15716:x1876178888679552:12345-192.168.203.20@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789263845.744775:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683000/0xce1582440fb1f210 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.744787:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683000/0xce1582440fb1f210 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.744805:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683000/0xce1582440fb1f210 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.744853:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683a00/0xce1582440fb1f217 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.744861:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683a00/0xce1582440fb1f217 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.744873:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683a00/0xce1582440fb1f217 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.744897:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981682200/0xce1582440fb1f21e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.744907:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981682200/0xce1582440fb1f21e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.744914:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981682200/0xce1582440fb1f21e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789263845.744950:0:17192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1789263845.744954:0:17192:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789263845.744966:0:17192:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981682200/0xce1582440fb1f21e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.744977:0:17192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683000/0xce1582440fb1f210 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.744984:0:17192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683000/0xce1582440fb1f210 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.745001:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683000/0xce1582440fb1f210 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.745008:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981683000 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263845.745012:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683000/0xce1582440fb1f210 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.745019:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683000/0xce1582440fb1f210 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.745031:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9dd9bb595f00) 00010000:00010000:3.0:1789263845.745033:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789263845.745036:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683000/0xce1582440fb1f210 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.745042:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683000/0xce1582440fb1f210 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.745055:0:17192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683a00/0xce1582440fb1f217 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.745061:0:17192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683a00/0xce1582440fb1f217 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.745067:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683a00/0xce1582440fb1f217 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.745072:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981683a00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263845.745106:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683a00/0xce1582440fb1f217 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.745119:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683a00/0xce1582440fb1f217 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.745125:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9dd9bb595200) 00010000:00010000:3.0:1789263845.745127:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789263845.745130:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683a00/0xce1582440fb1f217 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.745134:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683a00/0xce1582440fb1f217 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.745147:0:17192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981682200/0xce1582440fb1f21e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.745151:0:17192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981682200/0xce1582440fb1f21e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.745155:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981682200/0xce1582440fb1f21e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.745158:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981682200 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263845.745160:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981682200/0xce1582440fb1f21e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.745163:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981682200/0xce1582440fb1f21e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.745167:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dd9bb595100) 00010000:00010000:3.0:1789263845.745168:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789263845.745183:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981682200/0xce1582440fb1f21e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.745199:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981682200/0xce1582440fb1f21e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263845.745249:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+41:15716:x1876178888679552:12345-192.168.203.20@tcp:34:lhsmtool_posix.0 Request processed in 517us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263845.745255:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 61 00000100:00100000:1.0:1789263845.746265:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263845.746302:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888679808 00000100:00100000:3.0:1789263845.746309:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888679808 00000100:00100000:3.0:1789263845.746348:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 62 00000100:00100000:3.0:1789263845.746356:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+41:15716:x1876178888679808:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789263845.746386:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263845.746401:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1f225 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d1221f expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.746489:0:17193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1f22c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.746501:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1f22c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.746510:0:17193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1f22c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789263845.746520:0:17193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789263845.746591:0:17193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1f22c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.746598:0:17193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1f22c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.746617:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1f22c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.746623:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981531a00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263845.746627:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1f22c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.746634:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1f22c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.746644:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dd9bb595100) 00010000:00010000:3.0:1789263845.746647:0:17193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789263845.746650:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1f22c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.746656:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1f22c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.746696:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1f225 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1221f expref: 43 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.746710:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9dd9bb595f00) 00010000:00010000:3.0:1789263845.746712:0:17193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789263845.746716:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1f225 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1221f expref: 43 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.746726:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981530400, rc 0) 00000100:00100000:3.0:1789263845.746769:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+42:15716:x1876178888679808:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 413us (504us total) trans 8589934621 rc 301/301 00000100:00100000:3.0:1789263845.746790:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 62 00000100:00100000:1.0:1789263845.747890:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263845.747967:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888679936 00000100:00100000:0.0:1789263845.747974:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888679936 00000100:00100000:0.0:1789263845.748020:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 63 00000100:00100000:0.0:1789263845.748029:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+42:15716:x1876178888679936:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789263845.748055:0:17191:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789263845.748182:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+42:15716:x1876178888679936:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 Request processed in 144us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263845.748191:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 63 00000100:00100000:1.0:1789263845.749213:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263845.749286:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888680192 00000100:00100000:2.0:1789263845.749292:0:18722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888680192 00000100:00100000:2.0:1789263845.749353:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 64 00000100:00100000:2.0:1789263845.749360:0:18722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+42:15716:x1876178888680192:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789263845.749372:0:18722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263845.749375:0:18722:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789263845.749394:0:18722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683e00/0xce1582440fb1f1e6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12211 expref: 42 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.749409:0:18722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9dd9bb595c00) 00010000:00010000:2.0:1789263845.749413:0:18722:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789263845.749424:0:18722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22a00/0xce1582440fb1f23a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d12226 expref: -99 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789263845.749737:0:18722:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x6:0x0], count =28 00000004:00080000:2.0:1789263845.749746:0:18722:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x6:0x0]+28 in llog 00000004:00080000:2.0:1789263845.749769:0:18722:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x22:0x0], index 1: 0 00010000:00010000:2.0:1789263845.749914:0:18722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23a00/0xce1582440fb1f241 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.749932:0:18722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23a00/0xce1582440fb1f241 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.749950:0:18722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23a00/0xce1582440fb1f241 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.749992:0:18722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22a00/0xce1582440fb1f23a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12226 expref: 44 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.750006:0:18722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23a00/0xce1582440fb1f241 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12226 expref: 43 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.750013:0:18722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9dd882850300) 00010000:00010000:2.0:1789263845.750015:0:18722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789263845.750018:0:18722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bfa23a00, rc 0) 00000100:00100000:2.0:1789263845.750102:0:18722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+43:15716:x1876178888680192:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 714us (864us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1789263845.750112:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 64 00000100:00100000:1.0:1789263845.751778:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263845.751824:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888680448 00000100:00100000:3.0:1789263845.751832:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888680448 00000100:00100000:3.0:1789263845.751887:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 65 00000100:00100000:3.0:1789263845.751896:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+43:15716:x1876178888680448:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789263845.751938:0:17192:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789263845.751959:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23a00/0xce1582440fb1f241 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12226 expref: 43 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.751973:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9dd882850300) 00010000:00010000:3.0:1789263845.751982:0:17192:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789263845.751997:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531200/0xce1582440fb1f24f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.752010:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531200/0xce1582440fb1f24f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.752018:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531200/0xce1582440fb1f24f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.752069:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1f256 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x708f648b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.752103:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1f256 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x708f648b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.752112:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1f256 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x708f648b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.752187:0:17192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531200/0xce1582440fb1f24f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.752195:0:17192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531200/0xce1582440fb1f24f lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.752201:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531200/0xce1582440fb1f24f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.752207:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981531200 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263845.752211:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531200/0xce1582440fb1f24f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.752218:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531200/0xce1582440fb1f24f lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.752227:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9dd9bb595c00) 00010000:00010000:3.0:1789263845.752229:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789263845.752233:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531200/0xce1582440fb1f24f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.752239:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531200/0xce1582440fb1f24f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.752258:0:17192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1f256 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x708f648b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.752264:0:17192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1f256 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x708f648b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.752270:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1f256 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x708f648b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.752281:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981531600 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263845.752285:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1f256 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x708f648b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.752291:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1f256 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x708f648b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.752300:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x708f648b (ffff9dd9bb595600) 00010000:00010000:3.0:1789263845.752302:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789263845.752305:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1f256 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x708f648b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.752311:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1f256 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x708f648b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263845.752375:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+42:15716:x1876178888680448:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 Request processed in 479us (599us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789263845.752382:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 65 00000100:00100000:1.0:1789263845.753282:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263845.753334:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888680576 00000100:00100000:3.0:1789263845.753340:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888680576 00000100:00100000:3.0:1789263845.753381:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 66 00000100:00100000:3.0:1789263845.753388:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+42:15716:x1876178888680576:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789263845.753397:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263845.753418:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1f25d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d1222d expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.753445:0:17193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683000/0xce1582440fb1f264 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.753466:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683000/0xce1582440fb1f264 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.753474:0:17193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683000/0xce1582440fb1f264 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.753545:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1f25d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1222d expref: 44 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.753556:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683000/0xce1582440fb1f264 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1222d expref: 43 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.753561:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9dd9bb595500) 00010000:00010000:3.0:1789263845.753563:0:17193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789263845.753565:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981683000, rc 0) 00000100:00100000:3.0:1789263845.753592:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+43:15716:x1876178888680576:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 206us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263845.753597:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 66 00000100:00100000:1.0:1789263845.754685:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263845.754733:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888680832 00000100:00100000:2.0:1789263845.754740:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888680832 00000100:00100000:2.0:1789263845.754779:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 67 00000100:00100000:2.0:1789263845.754789:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+43:15716:x1876178888680832:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789263845.754841:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22e00/0xce1582440fb1f26b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.754852:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22e00/0xce1582440fb1f26b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.754859:0:17191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22e00/0xce1582440fb1f26b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789263845.755020:0:17191:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:2.0:1789263845.755030:0:17191:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 288044952765ns, next at 289044950393ns, rc = 0 00000004:00010000:2.0:1789263845.755106:0:17191:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005225e4f3 reply state 00000000cea7f0d4 transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22e00/0xce1582440fb1f26b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.755119:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22e00/0xce1582440fb1f26b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.755126:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9dd9bb595500) 00010000:00010000:2.0:1789263845.755129:0:17191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1789263845.755133:0:17191:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789263845.755220:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+45:15716:x1876178888680832:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 Request processed in 432us (537us total) trans 8589934623 rc 0/0 00000100:00100000:2.0:1789263845.755227:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 67 00000100:00100000:1.0:1789263845.756058:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263845.756106:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888680960 00000100:00100000:2.0:1789263845.756113:0:18722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888680960 00000100:00100000:2.0:1789263845.756157:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 68 00000100:00100000:2.0:1789263845.756167:0:18722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+45:15716:x1876178888680960:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789263845.756190:0:18722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263845.756201:0:18722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22a00/0xce1582440fb1f272 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d12234 expref: -99 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.756237:0:18722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22a00/0xce1582440fb1f272 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12234 expref: 46 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.756250:0:18722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22a00/0xce1582440fb1f272 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12234 expref: 46 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.756282:0:18722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9dd9bb595500) 00010000:00010000:2.0:1789263845.756285:0:18722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789263845.756288:0:18722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bfa22a00, rc 0) 00000100:00100000:2.0:1789263845.756321:0:18722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+46:15716:x1876178888680960:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 156us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263845.756328:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 68 00000100:00100000:1.0:1789263845.757435:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263845.757484:0:18696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888681088 00000100:00100000:2.0:1789263845.757497:0:18696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888681088 00000100:00080000:1.0:1789263845.757548:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789263845.757553:0:18696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 22 00000100:00100000:2.0:1789263845.757565:0:18696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88431d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+5:2397:x1876178888681088:12345-192.168.203.20@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789263845.757747:0:18696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88431d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+6:2397:x1876178888681088:12345-192.168.203.20@tcp:2:lhsmtool_posix.0 Request processed in 186us (315us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1789263845.757762:0:18696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 22 00000100:00100000:1.0:1789263845.758618:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263845.758663:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888681344 00000100:00100000:0.0:1789263845.758667:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888681344 00000100:00100000:0.0:1789263845.758695:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 12 00000100:00100000:0.0:1789263845.758700:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88431ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+46:15716:x1876178888681344:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789263845.758825:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88431ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+47:15716:x1876178888681344:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 Request processed in 123us (209us total) trans 8589934624 rc 0/0 00000100:00100000:0.0:1789263845.758829:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 12 00000100:00100000:2.0:1789263845.759640:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263845.759749:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888681600 00000100:00100000:3.0:1789263845.759756:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888681600 00000100:00100000:3.0:1789263845.759798:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 69 00000100:00100000:3.0:1789263845.759809:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+47:15716:x1876178888681600:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789263845.759976:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+47:15716:x1876178888681600:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 Request processed in 168us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263845.759995:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 69 00000100:00100000:1.0:1789263845.761003:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263845.761032:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888681728 00000100:00100000:3.0:1789263845.761044:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888681728 00000100:00100000:3.0:1789263845.761104:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 70 00000100:00100000:3.0:1789263845.761115:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88431dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+47:15716:x1876178888681728:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789263845.761127:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263845.761143:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981682200/0xce1582440fb1f279 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d1223b expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.761209:0:17193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683a00/0xce1582440fb1f280 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.761223:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683a00/0xce1582440fb1f280 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.761234:0:17193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683a00/0xce1582440fb1f280 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789263845.761276:0:17193:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789263845.761293:0:17193:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683a00/0xce1582440fb1f280 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.761320:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981682200/0xce1582440fb1f279 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1223b expref: 49 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.761336:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683a00/0xce1582440fb1f280 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1223b expref: 48 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.761343:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9dd9bb595500) 00010000:00010000:3.0:1789263845.761345:0:17193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789263845.761347:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981683a00, rc 0) 00000100:00100000:3.0:1789263845.761386:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88431dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+48:15716:x1876178888681728:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 274us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263845.761399:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 70 00000100:00100000:2.0:1789263845.762502:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263845.762575:0:19981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888681856 00000100:00100000:1.0:1789263845.762581:0:19981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888681856 00000100:00100000:1.0:1789263845.762624:0:19981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 23 00000100:00100000:1.0:1789263845.762633:0:19981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+6:2398:x1876178888681856:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789263845.762644:0:19981:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263845.762658:0:19981:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8436489/0xce1582440fb1f287 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d12242 expref: -99 pid: 19981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789263845.762678:0:19981:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa5ffe6, blocks: 0x0 00010000:00010000:1.0:1789263845.762692:0:19981:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=288s v=(0 0) 00010000:00010000:1.0:1789263845.762697:0:19981:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789263845.762705:0:19981:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8436489/0xce1582440fb1f287 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12242 expref: 7 pid: 19981 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263845.762722:0:19981:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d8436489/0xce1582440fb1f287 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12242 expref: 7 pid: 19981 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263845.762734:0:19981:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd8841a2e00, rc 0) 00000100:00100000:1.0:1789263845.762804:0:19981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+7:2398:x1876178888681856:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 172us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263845.762818:0:19981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 23 00000100:00100000:2.0:1789263845.763908:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263845.763955:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888682112 00000100:00100000:0.0:1789263845.763962:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888682112 00000100:00100000:0.0:1789263845.764002:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 71 00000100:00100000:0.0:1789263845.764011:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+48:15716:x1876178888682112:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789263845.764099:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+48:15716:x1876178888682112:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 Request processed in 89us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263845.764107:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 71 00000100:00100000:2.0:1789263845.765195:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263845.765242:0:18698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888682240 00000100:00100000:3.0:1789263845.765247:0:18698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888682240 00000100:00100000:3.0:1789263845.765293:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 24 00000100:00100000:3.0:1789263845.765302:0:18698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd884acc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+7:15716:x1876178888682240:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789263845.765314:0:18698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263845.765335:0:18698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078915044/0xce1582440fb1f28e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d12249 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.765376:0:18698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d8436489/0xce1582440fb1f287 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12242 expref: 8 pid: 19981 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.765384:0:18698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789263845.765387:0:18698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789263845.765391:0:18698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078915044/0xce1582440fb1f28e lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12249 expref: 8 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.765416:0:18698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d8436489/0xce1582440fb1f287 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12242 expref: 8 pid: 19981 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.765437:0:18698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d8436489/0xce1582440fb1f287 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12242 expref: 8 pid: 19981 timeout: 388 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263845.765447:0:18698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989aeea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:18698:1876178898142336:192.168.203.20@tcp:104: 00000100:00100000:3.0:1789263845.765511:0:18698:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd8826163c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789263845.766430:0:18698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989aeea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:18698:1876178898142336:192.168.203.20@tcp:104: 00010000:00010000:3.0:1789263845.766463:0:18698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000078915044/0xce1582440fb1f28e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12249 expref: 8 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.766479:0:18698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981683e00, rc 0) 00000100:00100000:3.0:1789263845.766586:0:18698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd884acc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+8:15716:x1876178888682240:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 1284us (1393us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263845.766593:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 24 00000100:00100000:2.0:1789263845.766651:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263845.766739:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888682368 00000100:00100000:3.0:1789263845.766744:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888682368 00010000:00010000:3.0:1789263845.766768:0:17179:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d8436489/0xce1582440fb1f287 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12242 expref: 8 pid: 19981 timeout: 388 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263845.766799:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 22 00000100:00100000:3.0:1789263845.766809:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989afd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+8:2397:x1876178888682368:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789263845.766819:0:17179:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789263845.766837:0:17179:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d8436489/0xce1582440fb1f287 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12242 expref: 8 pid: 19981 timeout: 388 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.766854:0:17179:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d8436489/0xce1582440fb1f287 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12242 expref: 8 pid: 19981 timeout: 388 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.766874:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8436489/0xce1582440fb1f287 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12242 expref: 8 pid: 19981 timeout: 388 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.766885:0:17179:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789263845.766896:0:17179:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789263845.766903:0:17179:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000078915044/0xce1582440fb1f28e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12249 expref: 7 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.766912:0:17179:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078915044/0xce1582440fb1f28e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12249 expref: 7 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.766942:0:17179:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000078915044/0xce1582440fb1f28e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12249 expref: 7 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263845.766953:0:17179:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989aeea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:17179:1876178898142464:192.168.203.20@tcp:105: 00000100:00100000:3.0:1789263845.767000:0:17179:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd8826163c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789263845.768306:0:17179:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989aeea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:17179:1876178898142464:192.168.203.20@tcp:105: 00010000:00010000:3.0:1789263845.768318:0:17179:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789263845.768351:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989afd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+7:2397:x1876178888682368:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 1544us (1700us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263845.768359:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 22 00000100:00100000:2.0:1789263845.769070:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263845.769159:0:18702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888682496 00000100:00100000:0.0:1789263845.769191:0:18702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888682496 00002000:00100000:0.0:1789263845.769224:0:18702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x22:0x0] (0->8) req@ffff9dd989affb80 x1876178888682496/t0(0) o4->aea5b0bf-5091-4b59-8387-6d6e4df18cfc@192.168.203.20@tcp:681/0 lens 504/0 e 0 to 0 dl 1789263856 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1789263845.769231:0:18702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dd989affb80 with x1876178888682496 ext(0->8) 00002000:00010000:0.0:1789263845.769234:0:18702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9dd989affb80 00000100:00100000:0.0:1789263845.769255:0:18702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 0 00000100:00100000:0.0:1789263845.769261:0:18702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989affb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+7:2398:x1876178888682496:12345-192.168.203.20@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789263845.770510:0:18702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989affb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+9:2398:x1876178888682496:12345-192.168.203.20@tcp:4:lhsmtool_posix.0 Request processed in 1244us (1437us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1789263845.770522:0:18702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 0 00002000:00100000:0.0:1789263845.770531:0:18702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x22:0x0] (0->8) req@ffff9dd989affb80 x1876178888682496/t8589934596(0) o4->aea5b0bf-5091-4b59-8387-6d6e4df18cfc@192.168.203.20@tcp:681/0 lens 504/448 e 0 to 0 dl 1789263856 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1789263845.770540:0:18702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dd989affb80 with x1876178888682496 ext(0->8) 00002000:00010000:0.0:1789263845.770544:0:18702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9dd989affb80 00000100:00100000:1.0:1789263845.771743:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263845.771787:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888682624 00000100:00100000:2.0:1789263845.771794:0:18722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888682624 00000100:00100000:2.0:1789263845.771840:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 72 00000100:00100000:2.0:1789263845.771859:0:18722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88431e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+48:15716:x1876178888682624:12345-192.168.203.20@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789263845.773219:0:17172:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934624 is committed 00000004:00080000:0.0:1789263845.773230:0:17172:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:2.0:1789263845.773292:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1efa8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789263845.773301:0:17172:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:2.0:1789263845.773312:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1efa8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.773321:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1efa8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.773328:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981530c00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263845.773333:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1efa8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.773342:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1efa8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.773350:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51a00/0xce1582440fb1effc lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.773359:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9dd9bb595b00) 00010000:00010000:3.0:1789263845.773362:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51a00/0xce1582440fb1effc lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.773364:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789263845.773370:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1efa8 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.773372:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51a00/0xce1582440fb1effc lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.773382:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1efa8 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.773385:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd987f51a00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263845.773392:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51a00/0xce1582440fb1effc lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.773408:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1efaf lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.773415:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1efaf lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.773422:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1efaf lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.773426:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51a00/0xce1582440fb1effc lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.773428:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981530600 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263845.773450:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9dd9bb595c00) 00010000:00010000:2.0:1789263845.773450:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1efaf lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.773455:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1789263845.773461:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51a00/0xce1582440fb1effc lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.773464:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1efaf lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.773478:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51a00/0xce1582440fb1effc lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.773483:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9dd9bb595c00) 00010000:00010000:2.0:1789263845.773488:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789263845.773492:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1efaf lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.773500:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1efaf lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.773517:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531c00/0xce1582440fb1f057 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263845.773524:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88431f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876178898142592:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1789263845.773525:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531c00/0xce1582440fb1f057 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.773536:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531c00/0xce1582440fb1f057 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.773542:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981531c00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263845.773545:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531c00/0xce1582440fb1f057 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.773551:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531c00/0xce1582440fb1f057 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.773559:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9dd9bb595e00) 00010000:00010000:2.0:1789263845.773562:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789263845.773572:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531c00/0xce1582440fb1f057 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263845.773572:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789263845.773581:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531c00/0xce1582440fb1f057 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.773599:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683400/0xce1582440fb1f0c7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.773605:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683400/0xce1582440fb1f0c7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263845.773612:0:18696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898142592 00010000:00010000:2.0:1789263845.773613:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683400/0xce1582440fb1f0c7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263845.773620:0:18696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898142592 00010000:00010000:2.0:1789263845.773621:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981683400 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263845.773626:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683400/0xce1582440fb1f0c7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.773633:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683400/0xce1582440fb1f0c7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.773641:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dd9bb595100) 00010000:00010000:2.0:1789263845.773643:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789263845.773646:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683400/0xce1582440fb1f0c7 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263845.773654:0:18722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88431e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+19:15716:x1876178888682624:12345-192.168.203.20@tcp:44:lhsmtool_posix.0 Request processed in 1795us (1912us total) trans 0 rc 0/0 00010000:00010000:2.0:1789263845.773655:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683400/0xce1582440fb1f0c7 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263845.773672:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 72 00000100:00100000:3.0:1789263845.773676:0:18696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00010000:00010000:2.0:1789263845.773676:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f130 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263845.773690:0:18696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88431ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1876178898142592:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1789263845.773706:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f130 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.773713:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f130 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.773716:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd987f51600 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263845.773719:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f130 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.773723:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f130 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.773729:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dd9bb595100) 00010000:00010000:2.0:1789263845.773731:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789263845.773732:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f130 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.773736:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f130 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.773744:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51000/0xce1582440fb1f176 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.773748:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51000/0xce1582440fb1f176 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.773751:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51000/0xce1582440fb1f176 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.773755:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd987f51000 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263845.773761:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51000/0xce1582440fb1f176 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.773767:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51000/0xce1582440fb1f176 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.773778:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dd9bb595100) 00010000:00010000:2.0:1789263845.773781:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00002000:00010000:3.0:1789263845.773782:0:18696:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 9 00010000:00010000:2.0:1789263845.773784:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51000/0xce1582440fb1f176 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789263845.773785:0:18696:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1789263846 00002000:00010000:3.0:1789263845.773790:0:18696:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789263845.773795:0:18696:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1789263846 -> 1789263846 00002000:00010000:3.0:1789263845.773799:0:18696:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1789263845.773800:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51000/0xce1582440fb1f176 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.773819:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22e00/0xce1582440fb1f26b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.773825:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22e00/0xce1582440fb1f26b lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.773831:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22e00/0xce1582440fb1f26b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263845.773836:0:18696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88431ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3619:x1876178898142592:12345-0@lo:2:osp-syn-1-0.0 Request processed in 150us (266us total) trans 8589934597 rc 0/0 00000100:00080000:1.0:1789263845.773840:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789263845.773841:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bfa22e00 already unused, calling callback (ffffffffc18c14f0) 00000100:00100000:3.0:1789263845.773846:0:18696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:2.0:1789263845.773848:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22e00/0xce1582440fb1f26b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.773856:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22e00/0xce1582440fb1f26b lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.773864:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9dd9bb595500) 00010000:00010000:2.0:1789263845.773866:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789263845.773875:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22e00/0xce1582440fb1f26b lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.773880:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22e00/0xce1582440fb1f26b lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789263845.773902:0:3619:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9dd88431f100/2, rc 0, transno 8589934597 00000100:00100000:0.0:1789263845.773909:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88431f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876178898142592:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789263845.774816:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263845.774869:0:19981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888682752 00000100:00100000:1.0:1789263845.774875:0:19981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888682752 00000100:00100000:1.0:1789263845.774911:0:19981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 26 00000100:00100000:1.0:1789263845.774920:0:19981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989afe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+9:2398:x1876178888682752:12345-192.168.203.20@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1789263845.775762:0:19510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00000001:00080000:3.0:1789263845.775770:0:19510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934596 is committed 00000100:00100000:1.0:1789263845.775882:0:19981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989afe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+6:2398:x1876178888682752:12345-192.168.203.20@tcp:16:lhsmtool_posix.0 Request processed in 962us (1066us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263845.775890:0:19981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 26 00000100:00100000:0.0:1789263845.776981:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263845.777021:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888683008 00000100:00100000:3.0:1789263845.777027:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888683008 00000100:00100000:3.0:1789263845.777100:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 73 00000100:00100000:3.0:1789263845.777118:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88397c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+15:15716:x1876178888683008:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789263845.777164:0:17192:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789263845.777198:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683a00/0xce1582440fb1f280 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1223b expref: 15 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.777215:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9dd9bb595500) 00010000:00010000:3.0:1789263845.777219:0:17192:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789263845.777245:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981682200/0xce1582440fb1f295 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.777258:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981682200/0xce1582440fb1f295 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.777268:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981682200/0xce1582440fb1f295 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789263845.777369:0:17192:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000054fbc840 reply state 000000001672b2da transno 8589934625 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981682200/0xce1582440fb1f295 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.777381:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981682200/0xce1582440fb1f295 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.777387:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9dd9bb595500) 00010000:00010000:3.0:1789263845.777390:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789263845.777392:0:17192:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789263845.777474:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88397c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+16:15716:x1876178888683008:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 Request processed in 357us (494us total) trans 8589934625 rc 0/0 00000100:00100000:3.0:1789263845.777482:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 73 00000100:00100000:2.0:1789263845.778557:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263845.778632:0:18698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888683136 00000100:00100000:3.0:1789263845.778637:0:18698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888683136 00000100:00100000:3.0:1789263845.778682:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 27 00000100:00100000:3.0:1789263845.778692:0:18698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989afdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+6:2397:x1876178888683136:12345-192.168.203.20@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789263845.778798:0:18698:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1789263845.778801:0:18698:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 1789263846 -> 1789263845 00002000:00010000:3.0:1789263845.778803:0:18698:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 1789263844 00002000:00010000:3.0:1789263845.778804:0:18698:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1789263846 -> 1789263845 00002000:00010000:3.0:1789263845.778805:0:18698:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1789263845.778837:0:18698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989afdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+7:2397:x1876178888683136:12345-192.168.203.20@tcp:2:lhsmtool_posix.0 Request processed in 148us (282us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1789263845.778842:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 27 00000100:00100000:2.0:1789263845.780059:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263845.780140:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888683392 00000100:00100000:3.0:1789263845.780148:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888683392 00000100:00100000:3.0:1789263845.780205:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 74 00000100:00100000:3.0:1789263845.780214:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989aff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+16:15716:x1876178888683392:12345-192.168.203.20@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789263845.780268:0:17193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1f29c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.780284:0:17193:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683000/0xce1582440fb1f264 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1222d expref: 16 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.780304:0:17193:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1f29c lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.780337:0:17193:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683000/0xce1582440fb1f264 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1222d expref: 16 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.780361:0:17193:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683000/0xce1582440fb1f264 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1222d expref: 16 pid: 17193 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263845.780380:0:17193:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989aeea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17193:1876178898142720:192.168.203.20@tcp:104: 00000100:00100000:3.0:1789263845.780447:0:17193:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd882616000 going to sleep for 11 seconds 00000100:00100000:3.0:1789263845.781718:0:17193:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989aeea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17193:1876178898142720:192.168.203.20@tcp:104: 00010000:00010000:3.0:1789263845.781757:0:17193:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1f29c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263845.781789:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263845.781913:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888683520 00000100:00100000:3.0:1789263845.781922:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888683520 00010000:00010000:3.0:1789263845.781961:0:17178:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683000/0xce1582440fb1f264 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1222d expref: 17 pid: 17193 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263845.782005:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 23 00000100:00100000:3.0:1789263845.782016:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989afca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+17:2397:x1876178888683520:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789263845.782035:0:17178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789263845.782042:0:17178:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683000/0xce1582440fb1f264 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1222d expref: 17 pid: 17193 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.782072:0:17178:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683000/0xce1582440fb1f264 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1222d expref: 17 pid: 17193 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.782139:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683000/0xce1582440fb1f264 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1222d expref: 17 pid: 17193 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.782159:0:17178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9dd9bb595500) 00010000:00010000:3.0:1789263845.782183:0:17178:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1f29c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.782211:0:17178:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1f29c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.782221:0:17178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1f29c lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.782259:0:17178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789263845.782292:0:17193:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1f29c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.782307:0:17193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1f29c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263845.782333:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989afca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+16:2397:x1876178888683520:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 317us (547us total) trans 0 rc 0/0 00010000:00010000:2.0:1789263845.782343:0:17193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1f29c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263845.782344:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 23 00010000:00010000:2.0:1789263845.782359:0:17193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1f29c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.782368:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1f29c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.782374:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981530a00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263845.782380:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1f29c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.782388:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1f29c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.782404:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9dd9bb595500) 00010000:00010000:2.0:1789263845.782419:0:17193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789263845.782424:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1f29c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.782431:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1f29c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263845.782496:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989aff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+15:15716:x1876178888683392:12345-192.168.203.20@tcp:55:lhsmtool_posix.0 Request processed in 2281us (2438us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789263845.782505:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 74 00000100:00100000:0.0:1789263845.783503:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263845.783558:0:18696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888683648 00000100:00100000:3.0:1789263845.783568:0:18696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888683648 00000100:00100000:3.0:1789263845.783622:0:18696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 28 00000100:00100000:3.0:1789263845.783631:0:18696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88397f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+7:2398:x1876178888683648:12345-192.168.203.20@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789263845.783678:0:18696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000005d51fd86/0xce1582440fb1f2a3 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.783701:0:18696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000078915044/0xce1582440fb1f28e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12249 expref: 7 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.783711:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789263845.783717:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789263845.783722:0:18696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d51fd86/0xce1582440fb1f2a3 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.783771:0:18696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000078915044/0xce1582440fb1f28e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12249 expref: 7 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.783814:0:18696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000078915044/0xce1582440fb1f28e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12249 expref: 7 pid: 18698 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263845.783832:0:18696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989aeea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:18696:1876178898142848:192.168.203.20@tcp:104: 00000100:00100000:3.0:1789263845.783937:0:18696:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd882616000 going to sleep for 11 seconds 00000100:00100000:3.0:1789263845.785328:0:18696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989aeea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:18696:1876178898142848:192.168.203.20@tcp:104: 00010000:00010000:3.0:1789263845.785354:0:18696:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005d51fd86/0xce1582440fb1f2a3 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263845.785400:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263845.785496:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888683776 00000100:00100000:2.0:1789263845.785502:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888683776 00010000:00010000:2.0:1789263845.785536:0:17177:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000078915044/0xce1582440fb1f28e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12249 expref: 8 pid: 18698 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263845.785569:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 24 00000100:00100000:2.0:1789263845.785577:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88397d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+8:2398:x1876178888683776:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789263845.785594:0:17177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789263845.785618:0:17177:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000078915044/0xce1582440fb1f28e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12249 expref: 8 pid: 18698 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.785644:0:17177:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000078915044/0xce1582440fb1f28e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12249 expref: 8 pid: 18698 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.785674:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078915044/0xce1582440fb1f28e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12249 expref: 8 pid: 18698 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.785693:0:17177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789263845.785703:0:17177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789263845.785710:0:17177:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005d51fd86/0xce1582440fb1f2a3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.785720:0:17177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d51fd86/0xce1582440fb1f2a3 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.785742:0:17177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789263845.785764:0:18696:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005d51fd86/0xce1582440fb1f2a3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.785776:0:18696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d51fd86/0xce1582440fb1f2a3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263845.785800:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88397d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+7:2398:x1876178888683776:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 220us (397us total) trans 0 rc 0/0 00010000:00010000:3.0:1789263845.785807:0:18696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000005d51fd86/0xce1582440fb1f2a3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263845.785812:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 24 00010000:00010000:3.0:1789263845.785824:0:18696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d51fd86/0xce1582440fb1f2a3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.785834:0:18696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d51fd86/0xce1582440fb1f2a3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.785856:0:18696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981531600 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:3.0:1789263845.785862:0:18696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d51fd86/0xce1582440fb1f2a3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.785872:0:18696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d51fd86/0xce1582440fb1f2a3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.785889:0:18696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d51fd86/0xce1582440fb1f2a3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.785899:0:18696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d51fd86/0xce1582440fb1f2a3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263845.785999:0:18696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88397f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+6:2398:x1876178888683648:12345-192.168.203.20@tcp:1:lhsmtool_posix.0 Request processed in 2368us (2497us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263845.786010:0:18696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 28 00000100:00100000:0.0:1789263845.787247:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263845.787317:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888684032 00000100:00100000:2.0:1789263845.787326:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888684032 00000100:00100000:2.0:1789263845.787378:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 75 00000100:00100000:2.0:1789263845.787388:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88397c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+15:15716:x1876178888684032:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789263845.787470:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22e00/0xce1582440fb1f2aa lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.787487:0:17191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683600/0xce1582440fb1f0c0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d121cb expref: 15 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.787496:0:17191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22e00/0xce1582440fb1f2aa lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.787531:0:17191:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683600/0xce1582440fb1f0c0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d121cb expref: 15 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.787555:0:17191:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683600/0xce1582440fb1f0c0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d121cb expref: 15 pid: 17193 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263845.787577:0:17191:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989afea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17191:1876178898142976:192.168.203.20@tcp:104: 00000100:00100000:2.0:1789263845.787651:0:17191:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd8838ea9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789263845.788768:0:17191:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989afea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17191:1876178898142976:192.168.203.20@tcp:104: 00010000:00010000:2.0:1789263845.788791:0:17191:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22e00/0xce1582440fb1f2aa lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263845.788981:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263845.789036:0:18344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888684160 00000100:00100000:1.0:1789263845.789046:0:18344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888684160 00010000:00010000:1.0:1789263845.789113:0:18344:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683600/0xce1582440fb1f0c0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d121cb expref: 16 pid: 17193 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263845.789154:0:18344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 25 00000100:00100000:1.0:1789263845.789162:0:18344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa61850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+16:2397:x1876178888684160:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789263845.789184:0:18344:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789263845.789190:0:18344:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683600/0xce1582440fb1f0c0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d121cb expref: 16 pid: 17193 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263845.789211:0:18344:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683600/0xce1582440fb1f0c0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d121cb expref: 16 pid: 17193 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263845.789243:0:18344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683600/0xce1582440fb1f0c0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d121cb expref: 16 pid: 17193 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263845.789255:0:18344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dd9bb595100) 00010000:00010000:1.0:1789263845.789259:0:18344:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22e00/0xce1582440fb1f2aa lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263845.789266:0:18344:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22e00/0xce1582440fb1f2aa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263845.789271:0:18344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22e00/0xce1582440fb1f2aa lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263845.789291:0:18344:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789263845.789342:0:18344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa61850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+15:2397:x1876178888684160:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 180us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263845.789350:0:18344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 25 00010000:00010000:2.0:1789263845.789353:0:17191:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22e00/0xce1582440fb1f2aa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.789361:0:17191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22e00/0xce1582440fb1f2aa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.789545:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22800/0xce1582440fb1f2b1 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.789558:0:17191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22a00/0xce1582440fb1f272 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12234 expref: 15 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.789565:0:17191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22800/0xce1582440fb1f2b1 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.789587:0:17191:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22a00/0xce1582440fb1f272 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12234 expref: 15 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.789598:0:17191:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22a00/0xce1582440fb1f272 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12234 expref: 15 pid: 18722 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263845.789608:0:17191:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989afea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17191:1876178898143104:192.168.203.20@tcp:104: 00000100:00100000:2.0:1789263845.789669:0:17191:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9b7a9ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1789263845.790837:0:17191:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989afea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17191:1876178898143104:192.168.203.20@tcp:104: 00010000:00010000:2.0:1789263845.790857:0:17191:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22800/0xce1582440fb1f2b1 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263845.791056:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263845.791180:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888684288 00000100:00100000:2.0:1789263845.791186:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888684288 00010000:00010000:2.0:1789263845.791211:0:17179:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22a00/0xce1582440fb1f272 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12234 expref: 16 pid: 18722 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263845.791251:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 26 00000100:00100000:2.0:1789263845.791260:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989aeea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+16:2397:x1876178888684288:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789263845.791270:0:17179:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789263845.791275:0:17179:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22a00/0xce1582440fb1f272 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12234 expref: 16 pid: 18722 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.791289:0:17179:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22a00/0xce1582440fb1f272 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12234 expref: 16 pid: 18722 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.791305:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22a00/0xce1582440fb1f272 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12234 expref: 16 pid: 18722 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.791316:0:17179:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9dd9bb595500) 00010000:00010000:2.0:1789263845.791320:0:17179:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22800/0xce1582440fb1f2b1 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.791328:0:17179:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22800/0xce1582440fb1f2b1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.791348:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22800/0xce1582440fb1f2b1 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.791426:0:17179:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789263845.791463:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989aeea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+15:2397:x1876178888684288:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 203us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263845.791471:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 26 00010000:00010000:3.0:1789263845.791488:0:17191:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22800/0xce1582440fb1f2b1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.791495:0:17191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22800/0xce1582440fb1f2b1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789263845.791725:0:17191:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000001:00080000:3.0:1789263845.791893:0:17191:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000001:00080000:3.0:1789263845.791974:0:17191:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934628 00000100:00100000:3.0:1789263845.792218:0:17191:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989aedc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17191:1876178898143232:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789263845.792320:0:17191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263845.792365:0:17191:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd882616480 going to sleep for 11 seconds 00000100:00100000:0.0:1789263845.792370:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898143232 00000100:00100000:0.0:1789263845.792376:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898143232 00000100:00100000:0.0:1789263845.792405:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789263845.792410:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989aee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:17191:x1876178898143232:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789263845.792476:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989aee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:17191:x1876178898143232:12345-0@lo:1000:mdt00_000.0 Request processed in 65us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263845.792484:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789263845.792524:0:17191:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:3.0:1789263845.792529:0:17191:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9dd88431f100, transno 8589934597 00000100:00100000:3.0:1789263845.792556:0:17191:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989aedc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17191:1876178898143232:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1789263845.792704:0:17191:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00000100:00100000:3.0:1789263845.792743:0:17191:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989aedc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17191:1876178898143360:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789263845.792769:0:17191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263845.792787:0:17191:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd882616f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789263845.792806:0:18524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898143360 00000100:00100000:2.0:1789263845.792812:0:18524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898143360 00000100:00100000:2.0:1789263845.792841:0:18524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789263845.792855:0:18524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:17191:x1876178898143360:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789263845.792958:0:18524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17191:x1876178898143360:12345-0@lo:1000:mdt00_000.0 Request processed in 104us (186us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1789263845.792965:0:18524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789263845.792993:0:17191:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989aedc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17191:1876178898143360:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1789263845.793021:0:17191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22800/0xce1582440fb1f2b1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.793029:0:17191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22800/0xce1582440fb1f2b1 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.793036:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22800/0xce1582440fb1f2b1 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.793046:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bfa22800 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263845.793050:0:17191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22800/0xce1582440fb1f2b1 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.793059:0:17191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22800/0xce1582440fb1f2b1 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.793071:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9dd9bb595500) 00010000:00010000:3.0:1789263845.793110:0:17191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789263845.793124:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22800/0xce1582440fb1f2b1 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.793131:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22800/0xce1582440fb1f2b1 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.793180:0:17191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683800/0xce1582440fb1f1ed lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.793188:0:17191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683800/0xce1582440fb1f1ed lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.793193:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683800/0xce1582440fb1f1ed lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.793199:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981683800 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263845.793202:0:17191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683800/0xce1582440fb1f1ed lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.793208:0:17191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683800/0xce1582440fb1f1ed lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.793217:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dd9bb595100) 00010000:00010000:3.0:1789263845.793219:0:17191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789263845.793222:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683800/0xce1582440fb1f1ed lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.793228:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683800/0xce1582440fb1f1ed lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.793249:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531200/0xce1582440fb1f2b8 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.793261:0:17191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50800/0xce1582440fb1f209 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12218 expref: 18 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.793275:0:17191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531200/0xce1582440fb1f2b8 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.793295:0:17191:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50800/0xce1582440fb1f209 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12218 expref: 18 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.793314:0:17191:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50800/0xce1582440fb1f209 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12218 expref: 18 pid: 17191 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263845.793325:0:17191:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaaf100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17191:1876178898143488:192.168.203.20@tcp:104: 00000100:00100000:3.0:1789263845.793378:0:17191:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd8838ea9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789263845.794556:0:17191:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaaf100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17191:1876178898143488:192.168.203.20@tcp:104: 00010000:00010000:2.0:1789263845.794569:0:17191:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531200/0xce1582440fb1f2b8 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263845.794819:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263845.794895:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888684416 00000100:00100000:3.0:1789263845.794901:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888684416 00010000:00010000:3.0:1789263845.794925:0:17178:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50800/0xce1582440fb1f209 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12218 expref: 19 pid: 17191 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263845.794961:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 27 00000100:00100000:3.0:1789263845.794969:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88431f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+19:2397:x1876178888684416:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789263845.794980:0:17178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789263845.794986:0:17178:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50800/0xce1582440fb1f209 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12218 expref: 19 pid: 17191 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.795004:0:17178:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50800/0xce1582440fb1f209 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12218 expref: 19 pid: 17191 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.795022:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50800/0xce1582440fb1f209 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12218 expref: 19 pid: 17191 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.795042:0:17178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dd9bb595100) 00010000:00010000:3.0:1789263845.795047:0:17178:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531200/0xce1582440fb1f2b8 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.795054:0:17178:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531200/0xce1582440fb1f2b8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.795061:0:17178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531200/0xce1582440fb1f2b8 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.795125:0:17178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789263845.795129:0:17191:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531200/0xce1582440fb1f2b8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.795139:0:17191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531200/0xce1582440fb1f2b8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.795154:0:17191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531200/0xce1582440fb1f2b8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.795161:0:17191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531200/0xce1582440fb1f2b8 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263845.795181:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88431f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+18:2397:x1876178888684416:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 201us (351us total) trans 0 rc 0/0 00010000:00010000:2.0:1789263845.795189:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531200/0xce1582440fb1f2b8 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263845.795193:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 27 00010000:00010000:2.0:1789263845.795201:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981531200 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263845.795206:0:17191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531200/0xce1582440fb1f2b8 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.795212:0:17191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531200/0xce1582440fb1f2b8 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.795223:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dd9bb595100) 00010000:00010000:2.0:1789263845.795226:0:17191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789263845.795229:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531200/0xce1582440fb1f2b8 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.795235:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531200/0xce1582440fb1f2b8 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.795245:0:17191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22e00/0xce1582440fb1f2aa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.795252:0:17191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22e00/0xce1582440fb1f2aa lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.795258:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22e00/0xce1582440fb1f2aa lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.795263:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bfa22e00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263845.795266:0:17191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22e00/0xce1582440fb1f2aa lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.795282:0:17191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22e00/0xce1582440fb1f2aa lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.795291:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dd9bb595100) 00010000:00010000:2.0:1789263845.795294:0:17191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789263845.795297:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22e00/0xce1582440fb1f2aa lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263845.795303:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22e00/0xce1582440fb1f2aa lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263845.795436:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88397c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+17:15716:x1876178888684032:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 Request processed in 8049us (8192us total) trans 8589934630 rc 0/0 00000100:00100000:2.0:1789263845.795444:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 75 00000020:00080000:2.0:1789263845.795448:0:17191:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789263845.795487:0:17227:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789263845.795492:0:17227:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789263845.795519:0:17227:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1789263845.795526:0:17227:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1789263845.796507:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263845.796544:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888684672 00000100:00100000:3.0:1789263845.796552:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888684672 00000100:00100000:3.0:1789263845.796591:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 13 00000100:00100000:3.0:1789263845.796600:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88431d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+17:15716:x1876178888684672:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789263845.796803:0:17195:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789263845.796828:0:17195:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00010000:00010000:3.0:1789263845.796851:0:17195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1f2bf lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.796865:0:17195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1f2bf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.796875:0:17195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1f2bf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.796895:0:17195:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1f2bf lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.796902:0:17195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1f2bf lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.796908:0:17195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1f2bf lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263845.796932:0:17195:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789263845.796997:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88431d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+19:15716:x1876178888684672:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 Request processed in 398us (490us total) trans 8589934632 rc 0/0 00000100:00100000:3.0:1789263845.797017:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 13 00000020:00080000:3.0:1789263845.797021:0:17195:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789263845.797100:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263845.797107:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1f2bf lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263845.797115:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981531600 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263845.797119:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1f2bf lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263845.797127:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1f2bf lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263845.797152:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9dd9bb595500) 00010000:00010000:1.0:1789263845.797157:0:17181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789263845.797165:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1f2bf lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263845.797181:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1f2bf lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263845.797192:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263845.797194:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263845.797196:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789263845.819871:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263845.819938:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263845.820018:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263845.820038:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263845.820057:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263845.820101:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888684800 00000100:00100000:3.0:1789263845.820111:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263845.820113:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888684800 00000100:00100000:1.0:1789263845.820168:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 157 00000100:00100000:1.0:1789263845.820189:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd990734850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9c31cd1-b03c-4865-98dc-92dea6862336+13:2398:x1876178888684800:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789263845.820196:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888684928 00000100:00100000:0.0:1789263845.820202:0:18722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888684928 00000100:00100000:2.0:1789263845.820203:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888685184 00000100:00100000:2.0:1789263845.820210:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888685184 00000100:00100000:3.0:1789263845.820227:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263845.820236:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888685312 00000100:00100000:0.0:1789263845.820240:0:18722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888685312 00000100:00100000:2.0:1789263845.820247:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 31 00000100:00100000:2.0:1789263845.820259:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+5:2398:x1876178888684928:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1789263845.820266:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd990734850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9c31cd1-b03c-4865-98dc-92dea6862336+13:2398:x1876178888684800:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 75us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263845.820267:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 32 00000100:00100000:1.0:1789263845.820280:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 157 00000100:00100000:0.0:1789263845.820281:0:18722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c09f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a1530e0-880b-4d94-ada1-a3a40d18af45+6:2398:x1876178888685184:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789263845.820303:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+5:2398:x1876178888684928:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 47us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263845.820312:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 31 00000100:00100000:1.0:1789263845.820322:0:19981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888685440 00000100:00100000:0.0:1789263845.820325:0:18722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c09f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a1530e0-880b-4d94-ada1-a3a40d18af45+6:2398:x1876178888685184:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 46us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263845.820327:0:19981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888685440 00000100:00100000:2.0:1789263845.820336:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 33 00000100:00100000:0.0:1789263845.820344:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 32 00000100:00100000:2.0:1789263845.820350:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c09f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a1530e0-880b-4d94-ada1-a3a40d18af45+5:2398:x1876178888685312:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1789263845.820369:0:19981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888685056 00000100:00100000:1.0:1789263845.820374:0:19981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888685056 00000100:00080000:0.0:1789263845.820386:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789263845.820387:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c09f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a1530e0-880b-4d94-ada1-a3a40d18af45+5:2398:x1876178888685312:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 40us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263845.820402:0:19981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888685568 00000100:00100000:1.0:1789263845.820406:0:19981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888685568 00000100:00100000:0.0:1789263845.820416:0:19302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 6 00000100:00100000:2.0:1789263845.820421:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 33 00000100:00100000:0.0:1789263845.820432:0:19302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c09f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9a1530e0-880b-4d94-ada1-a3a40d18af45+5:2398:x1876178888685440:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1789263845.820439:0:19981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 7 00000100:00100000:1.0:1789263845.820450:0:19981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c09f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+5:2398:x1876178888685056:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789263845.820466:0:19302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c09f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9a1530e0-880b-4d94-ada1-a3a40d18af45+5:2398:x1876178888685440:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 37us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263845.820472:0:18699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 8 00000100:00100000:1.0:1789263845.820484:0:19981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c09f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+5:2398:x1876178888685056:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 34us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263845.820486:0:18699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c09f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9a1530e0-880b-4d94-ada1-a3a40d18af45+5:2398:x1876178888685568:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789263845.820496:0:19302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 6 00000100:00100000:1.0:1789263845.820510:0:19981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 7 00000100:00100000:2.0:1789263845.820528:0:18699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c09f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9a1530e0-880b-4d94-ada1-a3a40d18af45+5:2398:x1876178888685568:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 45us (299us total) trans 0 rc 0/0 00000100:00080000:1.0:1789263845.820532:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789263845.820537:0:18699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 8 00010000:00010000:2.0:1789263846.701326:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789263846.767583:0:20419:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789263846.767590:0:20419:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789263846.767615:0:20419:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1789263846.767623:0:20419:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1789263846.812863:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263846.812915:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888685696 00000100:00100000:0.0:1789263846.812923:0:18722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888685696 00000100:00100000:0.0:1789263846.812984:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 76 00000100:00100000:0.0:1789263846.812995:0:18722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c09f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+19:15734:x1876178888685696:12345-192.168.203.20@tcp:34:lfs.0 00010000:00010000:0.0:1789263846.813062:0:18722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50e00/0xce1582440fb1f2c6 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.813097:0:18722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50e00/0xce1582440fb1f2c6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.813112:0:18722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50e00/0xce1582440fb1f2c6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.813127:0:18722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50600/0xce1582440fb1f2cd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.813135:0:18722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50600/0xce1582440fb1f2cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.813143:0:18722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50600/0xce1582440fb1f2cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.813228:0:18722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f2d4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.813237:0:18722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f2d4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.813245:0:18722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f2d4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789263846.813297:0:18722:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f2d4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.813310:0:18722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50e00/0xce1582440fb1f2c6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.813317:0:18722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50e00/0xce1582440fb1f2c6 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.813325:0:18722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50e00/0xce1582440fb1f2c6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.813331:0:18722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd987f50e00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:0.0:1789263846.813335:0:18722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50e00/0xce1582440fb1f2c6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.813342:0:18722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50e00/0xce1582440fb1f2c6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.813355:0:18722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9dd9bb595c00) 00010000:00010000:0.0:1789263846.813358:0:18722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789263846.813363:0:18722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50e00/0xce1582440fb1f2c6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.813369:0:18722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50e00/0xce1582440fb1f2c6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.813382:0:18722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50600/0xce1582440fb1f2cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.813388:0:18722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50600/0xce1582440fb1f2cd lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789263846.813392:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789263846.813404:0:18722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50600/0xce1582440fb1f2cd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.813410:0:18722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd987f50600 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:0.0:1789263846.813413:0:18722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50600/0xce1582440fb1f2cd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.813420:0:18722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50600/0xce1582440fb1f2cd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.813429:0:18722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9dd9bb585e00) 00010000:00010000:0.0:1789263846.813432:0:18722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789263846.813435:0:18722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50600/0xce1582440fb1f2cd lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.813441:0:18722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50600/0xce1582440fb1f2cd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.813455:0:18722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f2d4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.813462:0:18722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f2d4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.813468:0:18722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f2d4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.813473:0:18722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd987f50000 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:0.0:1789263846.813477:0:18722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f2d4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.813493:0:18722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f2d4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.813502:0:18722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dd9bb585800) 00010000:00010000:0.0:1789263846.813504:0:18722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789263846.813508:0:18722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f2d4 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.813513:0:18722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f2d4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263846.813594:0:18722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c09f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+19:15734:x1876178888685696:12345-192.168.203.20@tcp:34:lfs.0 Request processed in 601us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263846.813604:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 76 00000040:00080000:1.0:1789263846.829725:0:17227:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789263846.829731:0:17227:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789263846.829751:0:17227:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1789263846.829761:0:17227:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1789263846.836441:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263846.836496:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888685952 00000100:00100000:2.0:1789263846.836507:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888685952 00000100:00100000:2.0:1789263846.836566:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 77 00000100:00100000:2.0:1789263846.836577:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c09f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+19:15737:x1876178888685952:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:2.0:1789263846.836597:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263846.836623:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23c00/0xce1582440fb1f2db lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d12250 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263846.836696:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22000/0xce1582440fb1f2e2 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263846.836711:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22000/0xce1582440fb1f2e2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263846.836722:0:17191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22000/0xce1582440fb1f2e2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263846.836735:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23000/0xce1582440fb1f2e9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263846.836743:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23000/0xce1582440fb1f2e9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263846.836759:0:17191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23000/0xce1582440fb1f2e9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263846.836862:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23200/0xce1582440fb1f2f0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263846.836870:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23200/0xce1582440fb1f2f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263846.836878:0:17191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23200/0xce1582440fb1f2f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789263846.836888:0:17191:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 9 00010000:00010000:2.0:1789263846.836951:0:17191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22000/0xce1582440fb1f2e2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263846.836959:0:17191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22000/0xce1582440fb1f2e2 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263846.836965:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22000/0xce1582440fb1f2e2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263846.836972:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bfa22000 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263846.836976:0:17191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22000/0xce1582440fb1f2e2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263846.836983:0:17191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22000/0xce1582440fb1f2e2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263846.836995:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9dd9bb595c00) 00010000:00010000:2.0:1789263846.836999:0:17191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789263846.837011:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22000/0xce1582440fb1f2e2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263846.837018:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22000/0xce1582440fb1f2e2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263846.837028:0:17191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23000/0xce1582440fb1f2e9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263846.837032:0:17191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23000/0xce1582440fb1f2e9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263846.837036:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23000/0xce1582440fb1f2e9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263846.837039:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bfa23000 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263846.837041:0:17191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23000/0xce1582440fb1f2e9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263846.837045:0:17191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23000/0xce1582440fb1f2e9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263846.837053:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9dd882850000) 00010000:00010000:2.0:1789263846.837055:0:17191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789263846.837058:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23000/0xce1582440fb1f2e9 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263846.837063:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23000/0xce1582440fb1f2e9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263846.837129:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23c00/0xce1582440fb1f2db lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12250 expref: 22 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263846.837148:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23200/0xce1582440fb1f2f0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12250 expref: 21 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263846.837155:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dd882850d00) 00010000:00010000:2.0:1789263846.837157:0:17191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789263846.837160:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bfa23200, rc 0) 00000100:00100000:2.0:1789263846.837224:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c09f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+21:15737:x1876178888685952:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 649us (791us total) trans 8589934633 rc 0/0 00000100:00100000:2.0:1789263846.837232:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 77 00000100:00100000:1.0:1789263846.838915:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263846.838966:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888686080 00000100:00100000:3.0:1789263846.838973:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888686080 00000100:00100000:3.0:1789263846.839032:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 78 00000100:00100000:3.0:1789263846.839042:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88431c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+21:15737:x1876178888686080:12345-192.168.203.20@tcp:54:lfs.0 00010000:00010000:3.0:1789263846.839119:0:17193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1f2fe lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.839135:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1f2fe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.839142:0:17193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1f2fe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.839182:0:17193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1f2fe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.839189:0:17193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1f2fe lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.839197:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1f2fe lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.839203:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981531600 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263846.839207:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1f2fe lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.839214:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1f2fe lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.839224:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dd882850d00) 00010000:00010000:3.0:1789263846.839226:0:17193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789263846.839229:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1f2fe lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.839234:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1f2fe lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263846.839285:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88431c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+21:15737:x1876178888686080:12345-192.168.203.20@tcp:54:lfs.0 Request processed in 244us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263846.839298:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 78 00000100:00100000:2.0:1789263846.841442:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263846.841603:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888686336 00000100:00100000:1.0:1789263846.841612:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888686336 00000100:00100000:1.0:1789263846.841672:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 14 00000100:00100000:1.0:1789263846.841685:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989afea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+21:15737:x1876178888686336:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:1.0:1789263846.841900:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989afea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+22:15737:x1876178888686336:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 218us (465us total) trans 8589934634 rc 0/0 00000100:00100000:1.0:1789263846.841911:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 14 00000100:00100000:1.0:1789263846.864810:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263846.864858:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888686592 00000100:00100000:3.0:1789263846.864866:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888686592 00000100:00100000:3.0:1789263846.864920:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 79 00000100:00100000:3.0:1789263846.864930:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88431f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+22:12957:x1876178888686592:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:3.0:1789263846.864954:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263846.864973:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1f305 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d12257 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.865068:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531200/0xce1582440fb1f30c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.865111:0:17192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23200/0xce1582440fb1f2f0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12250 expref: 23 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.865121:0:17192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531200/0xce1582440fb1f30c lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.865154:0:17192:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23200/0xce1582440fb1f2f0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12250 expref: 23 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.865188:0:17192:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23200/0xce1582440fb1f2f0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12250 expref: 23 pid: 17191 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263846.865201:0:17192:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9c09f5180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17192:1876178898143616:192.168.203.20@tcp:104: 00000100:00100000:3.0:1789263846.865270:0:17192:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd883e68d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789263846.866638:0:17192:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9c09f5180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17192:1876178898143616:192.168.203.20@tcp:104: 00000100:00100000:2.0:1789263846.866646:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00010000:00010000:3.0:1789263846.866674:0:17192:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531200/0xce1582440fb1f30c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263846.866692:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888686720 00000100:00100000:0.0:1789263846.866699:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888686720 00010000:00010000:0.0:1789263846.866729:0:17179:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23200/0xce1582440fb1f2f0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12250 expref: 24 pid: 17191 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263846.866764:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 28 00000100:00100000:0.0:1789263846.866772:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989afe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+24:2398:x1876178888686720:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789263846.866784:0:17179:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789263846.866789:0:17179:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23200/0xce1582440fb1f2f0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12250 expref: 24 pid: 17191 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.866807:0:17179:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23200/0xce1582440fb1f2f0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12250 expref: 24 pid: 17191 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.866837:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23200/0xce1582440fb1f2f0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12250 expref: 24 pid: 17191 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.866850:0:17179:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dd882850d00) 00010000:00010000:0.0:1789263846.866855:0:17179:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531200/0xce1582440fb1f30c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.866862:0:17179:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531200/0xce1582440fb1f30c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.866868:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531200/0xce1582440fb1f30c lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.866887:0:17179:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789263846.866919:0:17192:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531200/0xce1582440fb1f30c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.866928:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531200/0xce1582440fb1f30c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263846.866932:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989afe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+23:2398:x1876178888686720:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 159us (287us total) trans 0 rc 0/0 00000004:00200000:3.0:1789263846.866948:0:17192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 9 00000100:00100000:0.0:1789263846.866951:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 28 00010000:00010000:3.0:1789263846.867060:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1f305 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12257 expref: 24 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.867141:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531200/0xce1582440fb1f30c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12257 expref: 23 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.867151:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dd882850d00) 00010000:00010000:3.0:1789263846.867153:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789263846.867156:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981531200, rc 0) 00000100:00100000:3.0:1789263846.867199:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88431f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+23:12957:x1876178888686592:12345-192.168.203.20@tcp:101:bash.0 Request processed in 2271us (2395us total) trans 8589934635 rc 0/0 00000100:00100000:3.0:1789263846.867206:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 79 00000100:00100000:2.0:1789263846.868985:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263846.869038:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888686848 00000100:00100000:0.0:1789263846.869045:0:18722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888686848 00000100:00100000:0.0:1789263846.869109:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 80 00000100:00100000:0.0:1789263846.869118:0:18722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989afdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+23:12957:x1876178888686848:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:0.0:1789263846.869136:0:18722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263846.869151:0:18722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50600/0xce1582440fb1f31a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d1225e expref: -99 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.869193:0:18722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50e00/0xce1582440fb1f321 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.869217:0:18722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50e00/0xce1582440fb1f321 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.869228:0:18722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50e00/0xce1582440fb1f321 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.869328:0:18722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50600/0xce1582440fb1f31a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1225e expref: 25 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.869342:0:18722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50e00/0xce1582440fb1f321 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1225e expref: 24 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.869348:0:18722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dd882850d00) 00010000:00010000:0.0:1789263846.869350:0:18722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789263846.869359:0:18722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd987f50e00, rc 0) 00000100:00100000:0.0:1789263846.869414:0:18722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989afdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+24:12957:x1876178888686848:12345-192.168.203.20@tcp:101:bash.0 Request processed in 297us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263846.869421:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 80 00000100:00100000:2.0:1789263846.870819:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263846.870897:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888687104 00000100:00100000:0.0:1789263846.870905:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888687104 00000100:00100000:0.0:1789263846.870949:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 81 00000100:00100000:0.0:1789263846.870958:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989afd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+24:12957:x1876178888687104:12345-192.168.203.20@tcp:36:bash.0 00010000:00010000:0.0:1789263846.871158:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51400/0xce1582440fb1f328 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.871183:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51400/0xce1582440fb1f328 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.871207:0:17191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51400/0xce1582440fb1f328 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789263846.871254:0:17191:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934636 00000004:00010000:0.0:1789263846.871276:0:17191:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000edf19d2d reply state 00000000b97cc53e transno 8589934637 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51400/0xce1582440fb1f328 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.871288:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51400/0xce1582440fb1f328 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.871295:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dd882850d00) 00010000:00010000:0.0:1789263846.871297:0:17191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789263846.871300:0:17191:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1789263846.871330:0:17191:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934637 00000100:00100000:0.0:1789263846.871411:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989afd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+28:12957:x1876178888687104:12345-192.168.203.20@tcp:36:bash.0 Request processed in 454us (595us total) trans 8589934638 rc 0/0 00000100:00100000:0.0:1789263846.871416:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 81 00000020:00080000:0.0:1789263846.871420:0:17191:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1789263846.872372:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263846.872408:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888687232 00000100:00100000:3.0:1789263846.872414:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888687232 00000100:00100000:3.0:1789263846.872444:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 82 00000100:00100000:3.0:1789263846.872450:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88431fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+28:12957:x1876178888687232:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:3.0:1789263846.872462:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263846.872471:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1f32f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d12265 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.872515:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1f32f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12265 expref: 29 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.872528:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1f32f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12265 expref: 29 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.872545:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dd882850d00) 00010000:00010000:3.0:1789263846.872548:0:17193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789263846.872551:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981531a00, rc 0) 00000100:00100000:3.0:1789263846.872589:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88431fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+29:12957:x1876178888687232:12345-192.168.203.20@tcp:101:bash.0 Request processed in 138us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263846.872596:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 82 00000100:00100000:2.0:1789263846.873817:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263846.873892:0:19302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888687360 00000100:00100000:0.0:1789263846.873898:0:19302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888687360 00000100:00100000:0.0:1789263846.873943:0:19302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 29 00000100:00100000:0.0:1789263846.873952:0:19302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9ab9e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+6:12957:x1876178888687360:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:0.0:1789263846.873970:0:19302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263846.873987:0:19302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005dc3a247/0xce1582440fb1f336 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d1226c expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789263846.874012:0:19302:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 9, mtime: 0x6aa5ffe5, atime: 0x6aa5ffe4, ctime: 0x6aa5ffe5, blocks: 0x8 00010000:00010000:0.0:1789263846.874031:0:19302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=289s v=(0 0) 00010000:00010000:0.0:1789263846.874044:0:19302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789263846.874052:0:19302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005dc3a247/0xce1582440fb1f336 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1226c expref: 7 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.874071:0:19302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005dc3a247/0xce1582440fb1f336 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1226c expref: 7 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.874117:0:19302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd987f50400, rc 0) 00000100:00100000:0.0:1789263846.874152:0:19302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9ab9e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+7:12957:x1876178888687360:12345-192.168.203.20@tcp:101:bash.0 Request processed in 201us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263846.874159:0:19302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 29 00000100:00100000:2.0:1789263846.875264:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263846.875316:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888687488 00000100:00100000:1.0:1789263846.875323:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888687488 00002000:00010000:1.0:1789263846.875350:0:18704:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/34 (0->18446744073709551615) 00002000:00100000:1.0:1789263846.875353:0:18704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dd989afc380 with x1876178888687488 ext(0->18446744073709551615) 00002000:00010000:1.0:1789263846.875360:0:18704:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9dd989afc380. 00000100:00100000:1.0:1789263846.875379:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 1 00000100:00100000:1.0:1789263846.875392:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989afc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+7:2399:x1876178888687488:12345-192.168.203.20@tcp:10:bash.0 00002000:00010000:1.0:1789263846.875603:0:18704:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1789263846.875606:0:18704:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 1789263845 -> 1789263847 00002000:00010000:1.0:1789263846.875608:0:18704:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 1789263844 -> 1789263844 00002000:00010000:1.0:1789263846.875609:0:18704:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1789263845 -> 1789263847 00002000:00010000:1.0:1789263846.875611:0:18704:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:1.0:1789263846.875641:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989afc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+8:2399:x1876178888687488:12345-192.168.203.20@tcp:10:bash.0 Request processed in 249us (381us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1789263846.875645:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 1 00002000:00010000:1.0:1789263846.875648:0:18704:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/34 (0->18446744073709551615) 00002000:00100000:1.0:1789263846.875650:0:18704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dd989afc380 with x1876178888687488 ext(0->18446744073709551615) 00002000:00010000:1.0:1789263846.875653:0:18704:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9dd989afc380. 00000100:00100000:1.0:1789263846.905241:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263846.905275:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888687616 00000100:00100000:3.0:1789263846.905286:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888687616 00000100:00100000:3.0:1789263846.905347:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 83 00000100:00100000:3.0:1789263846.905358:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88431e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+29:15751:x1876178888687616:12345-192.168.203.20@tcp:34:lfs.0 00010000:00010000:3.0:1789263846.905426:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1f33d lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.905443:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1f33d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.905455:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1f33d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.905469:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1f344 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.905493:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1f344 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.905501:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1f344 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.905565:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1f34b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.905575:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1f34b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.905581:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1f34b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789263846.905625:0:17192:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1f34b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.905636:0:17192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1f33d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.905642:0:17192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1f33d lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.905649:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1f33d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.905655:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981531600 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263846.905659:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1f33d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.905667:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1f33d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.905686:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9dd9bb595c00) 00010000:00010000:3.0:1789263846.905689:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789263846.905694:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1f33d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.905698:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1f33d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.905708:0:17192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1f344 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.905712:0:17192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1f344 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.905716:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1f344 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.905719:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981530400 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263846.905720:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1f344 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.905724:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1f344 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.905728:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9dd9bb595900) 00010000:00010000:3.0:1789263846.905729:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789263846.905730:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1f344 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.905733:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1f344 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.905755:0:17192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1f34b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.905760:0:17192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1f34b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.905766:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1f34b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.905771:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981530a00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263846.905774:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1f34b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.905780:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1f34b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.905788:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dd882850d00) 00010000:00010000:3.0:1789263846.905790:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789263846.905793:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1f34b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.905799:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1f34b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263846.905864:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88431e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+29:15751:x1876178888687616:12345-192.168.203.20@tcp:34:lfs.0 Request processed in 508us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263846.905869:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 83 00000100:00100000:2.0:1789263846.923849:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263846.923911:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888687872 00000100:00100000:0.0:1789263846.923922:0:18722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888687872 00000100:00100000:0.0:1789263846.923980:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 84 00000100:00100000:0.0:1789263846.923992:0:18722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989aff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+29:15754:x1876178888687872:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:0.0:1789263846.924012:0:18722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263846.924030:0:18722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50600/0xce1582440fb1f352 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d12273 expref: -99 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.924148:0:18722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51e00/0xce1582440fb1f359 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.924170:0:18722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51e00/0xce1582440fb1f359 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.924181:0:18722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51e00/0xce1582440fb1f359 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.924197:0:18722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f360 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.924217:0:18722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f360 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.924225:0:18722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f360 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.924321:0:18722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50c00/0xce1582440fb1f367 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.924328:0:18722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50c00/0xce1582440fb1f367 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.924333:0:18722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50c00/0xce1582440fb1f367 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789263846.924342:0:18722:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789263846.924426:0:18722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51e00/0xce1582440fb1f359 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.924434:0:18722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51e00/0xce1582440fb1f359 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.924441:0:18722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51e00/0xce1582440fb1f359 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.924447:0:18722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd987f51e00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:0.0:1789263846.924451:0:18722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51e00/0xce1582440fb1f359 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.924459:0:18722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51e00/0xce1582440fb1f359 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.924481:0:18722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9dd9bb595c00) 00010000:00010000:0.0:1789263846.924483:0:18722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789263846.924488:0:18722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51e00/0xce1582440fb1f359 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.924493:0:18722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51e00/0xce1582440fb1f359 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.924506:0:18722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f360 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.924511:0:18722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f360 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.924516:0:18722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f360 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.924521:0:18722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd987f50000 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:0.0:1789263846.924523:0:18722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f360 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.924529:0:18722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f360 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.924535:0:18722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9dd9bb585c00) 00010000:00010000:0.0:1789263846.924537:0:18722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789263846.924539:0:18722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f360 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.924544:0:18722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f360 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.924590:0:18722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50600/0xce1582440fb1f352 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12273 expref: 32 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.924602:0:18722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50c00/0xce1582440fb1f367 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12273 expref: 31 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.924608:0:18722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dd882850d00) 00010000:00010000:0.0:1789263846.924610:0:18722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789263846.924612:0:18722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd987f50c00, rc 0) 00000100:00100000:0.0:1789263846.924670:0:18722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989aff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+31:15754:x1876178888687872:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 681us (828us total) trans 8589934639 rc 0/0 00000100:00100000:0.0:1789263846.924678:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 84 00000100:00100000:2.0:1789263846.926475:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263846.926525:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888688000 00000100:00100000:0.0:1789263846.926534:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888688000 00000100:00100000:0.0:1789263846.926586:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 85 00000100:00100000:0.0:1789263846.926595:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989afc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+31:15754:x1876178888688000:12345-192.168.203.20@tcp:54:lfs.0 00010000:00010000:0.0:1789263846.926642:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f375 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.926657:0:17191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531200/0xce1582440fb1f30c lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12257 expref: 31 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.926665:0:17191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f375 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.926695:0:17191:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531200/0xce1582440fb1f30c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12257 expref: 31 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.926735:0:17191:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531200/0xce1582440fb1f30c lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12257 expref: 31 pid: 17192 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263846.926749:0:17191:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17191:1876178898143744:192.168.203.20@tcp:104: 00000100:00100000:0.0:1789263846.926823:0:17191:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9c09d70c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789263846.927896:0:17191:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17191:1876178898143744:192.168.203.20@tcp:104: 00010000:00010000:0.0:1789263846.927917:0:17191:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f375 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263846.927968:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263846.928103:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888688256 00000100:00100000:3.0:1789263846.928110:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888688256 00000100:00100000:3.0:1789263846.928155:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 15 00000100:00100000:3.0:1789263846.928187:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989afc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+32:15618:x1876178888688256:12345-192.168.203.20@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789263846.928466:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989afc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+33:15618:x1876178888688256:12345-192.168.203.20@tcp:35:ldlm_bl.0 Request processed in 280us (498us total) trans 8589934640 rc 0/0 00000100:00100000:3.0:1789263846.928474:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 15 00000100:00100000:1.0:1789263846.929849:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263846.929893:0:18344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888688384 00000100:00100000:0.0:1789263846.929906:0:18344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888688384 00010000:00010000:0.0:1789263846.929930:0:18344:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531200/0xce1582440fb1f30c lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12257 expref: 33 pid: 17192 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263846.929965:0:18344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 29 00000100:00100000:0.0:1789263846.929974:0:18344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88431c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+33:2397:x1876178888688384:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789263846.929987:0:18344:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789263846.929994:0:18344:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531200/0xce1582440fb1f30c lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12257 expref: 33 pid: 17192 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.930019:0:18344:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531200/0xce1582440fb1f30c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12257 expref: 33 pid: 17192 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.930040:0:18344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531200/0xce1582440fb1f30c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12257 expref: 33 pid: 17192 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.930070:0:18344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dd882850d00) 00010000:00010000:0.0:1789263846.930092:0:18344:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f375 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.930102:0:18344:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f375 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.930110:0:18344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f375 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.930139:0:18344:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789263846.930192:0:17191:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f375 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263846.930202:0:17191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f375 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263846.930204:0:18344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88431c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+32:2397:x1876178888688384:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 230us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263846.930219:0:18344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 29 00010000:00010000:2.0:1789263846.930240:0:17191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f375 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263846.930258:0:17191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f375 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263846.930264:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f375 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263846.930271:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd987f51600 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263846.930275:0:17191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f375 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263846.930283:0:17191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f375 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263846.930294:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dd882850d00) 00010000:00010000:2.0:1789263846.930296:0:17191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789263846.930301:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f375 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263846.930306:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f375 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263846.930356:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989afc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+31:15754:x1876178888688000:12345-192.168.203.20@tcp:54:lfs.0 Request processed in 3762us (3886us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263846.930364:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 85 00000100:00100000:3.0:1789263846.931178:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263846.931257:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888688640 00000100:00100000:0.0:1789263846.931262:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888688640 00000100:00100000:0.0:1789263846.931294:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 16 00000100:00100000:0.0:1789263846.931302:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c0ae7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+31:15754:x1876178888688640:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:0.0:1789263846.931453:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c0ae7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+32:15754:x1876178888688640:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 151us (288us total) trans 8589934641 rc 0/0 00000100:00100000:0.0:1789263846.931461:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 16 00000100:00100000:1.0:1789263846.965458:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263846.965514:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888688896 00000100:00100000:3.0:1789263846.965523:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888688896 00000100:00100000:3.0:1789263846.965574:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 86 00000100:00100000:3.0:1789263846.965582:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88431f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+32:15765:x1876178888688896:12345-192.168.203.20@tcp:101:cat.0 00010000:00010000:3.0:1789263846.965600:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263846.965616:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1f37c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d1227a expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.965694:0:17193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1f383 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.965705:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1f383 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.965717:0:17193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1f383 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.965736:0:17193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1f38a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.965743:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1f38a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.965750:0:17193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1f38a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.965879:0:17193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531c00/0xce1582440fb1f391 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.965889:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531c00/0xce1582440fb1f391 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.965904:0:17193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531c00/0xce1582440fb1f391 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789263846.965913:0:17193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 8 00010000:00010000:3.0:1789263846.965985:0:17193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1f383 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.965993:0:17193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1f383 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.966000:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1f383 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.966007:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981530400 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263846.966011:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1f383 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.966018:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1f383 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.966031:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9dd9bb595c00) 00010000:00010000:3.0:1789263846.966035:0:17193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789263846.966039:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1f383 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.966056:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1f383 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.966071:0:17193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1f38a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.966099:0:17193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1f38a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.966106:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1f38a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.966111:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981531600 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263846.966114:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1f38a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.966120:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1f38a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.966137:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9dd9bb595900) 00010000:00010000:3.0:1789263846.966142:0:17193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789263846.966146:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1f38a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.966151:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1f38a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.966218:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1f37c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1227a expref: 35 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.966245:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531c00/0xce1582440fb1f391 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1227a expref: 34 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.966252:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dd882850d00) 00010000:00010000:3.0:1789263846.966254:0:17193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789263846.966256:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981531c00, rc 0) 00000100:00100000:3.0:1789263846.966308:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88431f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+34:15765:x1876178888688896:12345-192.168.203.20@tcp:101:cat.0 Request processed in 726us (856us total) trans 8589934642 rc 0/0 00000100:00100000:3.0:1789263846.966315:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 86 00000100:00100000:2.0:1789263846.968671:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263846.968728:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888689152 00000100:00100000:0.0:1789263846.968738:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888689152 00000100:00100000:0.0:1789263846.968794:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 17 00000100:00100000:0.0:1789263846.968804:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989afed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+34:15765:x1876178888689152:12345-192.168.203.20@tcp:35:cat.0 00000100:00100000:0.0:1789263846.969385:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989afed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+35:15765:x1876178888689152:12345-192.168.203.20@tcp:35:cat.0 Request processed in 581us (719us total) trans 8589934643 rc 0/0 00000100:00100000:0.0:1789263846.969403:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 17 00000100:00100000:1.0:1789263846.978920:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263846.978987:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888689408 00000100:00100000:3.0:1789263846.978997:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888689408 00000100:00100000:3.0:1789263846.979047:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 87 00000100:00100000:3.0:1789263846.979054:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88431c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+35:15766:x1876178888689408:12345-192.168.203.20@tcp:36:rm.0 00010000:00010000:3.0:1789263846.979146:0:17192:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1789263846.979192:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1f32f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12265 expref: 35 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.979208:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531c00/0xce1582440fb1f391 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1227a expref: 34 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.979216:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50c00/0xce1582440fb1f367 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12273 expref: 33 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.979229:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50e00/0xce1582440fb1f321 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1225e expref: 32 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.979260:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dd882850d00) 00010000:00010000:3.0:1789263846.979264:0:17192:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789263846.979285:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1f39f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.979297:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1f39f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.979304:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1f39f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.979314:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1f3a6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.979318:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1f3a6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.979322:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1f3a6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.979382:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1f3ad lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.979390:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1f3ad lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.979395:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1f3ad lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789263846.979596:0:17192:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].3, 64 off8408 00000004:00080000:3.0:1789263846.979605:0:17192:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 289269527845ns, next at 290269525393ns, rc = 0 00010000:00010000:3.0:1789263846.979652:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1f3b4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.979662:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1f3b4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.979669:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1f3b4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.979677:0:17192:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1f3b4 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.979683:0:17192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1f3b4 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.979689:0:17192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1f3b4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.979707:0:17192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789263846.979745:0:17192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1f3ad lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.979752:0:17192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1f3ad lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.979759:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1f3ad lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.979763:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789263846.979765:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981530400 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263846.979774:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1f3ad lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.979774:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1f3b4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.979795:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1f3ad lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.979796:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981530600 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:0.0:1789263846.979802:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1f3b4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.979823:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dd882850d00) 00010000:00010000:3.0:1789263846.979826:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789263846.979829:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1f3b4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40018480000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.979830:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1f3ad lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.979848:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1f3ad lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.979856:0:17180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dd882850d00) 00010000:00010000:0.0:1789263846.979861:0:17180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789263846.979865:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1f3b4 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.979867:0:17192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1f39f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.979875:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1f3b4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.979880:0:17192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1f39f lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.979889:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1f39f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263846.979890:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263846.979894:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263846.979896:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981530a00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:0.0:1789263846.979897:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263846.979902:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1f39f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.979909:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1f39f lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.979917:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9dd9bb595c00) 00010000:00010000:3.0:1789263846.979919:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789263846.979922:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1f39f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.979927:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1f39f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789263846.979948:0:17192:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000032b4574b reply state 000000007008fa11 transno 8589934644 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1f3a6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.979959:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1f3a6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263846.979965:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9dd9bb595900) 00010000:00010000:3.0:1789263846.979968:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789263846.979970:0:17192:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789263846.980034:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88431c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+33:15766:x1876178888689408:12345-192.168.203.20@tcp:36:rm.0 Request processed in 980us (1123us total) trans 8589934644 rc 0/0 00000100:00100000:3.0:1789263846.980042:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 87 00000100:00100000:1.0:1789263847.002764:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263847.002824:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888689664 00000100:00100000:0.0:1789263847.002834:0:18722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888689664 00000100:00100000:0.0:1789263847.002892:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 88 00000100:00100000:0.0:1789263847.002899:0:18722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88431d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+33:15772:x1876178888689664:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:0.0:1789263847.002918:0:18722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263847.002933:0:18722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50600/0xce1582440fb1f3bb lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d12281 expref: -99 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.003028:0:18722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f3c2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.003042:0:18722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f3c2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.003053:0:18722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f3c2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.003064:0:18722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51e00/0xce1582440fb1f3c9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.003071:0:18722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51e00/0xce1582440fb1f3c9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.003102:0:18722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51e00/0xce1582440fb1f3c9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.003551:0:18722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50800/0xce1582440fb1f3d0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.003561:0:18722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50800/0xce1582440fb1f3d0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.003568:0:18722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50800/0xce1582440fb1f3d0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789263847.003579:0:18722:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00010000:00010000:0.0:1789263847.003609:0:18722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f3c2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.003616:0:18722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f3c2 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.003631:0:18722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f3c2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.003638:0:18722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd987f50000 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:0.0:1789263847.003642:0:18722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f3c2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.003650:0:18722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f3c2 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.003662:0:18722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9dd9bb595c00) 00010000:00010000:0.0:1789263847.003665:0:18722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789263847.003670:0:18722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f3c2 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.003674:0:18722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f3c2 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789263847.003685:0:18722:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000506eadab reply state 000000003b7808af transno 8589934645 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51e00/0xce1582440fb1f3c9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.003702:0:18722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51e00/0xce1582440fb1f3c9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.003708:0:18722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9dd9bb595900) 00010000:00010000:0.0:1789263847.003710:0:18722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789263847.003712:0:18722:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789263847.003738:0:18722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50600/0xce1582440fb1f3bb lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12281 expref: 36 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.003752:0:18722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50800/0xce1582440fb1f3d0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12281 expref: 35 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.003766:0:18722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9dd9bb585c00) 00010000:00010000:0.0:1789263847.003768:0:18722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1789263847.003771:0:18722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd987f50800, rc 0) 00000100:00100000:0.0:1789263847.003828:0:18722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88431d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+36:15772:x1876178888689664:12345-192.168.203.20@tcp:101:bash.0 Request processed in 928us (1073us total) trans 8589934645 rc 0/0 00000100:00100000:0.0:1789263847.003835:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 88 00000100:00100000:2.0:1789263847.005605:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263847.005652:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888689792 00000100:00100000:0.0:1789263847.005660:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888689792 00000100:00100000:0.0:1789263847.005708:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 89 00000100:00100000:0.0:1789263847.005717:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989afce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+36:15772:x1876178888689792:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:0.0:1789263847.005739:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263847.005754:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51000/0xce1582440fb1f3de lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d12288 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.005801:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51a00/0xce1582440fb1f3e5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.005813:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51a00/0xce1582440fb1f3e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.005823:0:17191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51a00/0xce1582440fb1f3e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789263847.005855:0:17191:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789263847.005860:0:17191:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789263847.005874:0:17191:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51a00/0xce1582440fb1f3e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.005897:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51a00/0xce1582440fb1f3e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.005917:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51000/0xce1582440fb1f3de lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12288 expref: 38 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.005931:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51a00/0xce1582440fb1f3e5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12288 expref: 37 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.005939:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9dd9bb585c00) 00010000:00010000:0.0:1789263847.005942:0:17191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789263847.005946:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd987f51a00, rc 0) 00000100:00100000:0.0:1789263847.005989:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989afce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+37:15772:x1876178888689792:12345-192.168.203.20@tcp:101:bash.0 Request processed in 273us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263847.005996:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 89 00000100:00100000:1.0:1789263847.007473:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263847.007541:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888690048 00000100:00100000:3.0:1789263847.007547:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888690048 00000100:00100000:3.0:1789263847.007582:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 18 00000100:00100000:3.0:1789263847.007591:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88431df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+37:15772:x1876178888690048:12345-192.168.203.20@tcp:35:bash.0 00000100:00100000:3.0:1789263847.007795:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88431df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+38:15772:x1876178888690048:12345-192.168.203.20@tcp:35:bash.0 Request processed in 205us (326us total) trans 8589934646 rc 0/0 00000100:00100000:3.0:1789263847.007800:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 18 00000100:00100000:1.0:1789263847.059281:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263847.059404:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888690304 00000100:00100000:3.0:1789263847.059418:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888690304 00000100:00100000:3.0:1789263847.059488:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 90 00000100:00100000:3.0:1789263847.059497:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88431ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+38:15785:x1876178888690304:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:3.0:1789263847.059525:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263847.059553:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1f3ec lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d1228f expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.059727:0:17193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1f3f3 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.059741:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1f3f3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.059755:0:17193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1f3f3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789263847.059767:0:17193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00010000:00010000:3.0:1789263847.059911:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1f3ec lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1228f expref: 41 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.059936:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1f3f3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1228f expref: 40 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.059945:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9dd9bb585c00) 00010000:00010000:3.0:1789263847.059949:0:17193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789263847.059953:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981530400, rc 0) 00000100:00100000:3.0:1789263847.060256:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88431ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+40:15785:x1876178888690304:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 759us (988us total) trans 8589934647 rc 0/0 00000100:00100000:3.0:1789263847.060262:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 90 00000100:00100000:2.0:1789263847.062579:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263847.062785:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888690432 00000100:00100000:3.0:1789263847.062795:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888690432 00000100:00100000:3.0:1789263847.062908:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 91 00000100:00100000:3.0:1789263847.062919:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989afd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+40:15785:x1876178888690432:12345-192.168.203.20@tcp:54:lfs.0 00010000:00010000:3.0:1789263847.062978:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531c00/0xce1582440fb1f401 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.063004:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531c00/0xce1582440fb1f401 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.063012:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531c00/0xce1582440fb1f401 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.063045:0:17192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531c00/0xce1582440fb1f401 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.063051:0:17192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531c00/0xce1582440fb1f401 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.063057:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531c00/0xce1582440fb1f401 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.063064:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981531c00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263847.063068:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531c00/0xce1582440fb1f401 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.063095:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531c00/0xce1582440fb1f401 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.063107:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9dd9bb585c00) 00010000:00010000:3.0:1789263847.063110:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789263847.063114:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531c00/0xce1582440fb1f401 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.063120:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531c00/0xce1582440fb1f401 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263847.063203:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989afd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+40:15785:x1876178888690432:12345-192.168.203.20@tcp:54:lfs.0 Request processed in 283us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263847.063218:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 91 00000100:00100000:1.0:1789263847.097383:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263847.097450:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888690688 00000100:00100000:0.0:1789263847.097460:0:18722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888690688 00000100:00100000:0.0:1789263847.097518:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 92 00000100:00100000:0.0:1789263847.097528:0:18722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88431ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+40:15795:x1876178888690688:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:0.0:1789263847.097548:0:18722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263847.097567:0:18722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51000/0xce1582440fb1f408 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d12296 expref: -99 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.097668:0:18722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50600/0xce1582440fb1f40f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.097681:0:18722:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50800/0xce1582440fb1f3d0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12281 expref: 41 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.097701:0:18722:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51a00/0xce1582440fb1f3e5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12288 expref: 41 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.097710:0:18722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50600/0xce1582440fb1f40f lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.097742:0:18722:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51a00/0xce1582440fb1f3e5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12288 expref: 41 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.097768:0:18722:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51a00/0xce1582440fb1f3e5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12288 expref: 41 pid: 17191 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263847.097782:0:18722:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18722:1876178898143872:192.168.203.20@tcp:104: 00010000:00010000:0.0:1789263847.097872:0:18722:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50800/0xce1582440fb1f3d0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12281 expref: 41 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.097883:0:18722:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50800/0xce1582440fb1f3d0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12281 expref: 41 pid: 18722 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263847.097894:0:18722:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18722:1876178898144000:192.168.203.20@tcp:104: 00000100:00100000:0.0:1789263847.097920:0:18722:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9c09d7540 going to sleep for 11 seconds 00000100:00100000:1.0:1789263847.099900:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263847.099903:0:18722:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18722:1876178898143872:192.168.203.20@tcp:104: 00000100:00100000:0.0:1789263847.099912:0:18722:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18722:1876178898144000:192.168.203.20@tcp:104: 00000100:00100000:1.0:1789263847.099935:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00010000:00010000:0.0:1789263847.099935:0:18722:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50600/0xce1582440fb1f40f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263847.099964:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888690816 00000100:00100000:2.0:1789263847.099972:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888690816 00010000:00010000:2.0:1789263847.100013:0:17177:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51a00/0xce1582440fb1f3e5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12288 expref: 42 pid: 17191 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263847.100061:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888690944 00000100:00100000:2.0:1789263847.100065:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888690944 00010000:00010000:2.0:1789263847.100111:0:17177:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50800/0xce1582440fb1f3d0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12281 expref: 43 pid: 18722 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263847.100112:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 30 00000100:00100000:1.0:1789263847.100127:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88431ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+43:2398:x1876178888690816:12345-192.168.203.20@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1789263847.100131:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 31 00000100:00100000:2.0:1789263847.100141:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88431d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+43:2400:x1876178888690944:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789263847.100144:0:17178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789263847.100148:0:17177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789263847.100155:0:17177:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50800/0xce1582440fb1f3d0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12281 expref: 43 pid: 18722 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263847.100172:0:17178:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51a00/0xce1582440fb1f3e5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12288 expref: 43 pid: 17191 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.100179:0:17177:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50800/0xce1582440fb1f3d0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12281 expref: 43 pid: 18722 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263847.100208:0:17178:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51a00/0xce1582440fb1f3e5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12288 expref: 43 pid: 17191 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.100238:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50800/0xce1582440fb1f3d0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12281 expref: 43 pid: 18722 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263847.100243:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51a00/0xce1582440fb1f3e5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12288 expref: 43 pid: 17191 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.100258:0:17177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9dd9bb585c00) 00010000:00010000:2.0:1789263847.100263:0:17177:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50600/0xce1582440fb1f40f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.100272:0:17177:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50600/0xce1582440fb1f40f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.100279:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50600/0xce1582440fb1f40f lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263847.100298:0:17178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9dd9bb585c00) 00010000:00010000:1.0:1789263847.100304:0:17178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789263847.100313:0:17177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789263847.100334:0:18722:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50600/0xce1582440fb1f40f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.100342:0:18722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50600/0xce1582440fb1f40f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789263847.100357:0:18722:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00000100:00100000:1.0:1789263847.100364:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88431ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+41:2398:x1876178888690816:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 237us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263847.100365:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88431d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+41:2400:x1876178888690944:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 220us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263847.100380:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 31 00000100:00100000:1.0:1789263847.100387:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 30 00010000:00010000:0.0:1789263847.100468:0:18722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51000/0xce1582440fb1f408 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12296 expref: 41 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.100485:0:18722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50600/0xce1582440fb1f40f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12296 expref: 40 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.100493:0:18722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9dd9bb585c00) 00010000:00010000:0.0:1789263847.100496:0:18722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789263847.100498:0:18722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd987f50600, rc 0) 00000100:00100000:0.0:1789263847.100526:0:18722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88431ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+40:15795:x1876178888690688:12345-192.168.203.20@tcp:101:bash.0 Request processed in 2999us (3150us total) trans 8589934648 rc 0/0 00000100:00100000:0.0:1789263847.100532:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 92 00000100:00100000:2.0:1789263847.102037:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263847.102113:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888691072 00000100:00100000:0.0:1789263847.102119:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888691072 00000100:00100000:0.0:1789263847.102158:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 93 00000100:00100000:0.0:1789263847.102175:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989aff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+40:15795:x1876178888691072:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:0.0:1789263847.102193:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263847.102205:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f41d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d1229d expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.102263:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50e00/0xce1582440fb1f424 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.102274:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50e00/0xce1582440fb1f424 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.102285:0:17191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50e00/0xce1582440fb1f424 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.102375:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f41d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1229d expref: 42 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.102390:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50e00/0xce1582440fb1f424 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1229d expref: 41 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.102396:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9dd9bb585c00) 00010000:00010000:0.0:1789263847.102399:0:17191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789263847.102402:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd987f50e00, rc 0) 00000100:00100000:0.0:1789263847.102453:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989aff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+41:15795:x1876178888691072:12345-192.168.203.20@tcp:101:bash.0 Request processed in 279us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263847.102460:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 93 00000100:00100000:3.0:1789263847.103523:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263847.103563:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888691328 00000100:00100000:2.0:1789263847.103568:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888691328 00000100:00100000:2.0:1789263847.103607:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 94 00000100:00100000:2.0:1789263847.103615:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c09f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+41:15795:x1876178888691328:12345-192.168.203.20@tcp:36:bash.0 00010000:00010000:2.0:1789263847.103779:0:17193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22a00/0xce1582440fb1f42b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.103790:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22a00/0xce1582440fb1f42b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.103798:0:17193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22a00/0xce1582440fb1f42b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789263847.103841:0:17193:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934649 00000004:00010000:2.0:1789263847.103864:0:17193:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003d416b06 reply state 000000009d816c36 transno 8589934650 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22a00/0xce1582440fb1f42b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.103877:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22a00/0xce1582440fb1f42b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.103883:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9dd9bb585c00) 00010000:00010000:2.0:1789263847.103884:0:17193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789263847.103886:0:17193:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789263847.103937:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c09f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+44:15795:x1876178888691328:12345-192.168.203.20@tcp:36:bash.0 Request processed in 324us (419us total) trans 8589934650 rc 0/0 00000100:00100000:2.0:1789263847.103953:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 94 00000020:00080000:2.0:1789263847.103958:0:17193:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789263847.104972:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263847.105009:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888691456 00000100:00100000:0.0:1789263847.105017:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888691456 00000100:00100000:0.0:1789263847.105050:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 95 00000100:00100000:0.0:1789263847.105060:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88431d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+44:15795:x1876178888691456:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:0.0:1789263847.105096:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263847.105111:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50c00/0xce1582440fb1f432 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d122a4 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.105201:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f439 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.105219:0:17191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50600/0xce1582440fb1f40f lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12296 expref: 45 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.105234:0:17191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f439 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.105264:0:17191:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50600/0xce1582440fb1f40f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12296 expref: 45 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.105288:0:17191:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50600/0xce1582440fb1f40f lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12296 expref: 45 pid: 18722 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263847.105301:0:17191:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17191:1876178898144128:192.168.203.20@tcp:104: 00000100:00100000:0.0:1789263847.105359:0:17191:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9c09d7540 going to sleep for 11 seconds 00000100:00100000:0.0:1789263847.106217:0:17191:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17191:1876178898144128:192.168.203.20@tcp:104: 00010000:00010000:0.0:1789263847.106235:0:17191:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f439 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263847.106504:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263847.106614:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888691584 00000100:00100000:3.0:1789263847.106620:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888691584 00010000:00010000:3.0:1789263847.106646:0:17179:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50600/0xce1582440fb1f40f lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12296 expref: 46 pid: 18722 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263847.106676:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 32 00000100:00100000:3.0:1789263847.106683:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa60850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+46:2397:x1876178888691584:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789263847.106694:0:17179:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789263847.106700:0:17179:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50600/0xce1582440fb1f40f lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12296 expref: 46 pid: 18722 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.106719:0:17179:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50600/0xce1582440fb1f40f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12296 expref: 46 pid: 18722 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.106737:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50600/0xce1582440fb1f40f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12296 expref: 46 pid: 18722 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.106760:0:17179:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9dd9bb585c00) 00010000:00010000:3.0:1789263847.106764:0:17179:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f439 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.106772:0:17179:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f439 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.106778:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f439 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.106807:0:17179:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789263847.106828:0:17191:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f439 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.106836:0:17191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f439 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263847.106842:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa60850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+45:2397:x1876178888691584:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 155us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263847.106851:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 32 00000004:00200000:0.0:1789263847.106875:0:17191:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789263847.106888:0:17191:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789263847.106908:0:17191:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f439 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.106934:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50c00/0xce1582440fb1f432 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122a4 expref: 45 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.106948:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f439 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122a4 expref: 44 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.106955:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9dd9bb585c00) 00010000:00010000:0.0:1789263847.106958:0:17191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789263847.106960:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd987f51600, rc 0) 00000100:00100000:0.0:1789263847.106994:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88431d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+44:15795:x1876178888691456:12345-192.168.203.20@tcp:101:bash.0 Request processed in 1935us (2023us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263847.107002:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 95 00000100:00100000:1.0:1789263847.111607:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263847.111655:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888691840 00000100:00100000:0.0:1789263847.111665:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888691840 00000100:00100000:0.0:1789263847.111719:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 19 00000100:00100000:0.0:1789263847.111730:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88431ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+44:15795:x1876178888691840:12345-192.168.203.20@tcp:35:bash.0 00000100:00100000:0.0:1789263847.111940:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88431ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+45:15795:x1876178888691840:12345-192.168.203.20@tcp:35:bash.0 Request processed in 211us (338us total) trans 8589934651 rc 0/0 00000100:00100000:0.0:1789263847.111948:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 19 00000100:00100000:3.0:1789263847.139443:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263847.139507:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888691968 00000100:00100000:0.0:1789263847.139520:0:18722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888691968 00000100:00100000:0.0:1789263847.139597:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 96 00000100:00100000:0.0:1789263847.139608:0:18722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c09f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+45:15801:x1876178888691968:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:0.0:1789263847.139638:0:18722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263847.139680:0:18722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50c00/0xce1582440fb1f440 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d122ab expref: -99 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.139761:0:18722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f447 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.139777:0:18722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f447 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.139790:0:18722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f447 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789263847.139855:0:18722:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789263847.139859:0:18722:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789263847.139882:0:18722:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f447 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.139909:0:18722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50c00/0xce1582440fb1f440 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122ab expref: 47 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.139930:0:18722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f447 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122ab expref: 46 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.139940:0:18722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9dd9bb595c00) 00010000:00010000:0.0:1789263847.139944:0:18722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789263847.139948:0:18722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd987f50000, rc 0) 00000100:00100000:0.0:1789263847.140023:0:18722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c09f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+46:15801:x1876178888691968:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 413us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263847.140031:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 96 00000100:00100000:1.0:1789263847.141574:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263847.141626:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888692096 00000100:00100000:3.0:1789263847.141636:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888692096 00000100:00100000:3.0:1789263847.141690:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 97 00000100:00100000:3.0:1789263847.141708:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88431f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+46:15801:x1876178888692096:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:3.0:1789263847.141728:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263847.141746:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1f44e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d122b2 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.141819:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531c00/0xce1582440fb1f455 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.141833:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531c00/0xce1582440fb1f455 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.141843:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531c00/0xce1582440fb1f455 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.141854:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1f45c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.141861:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1f45c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.141868:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1f45c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.141933:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1f463 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.141939:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1f463 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.141943:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1f463 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789263847.141974:0:17192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00000004:00200000:3.0:1789263847.141977:0:17192:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789263847.141990:0:17192:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1f463 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.141996:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1f463 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.142002:0:17192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531c00/0xce1582440fb1f455 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.142005:0:17192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531c00/0xce1582440fb1f455 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.142009:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531c00/0xce1582440fb1f455 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.142020:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981531c00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263847.142023:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531c00/0xce1582440fb1f455 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.142028:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531c00/0xce1582440fb1f455 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.142043:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9dd9bb595c00) 00010000:00010000:3.0:1789263847.142045:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789263847.142048:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531c00/0xce1582440fb1f455 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.142052:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531c00/0xce1582440fb1f455 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.142061:0:17192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1f45c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.142064:0:17192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1f45c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.142068:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1f45c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.142071:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981531a00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263847.142073:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1f45c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.142094:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1f45c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.142098:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9dd9bb595900) 00010000:00010000:3.0:1789263847.142100:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789263847.142102:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1f45c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.142106:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1f45c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.142133:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530a00/0xce1582440fb1f44e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122b2 expref: 48 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.142142:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1f463 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122b2 expref: 47 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.142146:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9dd9bb585c00) 00010000:00010000:3.0:1789263847.142148:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789263847.142149:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981530c00, rc 0) 00000100:00100000:3.0:1789263847.142215:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88431f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+47:15801:x1876178888692096:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 516us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263847.142222:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 97 00000100:00100000:1.0:1789263847.143653:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263847.143711:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888692224 00000100:00100000:2.0:1789263847.143720:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888692224 00000100:00100000:2.0:1789263847.143772:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 2 00000100:00100000:2.0:1789263847.143783:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88431c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+47:2398:x1876178888692224:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789263847.143796:0:17177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789263847.143814:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530c00/0xce1582440fb1f463 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122b2 expref: 47 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.143831:0:17177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9dd9bb585c00) 00010000:00010000:2.0:1789263847.143836:0:17177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789263847.143875:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88431c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+46:2398:x1876178888692224:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 96us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263847.143883:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 2 00000100:00100000:1.0:1789263847.143992:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263847.144027:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888692480 00000100:00100000:2.0:1789263847.144032:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888692480 00000100:00100000:2.0:1789263847.144106:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 98 00000100:00100000:2.0:1789263847.144127:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88431d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+46:15801:x1876178888692480:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:2.0:1789263847.144141:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263847.144153:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22800/0xce1582440fb1f46a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d122b9 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.144266:0:17193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23e00/0xce1582440fb1f471 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.144280:0:17193:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f439 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122a4 expref: 47 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.144295:0:17193:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23e00/0xce1582440fb1f471 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.144326:0:17193:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f439 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122a4 expref: 47 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.144351:0:17193:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f439 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122a4 expref: 47 pid: 17191 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263847.144366:0:17193:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989afe300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17193:1876178898144256:192.168.203.20@tcp:104: 00000100:00100000:2.0:1789263847.144433:0:17193:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9bf982480 going to sleep for 11 seconds 00000100:00100000:3.0:1789263847.145660:0:17193:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989afe300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17193:1876178898144256:192.168.203.20@tcp:104: 00010000:00010000:3.0:1789263847.145683:0:17193:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23e00/0xce1582440fb1f471 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263847.145926:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263847.146013:0:18344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888692608 00000100:00100000:0.0:1789263847.146028:0:18344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888692608 00010000:00010000:0.0:1789263847.146057:0:18344:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f439 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122a4 expref: 48 pid: 17191 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263847.146172:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 33 00000100:00100000:3.0:1789263847.146185:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88431ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+48:2397:x1876178888692608:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789263847.146198:0:17179:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789263847.146206:0:17179:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f439 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122a4 expref: 48 pid: 17191 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.146229:0:17179:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f439 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122a4 expref: 48 pid: 17191 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.146248:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f439 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122a4 expref: 48 pid: 17191 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.146268:0:17179:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9dd9bb585c00) 00010000:00010000:3.0:1789263847.146272:0:17179:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23e00/0xce1582440fb1f471 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.146352:0:17179:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23e00/0xce1582440fb1f471 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.146359:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23e00/0xce1582440fb1f471 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.146387:0:17179:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789263847.146413:0:17193:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23e00/0xce1582440fb1f471 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.146423:0:17193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23e00/0xce1582440fb1f471 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263847.146438:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88431ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+47:2397:x1876178888692608:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 249us (505us total) trans 0 rc 0/0 00000004:00200000:2.0:1789263847.146441:0:17193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00000100:00100000:3.0:1789263847.146448:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 33 00010000:00010000:2.0:1789263847.146569:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22800/0xce1582440fb1f46a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122b9 expref: 48 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.146587:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23e00/0xce1582440fb1f471 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122b9 expref: 47 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.146596:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9dd9bb585c00) 00010000:00010000:2.0:1789263847.146599:0:17193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789263847.146602:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bfa23e00, rc 0) 00000100:00100000:2.0:1789263847.146647:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88431d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+47:15801:x1876178888692480:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 2524us (2655us total) trans 8589934652 rc 0/0 00000100:00100000:2.0:1789263847.146655:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 98 00000100:00100000:1.0:1789263847.148156:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263847.148210:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888692992 00000100:00100000:3.0:1789263847.148218:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888692992 00000100:00100000:3.0:1789263847.148256:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 20 00000100:00100000:3.0:1789263847.148263:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+47:15801:x1876178888692992:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:3.0:1789263847.148440:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+48:15801:x1876178888692992:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 177us (289us total) trans 8589934653 rc 0/0 00000100:00100000:3.0:1789263847.148449:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 20 00000100:00100000:3.0:1789263847.149575:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263847.149665:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888693120 00000100:00100000:1.0:1789263847.149671:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888693120 00000100:00100000:1.0:1789263847.149716:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 3 00000100:00100000:1.0:1789263847.149725:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c09f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+48:15801:x1876178888693120:12345-192.168.203.20@tcp:103:lfs.0 00010000:00010000:1.0:1789263847.149736:0:17178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789263847.149767:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530400/0xce1582440fb1f3f3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1228f expref: 48 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263847.149783:0:17178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9dd9bb585c00) 00010000:00010000:1.0:1789263847.149788:0:17178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789263847.149831:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c09f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+47:15801:x1876178888693120:12345-192.168.203.20@tcp:103:lfs.0 Request processed in 107us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263847.149838:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 3 00000100:00100000:1.0:1789263847.150755:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263847.150811:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888693248 00000100:00100000:0.0:1789263847.150817:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888693248 00000100:00100000:0.0:1789263847.150854:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 99 00000100:00100000:0.0:1789263847.150862:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+47:15801:x1876178888693248:12345-192.168.203.20@tcp:58:lfs.0 00010000:00010000:0.0:1789263847.150938:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50c00/0xce1582440fb1f47f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.150952:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50c00/0xce1582440fb1f47f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.150961:0:17191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50c00/0xce1582440fb1f47f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789263847.151047:0:17191:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].2, 136 off8464 00000100:00100000:0.0:1789263847.151135:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+47:15801:x1876178888693248:12345-192.168.203.20@tcp:58:lfs.0 Request processed in 273us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263847.151152:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 99 00000100:00100000:3.0:1789263847.152295:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263847.152362:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888693376 00000100:00100000:0.0:1789263847.152369:0:18722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888693376 00000100:00100000:0.0:1789263847.152408:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 100 00000100:00100000:0.0:1789263847.152418:0:18722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c09f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+47:15801:x1876178888693376:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:0.0:1789263847.152431:0:18722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263847.152444:0:18722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51000/0xce1582440fb1f486 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d122c0 expref: -99 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.152501:0:18722:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50c00/0xce1582440fb1f47f lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.152510:0:18722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51000/0xce1582440fb1f486 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122c0 expref: 48 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.152526:0:18722:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50c00/0xce1582440fb1f47f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.152539:0:18722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51000/0xce1582440fb1f486 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122c0 expref: 48 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.152551:0:18722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9dd9bb585c00) 00010000:00010000:0.0:1789263847.152554:0:18722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789263847.152558:0:18722:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51000/0xce1582440fb1f486 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122c0 expref: 48 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.152565:0:18722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd987f51000, rc 0) 00000100:00100000:0.0:1789263847.152599:0:18722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c09f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+48:15801:x1876178888693376:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 183us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263847.152606:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 100 00010000:00010000:3.0:1789263847.725359:0:20218:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789263847.853414:0:17227:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789263847.853426:0:17227:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789263847.853453:0:17227:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:1.0:1789263847.853463:0:17227:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1789263847.853642:0:17227:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883e30e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17227:1876178898144384:192.168.203.20@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789263847.853758:0:17227:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd881f31240 going to sleep for 11 seconds 00000100:00100000:1.0:1789263847.855971:0:17227:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883e30e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17227:1876178898144384:192.168.203.20@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789263847.856129:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263847.856279:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888693504 00000100:00100000:0.0:1789263847.856287:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888693504 00000100:00100000:0.0:1789263847.856351:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 101 00000100:00100000:0.0:1789263847.856361:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c09f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+48:15802:x1876178888693504:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789263847.856390:0:17192:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789263847.856502:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c09f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+48:15802:x1876178888693504:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 Request processed in 143us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263847.856510:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 101 00000100:00100000:3.0:1789263847.857964:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263847.858022:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888693632 00000100:00100000:2.0:1789263847.858030:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888693632 00000100:00100000:2.0:1789263847.858111:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 102 00000100:00100000:2.0:1789263847.858121:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c09f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+48:15802:x1876178888693632:12345-192.168.203.20@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789263847.858345:0:17193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22800/0xce1582440fb1f48d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.858362:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22800/0xce1582440fb1f48d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.858373:0:17193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22800/0xce1582440fb1f48d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.858434:0:17193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23400/0xce1582440fb1f494 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.858443:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23400/0xce1582440fb1f494 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.858450:0:17193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23400/0xce1582440fb1f494 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.858475:0:17193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22e00/0xce1582440fb1f49b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.858484:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22e00/0xce1582440fb1f49b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.858489:0:17193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22e00/0xce1582440fb1f49b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789263847.858534:0:17193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789263847.858537:0:17193:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789263847.858546:0:17193:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22e00/0xce1582440fb1f49b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.858554:0:17193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22800/0xce1582440fb1f48d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.858558:0:17193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22800/0xce1582440fb1f48d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.858563:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22800/0xce1582440fb1f48d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.858567:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bfa22800 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263847.858570:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22800/0xce1582440fb1f48d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.858575:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22800/0xce1582440fb1f48d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.858583:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9dd9bb595f00) 00010000:00010000:2.0:1789263847.858586:0:17193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789263847.858589:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22800/0xce1582440fb1f48d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.858592:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22800/0xce1582440fb1f48d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.858602:0:17193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23400/0xce1582440fb1f494 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.858618:0:17193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23400/0xce1582440fb1f494 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.858624:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23400/0xce1582440fb1f494 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.858630:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bfa23400 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263847.858633:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23400/0xce1582440fb1f494 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.858640:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23400/0xce1582440fb1f494 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.858647:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdfbec3e4 (ffff9dd882850000) 00010000:00010000:2.0:1789263847.858650:0:17193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789263847.858652:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23400/0xce1582440fb1f494 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.858659:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23400/0xce1582440fb1f494 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.858671:0:17193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22e00/0xce1582440fb1f49b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.858677:0:17193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22e00/0xce1582440fb1f49b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.858683:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22e00/0xce1582440fb1f49b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.858689:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bfa22e00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263847.858695:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22e00/0xce1582440fb1f49b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.858702:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22e00/0xce1582440fb1f49b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.858710:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9dd9bb585c00) 00010000:00010000:2.0:1789263847.858712:0:17193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789263847.858715:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22e00/0xce1582440fb1f49b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.858721:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22e00/0xce1582440fb1f49b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263847.858783:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c09f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+48:15802:x1876178888693632:12345-192.168.203.20@tcp:34:lhsmtool_posix.0 Request processed in 664us (823us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263847.858791:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 102 00000100:00100000:3.0:1789263847.860170:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263847.860233:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888693888 00000100:00100000:2.0:1789263847.860241:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888693888 00000100:00100000:2.0:1789263847.860293:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 103 00000100:00100000:2.0:1789263847.860303:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c09f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+48:15802:x1876178888693888:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789263847.860319:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263847.860335:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23c00/0xce1582440fb1f4a2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d122c7 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.860410:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23000/0xce1582440fb1f4a9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.860422:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23000/0xce1582440fb1f4a9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.860442:0:17191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23000/0xce1582440fb1f4a9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789263847.860453:0:17191:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789263847.860526:0:17191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23000/0xce1582440fb1f4a9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.860533:0:17191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23000/0xce1582440fb1f4a9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.860539:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23000/0xce1582440fb1f4a9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.860545:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bfa23000 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263847.860548:0:17191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23000/0xce1582440fb1f4a9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.860555:0:17191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23000/0xce1582440fb1f4a9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.860565:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9dd9bb585c00) 00010000:00010000:2.0:1789263847.860568:0:17191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789263847.860572:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23000/0xce1582440fb1f4a9 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.860579:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23000/0xce1582440fb1f4a9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.860610:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23c00/0xce1582440fb1f4a2 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122c7 expref: 50 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.860632:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9dd9bb595f00) 00010000:00010000:2.0:1789263847.860635:0:17191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789263847.860639:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23c00/0xce1582440fb1f4a2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122c7 expref: 50 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.860648:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bfa23c00, rc 0) 00000100:00100000:2.0:1789263847.860708:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c09f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+49:15802:x1876178888693888:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 407us (552us total) trans 8589934654 rc 301/301 00000100:00100000:2.0:1789263847.860715:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 103 00000100:00100000:3.0:1789263847.862984:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263847.863049:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888694016 00000100:00100000:0.0:1789263847.863058:0:18722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888694016 00000100:00100000:0.0:1789263847.863143:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 104 00000100:00100000:0.0:1789263847.863153:0:18722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c09f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+49:15802:x1876178888694016:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789263847.863194:0:18722:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789263847.863396:0:18722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c09f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+49:15802:x1876178888694016:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 Request processed in 244us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263847.863411:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 104 00000100:00100000:3.0:1789263847.865718:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263847.866090:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888694272 00000100:00100000:0.0:1789263847.866101:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888694272 00000100:00100000:0.0:1789263847.866175:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 105 00000100:00100000:0.0:1789263847.866185:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c09f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+49:15802:x1876178888694272:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789263847.866201:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263847.866204:0:17192:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789263847.866223:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f447 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122ab expref: 49 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.866236:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9dd9bb595c00) 00010000:00010000:0.0:1789263847.866239:0:17192:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789263847.866248:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f4b7 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d122ce expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789263847.866626:0:17192:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x7:0x0], count =27 00000004:00080000:0.0:1789263847.866632:0:17192:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x7:0x0]+27 in llog 00000004:00080000:0.0:1789263847.866662:0:17192:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x22:0x0], index 0: 0 00010000:00010000:0.0:1789263847.866812:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50600/0xce1582440fb1f4be lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.866825:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50600/0xce1582440fb1f4be lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.866841:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50600/0xce1582440fb1f4be lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.866893:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f4b7 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122ce expref: 51 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.866907:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50600/0xce1582440fb1f4be lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122ce expref: 50 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.866915:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9dd9bb585900) 00010000:00010000:0.0:1789263847.866917:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789263847.866920:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd987f50600, rc 0) 00000100:00100000:0.0:1789263847.866985:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c09f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+50:15802:x1876178888694272:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 801us (1278us total) trans 8589934655 rc 0/0 00000100:00100000:0.0:1789263847.866992:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 105 00000100:00100000:3.0:1789263847.870037:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263847.870115:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888694528 00000100:00100000:2.0:1789263847.870125:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888694528 00000100:00100000:2.0:1789263847.870192:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 106 00000100:00100000:2.0:1789263847.870201:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c09f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+50:15802:x1876178888694528:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789263847.870263:0:17193:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789263847.870288:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50600/0xce1582440fb1f4be lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122ce expref: 50 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.870305:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9dd9bb585900) 00010000:00010000:2.0:1789263847.870323:0:17193:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789263847.870341:0:17193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23c00/0xce1582440fb1f4cc lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.870354:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23c00/0xce1582440fb1f4cc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.870365:0:17193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23c00/0xce1582440fb1f4cc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.870435:0:17193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23000/0xce1582440fb1f4d3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x31929a55 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.870444:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23000/0xce1582440fb1f4d3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x31929a55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.870451:0:17193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23000/0xce1582440fb1f4d3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x31929a55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.870491:0:17193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23c00/0xce1582440fb1f4cc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.870498:0:17193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23c00/0xce1582440fb1f4cc lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.870505:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23c00/0xce1582440fb1f4cc lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.870512:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bfa23c00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263847.870515:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23c00/0xce1582440fb1f4cc lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.870522:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23c00/0xce1582440fb1f4cc lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.870530:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9dd9bb595c00) 00010000:00010000:2.0:1789263847.870532:0:17193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789263847.870535:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23c00/0xce1582440fb1f4cc lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.870541:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23c00/0xce1582440fb1f4cc lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.870559:0:17193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23000/0xce1582440fb1f4d3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x31929a55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.870565:0:17193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23000/0xce1582440fb1f4d3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x31929a55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.870571:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23000/0xce1582440fb1f4d3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x31929a55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.870577:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bfa23000 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263847.870580:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23000/0xce1582440fb1f4d3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x31929a55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.870595:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23000/0xce1582440fb1f4d3 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x31929a55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.870604:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x31929a55 (ffff9dd882850000) 00010000:00010000:2.0:1789263847.870606:0:17193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789263847.870609:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23000/0xce1582440fb1f4d3 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x31929a55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.870615:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23000/0xce1582440fb1f4d3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x31929a55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263847.870680:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c09f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+49:15802:x1876178888694528:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 Request processed in 479us (650us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789263847.870687:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 106 00000100:00100000:2.0:1789263847.872579:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263847.872817:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888694656 00000100:00100000:1.0:1789263847.872828:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888694656 00000100:00100000:1.0:1789263847.872892:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 107 00000100:00100000:1.0:1789263847.872901:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989afea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+49:15802:x1876178888694656:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789263847.872919:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263847.872933:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3800/0xce1582440fb1f4da lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d122d5 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263847.872958:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2000/0xce1582440fb1f4e1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263847.872984:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2000/0xce1582440fb1f4e1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263847.872994:0:17191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2000/0xce1582440fb1f4e1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263847.873128:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3800/0xce1582440fb1f4da lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122d5 expref: 51 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263847.873148:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2000/0xce1582440fb1f4e1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122d5 expref: 50 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263847.873166:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9dd883cc7400) 00010000:00010000:1.0:1789263847.873172:0:17191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789263847.873175:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd8841a2000, rc 0) 00000100:00100000:1.0:1789263847.873228:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989afea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+50:15802:x1876178888694656:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 328us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263847.873236:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 107 00000100:00100000:3.0:1789263847.875211:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263847.875270:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888694912 00000100:00100000:0.0:1789263847.875280:0:18722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888694912 00000100:00100000:0.0:1789263847.875333:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 108 00000100:00100000:0.0:1789263847.875344:0:18722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c09f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+50:15802:x1876178888694912:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789263847.875413:0:18722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f4e8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.875441:0:18722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f4e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.875451:0:18722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f4e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789263847.875609:0:18722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:0.0:1789263847.875619:0:18722:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 290165541365ns, next at 291165539725ns, rc = 0 00000004:00010000:0.0:1789263847.875657:0:18722:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000047dbb971 reply state 00000000f5bdb3fb transno 8589934656 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f4e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.875667:0:18722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f4e8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.875672:0:18722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9dd883cc7400) 00010000:00010000:0.0:1789263847.875674:0:18722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1789263847.875676:0:18722:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789263847.875752:0:18722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c09f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+52:15802:x1876178888694912:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 Request processed in 411us (548us total) trans 8589934656 rc 0/0 00000100:00100000:0.0:1789263847.875757:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 108 00000100:00100000:3.0:1789263847.878479:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263847.878731:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888695040 00000100:00100000:0.0:1789263847.878741:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888695040 00000100:00100000:0.0:1789263847.878796:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 109 00000100:00100000:0.0:1789263847.878806:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c09f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+52:15802:x1876178888695040:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789263847.878828:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263847.878846:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f4ef lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d122dc expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.878909:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f4ef lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122dc expref: 53 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.878919:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f4ef lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122dc expref: 53 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.878933:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9dd883cc7400) 00010000:00010000:0.0:1789263847.878935:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789263847.878938:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd987f50000, rc 0) 00000100:00100000:0.0:1789263847.878990:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c09f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+53:15802:x1876178888695040:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 185us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263847.878997:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 109 00000100:00100000:2.0:1789263847.881958:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263847.882037:0:19981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888695168 00000100:00100000:1.0:1789263847.882046:0:19981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888695168 00000100:00080000:0.0:1789263847.882115:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789263847.882190:0:19981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 30 00000100:00100000:1.0:1789263847.882201:0:19981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989afc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+5:2397:x1876178888695168:12345-192.168.203.20@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789263847.882439:0:19981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989afc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+6:2397:x1876178888695168:12345-192.168.203.20@tcp:2:lhsmtool_posix.0 Request processed in 240us (486us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1789263847.882447:0:19981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 30 00000100:00100000:0.0:1789263847.885467:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263847.885538:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888695424 00000100:00100000:2.0:1789263847.885556:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888695424 00000100:00100000:2.0:1789263847.885610:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 21 00000100:00100000:2.0:1789263847.885621:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88397ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+53:15802:x1876178888695424:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789263847.885815:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88397ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+54:15802:x1876178888695424:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 Request processed in 196us (355us total) trans 8589934657 rc 0/0 00000100:00100000:2.0:1789263847.885823:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 21 00000100:00100000:2.0:1789263847.887452:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263847.887632:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888695680 00000100:00100000:3.0:1789263847.887640:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888695680 00000100:00100000:3.0:1789263847.887695:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 110 00000100:00100000:3.0:1789263847.887705:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989afe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+54:15802:x1876178888695680:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789263847.887803:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989afe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+54:15802:x1876178888695680:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 Request processed in 99us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263847.887811:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 110 00000100:00100000:3.0:1789263847.889131:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263847.889171:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888695808 00000100:00100000:1.0:1789263847.889189:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888695808 00000100:00100000:1.0:1789263847.889237:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 111 00000100:00100000:1.0:1789263847.889251:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c09f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+54:15802:x1876178888695808:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789263847.889265:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263847.889284:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2800/0xce1582440fb1f4f6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d122e3 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263847.889341:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3e00/0xce1582440fb1f4fd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263847.889354:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3e00/0xce1582440fb1f4fd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263847.889364:0:17191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3e00/0xce1582440fb1f4fd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789263847.889404:0:17191:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789263847.889423:0:17191:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3e00/0xce1582440fb1f4fd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263847.889448:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2800/0xce1582440fb1f4f6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122e3 expref: 56 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263847.889465:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3e00/0xce1582440fb1f4fd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122e3 expref: 55 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263847.889471:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9dd883cc7400) 00010000:00010000:1.0:1789263847.889473:0:17191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789263847.889475:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd8841a3e00, rc 0) 00000100:00100000:1.0:1789263847.889519:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c09f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+55:15802:x1876178888695808:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 270us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263847.889533:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 111 00000100:00100000:1.0:1789263847.890698:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263847.890750:0:18699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888695936 00000100:00100000:2.0:1789263847.890757:0:18699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888695936 00000100:00100000:2.0:1789263847.890799:0:18699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 31 00000100:00100000:2.0:1789263847.890807:0:18699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+6:2398:x1876178888695936:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789263847.890819:0:18699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263847.890834:0:18699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016612680/0xce1582440fb1f504 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d122ea expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789263847.890857:0:18699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa5ffe8, blocks: 0x0 00010000:00010000:2.0:1789263847.890872:0:18699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=290s v=(0 0) 00010000:00010000:2.0:1789263847.890877:0:18699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789263847.890883:0:18699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016612680/0xce1582440fb1f504 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122ea expref: 7 pid: 18699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.890897:0:18699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000016612680/0xce1582440fb1f504 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122ea expref: 7 pid: 18699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.890909:0:18699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bfa23400, rc 0) 00000100:00100000:2.0:1789263847.890950:0:18699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+7:2398:x1876178888695936:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 144us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263847.890965:0:18699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 31 00000100:00100000:2.0:1789263847.892138:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263847.892201:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888696192 00000100:00100000:3.0:1789263847.892207:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888696192 00000100:00100000:3.0:1789263847.892362:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 112 00000100:00100000:3.0:1789263847.892372:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989afdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+55:15802:x1876178888696192:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789263847.892454:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989afdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+55:15802:x1876178888696192:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 Request processed in 83us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263847.892461:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 112 00000100:00100000:3.0:1789263847.893689:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263847.893741:0:19302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888696320 00000100:00100000:0.0:1789263847.893749:0:19302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888696320 00000100:00100000:0.0:1789263847.893788:0:19302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 32 00000100:00100000:0.0:1789263847.893798:0:19302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c09f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+7:15802:x1876178888696320:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789263847.893812:0:19302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263847.893829:0:19302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e4ff603/0xce1582440fb1f50b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d122f1 expref: -99 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.893851:0:19302:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000016612680/0xce1582440fb1f504 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122ea expref: 8 pid: 18699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.893870:0:19302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789263847.893873:0:19302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789263847.893877:0:19302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e4ff603/0xce1582440fb1f50b lrc: 4/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122f1 expref: 8 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.893902:0:19302:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000016612680/0xce1582440fb1f504 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122ea expref: 8 pid: 18699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.893923:0:19302:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000016612680/0xce1582440fb1f504 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122ea expref: 8 pid: 18699 timeout: 390 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263847.893932:0:19302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:19302:1876178898144512:192.168.203.20@tcp:104: 00000100:00100000:0.0:1789263847.893985:0:19302:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9908eca80 going to sleep for 11 seconds 00000100:00100000:0.0:1789263847.895528:0:19302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:19302:1876178898144512:192.168.203.20@tcp:104: 00000100:00100000:2.0:1789263847.895549:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00010000:00010000:0.0:1789263847.895555:0:19302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006e4ff603/0xce1582440fb1f50b lrc: 3/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122f1 expref: 8 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.895570:0:19302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd987f50800, rc 0) 00000100:00100000:0.0:1789263847.895614:0:19302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c09f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+8:15802:x1876178888696320:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 1817us (1928us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263847.895622:0:19302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 32 00000100:00100000:1.0:1789263847.895634:0:18344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888696448 00000100:00100000:1.0:1789263847.895641:0:18344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888696448 00010000:00010000:1.0:1789263847.895673:0:18344:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000016612680/0xce1582440fb1f504 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122ea expref: 8 pid: 18699 timeout: 390 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263847.895700:0:18344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 34 00000100:00100000:1.0:1789263847.895708:0:18344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989afd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+8:2397:x1876178888696448:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789263847.895719:0:18344:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789263847.895739:0:18344:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000016612680/0xce1582440fb1f504 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122ea expref: 8 pid: 18699 timeout: 390 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263847.895757:0:18344:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000016612680/0xce1582440fb1f504 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122ea expref: 8 pid: 18699 timeout: 390 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263847.895777:0:18344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016612680/0xce1582440fb1f504 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122ea expref: 8 pid: 18699 timeout: 390 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263847.895788:0:18344:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789263847.895792:0:18344:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789263847.895799:0:18344:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006e4ff603/0xce1582440fb1f50b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122f1 expref: 7 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263847.895808:0:18344:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e4ff603/0xce1582440fb1f50b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122f1 expref: 7 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263847.895863:0:18344:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000006e4ff603/0xce1582440fb1f50b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122f1 expref: 7 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263847.895876:0:18344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8838f0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:18344:1876178898144640:192.168.203.20@tcp:105: 00000100:00100000:1.0:1789263847.895929:0:18344:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd881f31780 going to sleep for 11 seconds 00000100:00100000:0.0:1789263847.898008:0:18344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8838f0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:18344:1876178898144640:192.168.203.20@tcp:105: 00010000:00010000:0.0:1789263847.898035:0:18344:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789263847.898183:0:18344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989afd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+7:2397:x1876178888696448:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 2473us (2635us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263847.898194:0:18344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 34 00000100:00100000:2.0:1789263847.898487:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263847.898533:0:18702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888696576 00000100:00100000:0.0:1789263847.898539:0:18702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888696576 00002000:00100000:0.0:1789263847.898573:0:18702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x22:0x0] (0->12) req@ffff9dd989afca80 x1876178888696576/t0(0) o4->aea5b0bf-5091-4b59-8387-6d6e4df18cfc@192.168.203.20@tcp:683/0 lens 504/0 e 0 to 0 dl 1789263858 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1789263847.898580:0:18702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dd989afca80 with x1876178888696576 ext(0->12) 00002000:00010000:0.0:1789263847.898585:0:18702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dd989afca80 00000100:00100000:0.0:1789263847.898606:0:18702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 2 00000100:00100000:0.0:1789263847.898614:0:18702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989afca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+7:2398:x1876178888696576:12345-192.168.203.20@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789263847.899241:0:18702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989afca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+9:2398:x1876178888696576:12345-192.168.203.20@tcp:4:lhsmtool_posix.0 Request processed in 627us (752us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1789263847.899251:0:18702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 2 00002000:00100000:0.0:1789263847.899258:0:18702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x22:0x0] (0->12) req@ffff9dd989afca80 x1876178888696576/t8589934597(0) o4->aea5b0bf-5091-4b59-8387-6d6e4df18cfc@192.168.203.20@tcp:683/0 lens 504/448 e 0 to 0 dl 1789263858 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1789263847.899267:0:18702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dd989afca80 with x1876178888696576 ext(0->12) 00002000:00010000:0.0:1789263847.899271:0:18702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dd989afca80 00000100:00100000:2.0:1789263847.900129:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263847.900208:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888696704 00000100:00100000:0.0:1789263847.900215:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888696704 00000100:00100000:0.0:1789263847.900258:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 113 00000100:00100000:0.0:1789263847.900267:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989afe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+55:15802:x1876178888696704:12345-192.168.203.20@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789263847.901329:0:17172:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934657 is committed 00000004:00080000:3.0:1789263847.901337:0:17172:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:2.0:1789263847.901360:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981682200/0xce1582440fb1f295 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789263847.901368:0:17172:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00010000:00010000:2.0:1789263847.901369:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981682200/0xce1582440fb1f295 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.901376:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981682200/0xce1582440fb1f295 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.901382:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981682200 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263847.901390:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981682200/0xce1582440fb1f295 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1789263847.901397:0:17172:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9dd8826166c0 refcount 2 committed 0 result 0 batchid 4294967517 00010000:00010000:2.0:1789263847.901400:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981682200/0xce1582440fb1f295 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1789263847.901402:0:17172:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9dd9ab833f00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9dd983164480 00000020:00080000:3.0:1789263847.901410:0:17172:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9dd9ab833700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9dd882bedc00 00010000:00010000:2.0:1789263847.901431:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9dd9bb595500) 00010000:00010000:2.0:1789263847.901435:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789263847.901440:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981682200/0xce1582440fb1f295 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.901447:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981682200/0xce1582440fb1f295 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263847.901456:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8838f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898144768:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1789263847.901471:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51400/0xce1582440fb1f328 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.901490:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51400/0xce1582440fb1f328 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.901496:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51400/0xce1582440fb1f328 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263847.901502:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789263847.901511:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd987f51400 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263847.901515:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51400/0xce1582440fb1f328 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.901521:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51400/0xce1582440fb1f328 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263847.901524:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989afe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+21:15802:x1876178888696704:12345-192.168.203.20@tcp:44:lhsmtool_posix.0 Request processed in 1257us (1395us total) trans 0 rc 0/0 00010000:00010000:2.0:1789263847.901532:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dd882850d00) 00000100:00100000:0.0:1789263847.901532:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 113 00010000:00010000:2.0:1789263847.901535:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789263847.901538:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51400/0xce1582440fb1f328 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263847.901539:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1789263847.901548:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51400/0xce1582440fb1f328 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263847.901549:0:19981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898144768 00000100:00100000:1.0:1789263847.901549:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898144896:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789263847.901555:0:19981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898144768 00000100:00100000:1.0:1789263847.901575:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789263847.901576:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1f3a6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.901584:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1f3a6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789263847.901587:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789263847.901591:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1f3a6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.901597:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981531600 already unused, calling callback (ffffffffc18c14f0) 00000100:00100000:3.0:1789263847.901599:0:19981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898144896 00000100:00100000:3.0:1789263847.901602:0:19981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898144896 00010000:00010000:2.0:1789263847.901608:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1f3a6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263847.901609:0:18696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00010000:00010000:2.0:1789263847.901619:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1f3a6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263847.901621:0:18696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8838f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1876178898144768:12345-0@lo:2:osp-syn-0-0.0 00000100:00080000:0.0:1789263847.901626:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789263847.901630:0:19981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00010000:00010000:2.0:1789263847.901636:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9dd9bb595900) 00000100:00100000:3.0:1789263847.901641:0:19981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8838f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3620:x1876178898144896:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1789263847.901642:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000020:00080000:0.0:1789263847.901645:0:17231:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967517 committed batchid 8 00010000:00010000:2.0:1789263847.901648:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1f3a6 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.901653:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531600/0xce1582440fb1f3a6 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1789263847.901659:0:19981:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:34 count 1 00010000:00010000:2.0:1789263847.901667:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51e00/0xce1582440fb1f3c9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.901685:0:19981:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fce086e6/0xce1582440fb1f512 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.901685:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51e00/0xce1582440fb1f3c9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.901698:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51e00/0xce1582440fb1f3c9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789263847.901699:0:17231:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:2.0:1789263847.901706:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd987f51e00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263847.901709:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51e00/0xce1582440fb1f3c9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.901713:0:19981:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005dc3a247/0xce1582440fb1f336 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1226c expref: 7 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789263847.901719:0:18696:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 13 00010000:00010000:2.0:1789263847.901722:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51e00/0xce1582440fb1f3c9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789263847.901726:0:18696:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1789263848 00002000:00010000:1.0:1789263847.901733:0:18696:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789263847.901739:0:18696:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1789263848 -> 1789263848 00010000:00010000:3.0:1789263847.901741:0:19981:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789263847.901742:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9dd9bb595900) 00002000:00010000:1.0:1789263847.901743:0:18696:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1789263847.901750:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789263847.901752:0:19981:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789263847.901758:0:19981:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fce086e6/0xce1582440fb1f512 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.901772:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51e00/0xce1582440fb1f3c9 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.901779:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51e00/0xce1582440fb1f3c9 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.901788:0:19981:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005dc3a247/0xce1582440fb1f336 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1226c expref: 7 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263847.901792:0:18696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8838f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3620:x1876178898144768:12345-0@lo:2:osp-syn-0-0.0 Request processed in 171us (288us total) trans 8589934598 rc 0/0 00010000:00010000:2.0:1789263847.901796:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22a00/0xce1582440fb1f42b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263847.901807:0:3620:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934595 gen 2 00010000:00010000:2.0:1789263847.901809:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22a00/0xce1582440fb1f42b lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263847.901809:0:18696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:2.0:1789263847.901818:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22a00/0xce1582440fb1f42b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263847.901824:0:3620:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9dd8838f2d80 x1876178898144768/t8589934598(8589934598) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1789263863 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1789263847.901825:0:19981:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005dc3a247/0xce1582440fb1f336 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1226c expref: 7 pid: 19302 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.901826:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bfa22a00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263847.901830:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22a00/0xce1582440fb1f42b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.901838:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22a00/0xce1582440fb1f42b lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789263847.901838:0:3620:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9dd8838f2d80/2, rc 0, transno 8589934598 00000100:00100000:0.0:1789263847.901844:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8838f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898144768:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1789263847.901847:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9dd9bb585c00) 00010000:00010000:2.0:1789263847.901850:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789263847.901853:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22a00/0xce1582440fb1f42b lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.901859:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22a00/0xce1582440fb1f42b lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.901869:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f4e8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.901893:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f4e8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.901901:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f4e8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263847.901903:0:19981:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88297ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:19981:1876178898145024:192.168.203.20@tcp:104: 00010000:00010000:2.0:1789263847.901913:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd987f51600 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263847.901916:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f4e8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.901928:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f4e8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.901938:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9dd883cc7400) 00010000:00010000:2.0:1789263847.901940:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789263847.901943:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f4e8 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.901950:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f4e8 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263847.901980:0:19981:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd883e68180 going to sleep for 11 seconds 00000100:00100000:2.0:1789263847.903128:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263847.903194:0:19302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888696832 00000100:00100000:0.0:1789263847.903205:0:19302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888696832 00000100:00100000:0.0:1789263847.903244:0:19302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 35 00000100:00100000:0.0:1789263847.903254:0:19302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+9:2397:x1876178888696832:12345-192.168.203.20@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1789263847.903280:0:19981:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88297ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:19981:1876178898145024:192.168.203.20@tcp:104: 00010000:00010000:3.0:1789263847.903301:0:19981:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fce086e6/0xce1582440fb1f512 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263847.903645:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263847.903700:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888696960 00000100:00100000:1.0:1789263847.903705:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888696960 00010000:00010000:1.0:1789263847.903748:0:17178:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005dc3a247/0xce1582440fb1f336 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1226c expref: 8 pid: 19302 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263847.903792:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 35 00000100:00100000:1.0:1789263847.903802:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88397fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+8:2398:x1876178888696960:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789263847.903813:0:17178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789263847.903818:0:17178:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005dc3a247/0xce1582440fb1f336 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1226c expref: 8 pid: 19302 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263847.903839:0:17178:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005dc3a247/0xce1582440fb1f336 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1226c expref: 8 pid: 19302 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263847.903859:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005dc3a247/0xce1582440fb1f336 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1226c expref: 8 pid: 19302 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263847.903872:0:17178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789263847.903877:0:17178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789263847.903883:0:17178:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fce086e6/0xce1582440fb1f512 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263847.903892:0:17178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fce086e6/0xce1582440fb1f512 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263847.903917:0:17178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789263847.903959:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88397fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+7:2398:x1876178888696960:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 159us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263847.903967:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 35 00010000:00010000:2.0:1789263847.903995:0:19981:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fce086e6/0xce1582440fb1f512 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.904007:0:19981:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fce086e6/0xce1582440fb1f512 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.904018:0:19981:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fce086e6/0xce1582440fb1f512 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789263847.904023:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789263847.904044:0:19981:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fce086e6/0xce1582440fb1f512 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.904122:0:19981:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789263847.904167:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263847.904174:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fce086e6/0xce1582440fb1f512 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263847.904181:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981530a00 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263847.904186:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fce086e6/0xce1582440fb1f512 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263847.904195:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fce086e6/0xce1582440fb1f512 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263847.904207:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fce086e6/0xce1582440fb1f512 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263847.904214:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fce086e6/0xce1582440fb1f512 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263847.904308:0:19981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8838f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3620:x1876178898144896:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2670us (2731us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1789263847.904316:0:19981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:1.0:1789263847.904369:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263847.904372:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263847.904375:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789263847.904583:0:3620:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9dd88397f480/2, rc 0, transno 8589934601 00000100:00100000:0.0:1789263847.904591:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898144896:0@lo:6:osp-syn-1-0.0 00000001:00080000:2.0:1789263847.905075:0:18693:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00000001:00080000:2.0:1789263847.905101:0:18693:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00000100:00100000:0.0:1789263847.905213:0:19302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+6:2397:x1876178888696832:12345-192.168.203.20@tcp:16:lhsmtool_posix.0 Request processed in 1959us (2086us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263847.905232:0:19302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 35 00000100:00100000:0.0:1789263847.906364:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263847.906409:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888697216 00000100:00100000:2.0:1789263847.906417:0:18722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888697216 00000100:00100000:2.0:1789263847.906464:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 114 00000100:00100000:2.0:1789263847.906473:0:18722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88397e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+16:15802:x1876178888697216:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789263847.906522:0:18722:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789263847.906541:0:18722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3e00/0xce1582440fb1f4fd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122e3 expref: 16 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.906552:0:18722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9dd883cc7400) 00010000:00010000:2.0:1789263847.906555:0:18722:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789263847.906579:0:18722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23200/0xce1582440fb1f519 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.906591:0:18722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23200/0xce1582440fb1f519 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.906600:0:18722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23200/0xce1582440fb1f519 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789263847.906726:0:18722:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000141e65d3 reply state 00000000762cbab2 transno 8589934658 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23200/0xce1582440fb1f519 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.906738:0:18722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23200/0xce1582440fb1f519 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.906744:0:18722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9dd883cc7400) 00010000:00010000:2.0:1789263847.906746:0:18722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789263847.906747:0:18722:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789263847.906808:0:18722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88397e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+17:15802:x1876178888697216:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 Request processed in 337us (450us total) trans 8589934658 rc 0/0 00000100:00100000:2.0:1789263847.906813:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 114 00000100:00100000:2.0:1789263847.907952:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263847.908007:0:18699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888697344 00000100:00100000:1.0:1789263847.908015:0:18699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888697344 00000100:00100000:1.0:1789263847.908057:0:18699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 36 00000100:00100000:1.0:1789263847.908066:0:18699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+6:2397:x1876178888697344:12345-192.168.203.20@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789263847.908215:0:18699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1789263847.908219:0:18699:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 1789263848 -> 1789263847 00002000:00010000:1.0:1789263847.908221:0:18699:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 1789263847 00002000:00010000:1.0:1789263847.908231:0:18699:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1789263848 -> 1789263847 00002000:00010000:1.0:1789263847.908233:0:18699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1789263847.908281:0:18699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+7:2397:x1876178888697344:12345-192.168.203.20@tcp:2:lhsmtool_posix.0 Request processed in 215us (330us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1789263847.908288:0:18699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 36 00000100:00100000:0.0:1789263847.909230:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263847.909278:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888697600 00000100:00100000:1.0:1789263847.909283:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888697600 00000100:00100000:1.0:1789263847.909322:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 115 00000100:00100000:1.0:1789263847.909330:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88397e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+17:15802:x1876178888697600:12345-192.168.203.20@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1789263847.909373:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3c00/0xce1582440fb1f520 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263847.909388:0:17191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2000/0xce1582440fb1f4e1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122d5 expref: 17 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263847.909397:0:17191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3c00/0xce1582440fb1f520 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263847.909429:0:17191:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2000/0xce1582440fb1f4e1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122d5 expref: 17 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263847.909456:0:17191:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2000/0xce1582440fb1f4e1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122d5 expref: 17 pid: 17191 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263847.909468:0:17191:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8838f1500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17191:1876178898145152:192.168.203.20@tcp:104: 00000100:00100000:1.0:1789263847.909536:0:17191:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd881f31480 going to sleep for 11 seconds 00000100:00100000:1.0:1789263847.911346:0:17191:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8838f1500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17191:1876178898145152:192.168.203.20@tcp:104: 00000100:00100000:2.0:1789263847.911347:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00010000:00010000:1.0:1789263847.911381:0:17191:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3c00/0xce1582440fb1f520 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263847.911446:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888697728 00000100:00100000:3.0:1789263847.911453:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888697728 00010000:00010000:3.0:1789263847.911481:0:17179:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2000/0xce1582440fb1f4e1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122d5 expref: 18 pid: 17191 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263847.911514:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 36 00000100:00100000:3.0:1789263847.911522:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa72300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+18:2398:x1876178888697728:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789263847.911539:0:17179:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789263847.911545:0:17179:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2000/0xce1582440fb1f4e1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122d5 expref: 18 pid: 17191 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.911565:0:17179:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2000/0xce1582440fb1f4e1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122d5 expref: 18 pid: 17191 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.911584:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2000/0xce1582440fb1f4e1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122d5 expref: 18 pid: 17191 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.911598:0:17179:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9dd883cc7400) 00010000:00010000:3.0:1789263847.911602:0:17179:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3c00/0xce1582440fb1f520 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.911621:0:17179:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3c00/0xce1582440fb1f520 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.911628:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3c00/0xce1582440fb1f520 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.911650:0:17179:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789263847.911672:0:17191:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3c00/0xce1582440fb1f520 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263847.911686:0:17191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3c00/0xce1582440fb1f520 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263847.911708:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa72300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+17:2398:x1876178888697728:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 185us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263847.911716:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 36 00010000:00010000:1.0:1789263847.911725:0:17191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3c00/0xce1582440fb1f520 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263847.911734:0:17191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3c00/0xce1582440fb1f520 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263847.911741:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3c00/0xce1582440fb1f520 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263847.911748:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd8841a3c00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263847.911752:0:17191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3c00/0xce1582440fb1f520 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263847.911760:0:17191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3c00/0xce1582440fb1f520 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263847.911770:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9dd883cc7400) 00010000:00010000:1.0:1789263847.911773:0:17191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1789263847.911776:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3c00/0xce1582440fb1f520 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263847.911781:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3c00/0xce1582440fb1f520 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263847.911834:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88397e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+16:15802:x1876178888697600:12345-192.168.203.20@tcp:55:lhsmtool_posix.0 Request processed in 2504us (2605us total) trans 0 rc -22/-22 00000100:00100000:1.0:1789263847.911842:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 115 00000100:00100000:2.0:1789263847.913056:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263847.913118:0:18696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888697856 00000100:00100000:1.0:1789263847.913125:0:18696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888697856 00000100:00100000:1.0:1789263847.913179:0:18696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 37 00000100:00100000:1.0:1789263847.913188:0:18696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+7:2397:x1876178888697856:12345-192.168.203.20@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789263847.913223:0:18696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f5e2071d/0xce1582440fb1f527 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263847.913246:0:18696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006e4ff603/0xce1582440fb1f50b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122f1 expref: 7 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263847.913253:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789263847.913257:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789263847.913261:0:18696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5e2071d/0xce1582440fb1f527 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263847.913288:0:18696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006e4ff603/0xce1582440fb1f50b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122f1 expref: 7 pid: 19302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263847.913308:0:18696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006e4ff603/0xce1582440fb1f50b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122f1 expref: 7 pid: 19302 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263847.913321:0:18696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8838f1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:18696:1876178898145280:192.168.203.20@tcp:104: 00000100:00100000:1.0:1789263847.913392:0:18696:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd881f31480 going to sleep for 11 seconds 00000100:00100000:1.0:1789263847.915266:0:18696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8838f1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:18696:1876178898145280:192.168.203.20@tcp:104: 00010000:00010000:1.0:1789263847.915302:0:18696:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f5e2071d/0xce1582440fb1f527 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263847.915372:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263847.915420:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888697984 00000100:00100000:2.0:1789263847.915427:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888697984 00010000:00010000:2.0:1789263847.915459:0:17177:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006e4ff603/0xce1582440fb1f50b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122f1 expref: 8 pid: 19302 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263847.915507:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 37 00000100:00100000:2.0:1789263847.915517:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa60050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+8:2397:x1876178888697984:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789263847.915529:0:17177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789263847.915550:0:17177:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006e4ff603/0xce1582440fb1f50b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122f1 expref: 8 pid: 19302 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.915569:0:17177:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006e4ff603/0xce1582440fb1f50b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122f1 expref: 8 pid: 19302 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.915596:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e4ff603/0xce1582440fb1f50b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122f1 expref: 8 pid: 19302 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.915607:0:17177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789263847.915610:0:17177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789263847.915616:0:17177:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f5e2071d/0xce1582440fb1f527 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.915625:0:17177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5e2071d/0xce1582440fb1f527 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.915656:0:17177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789263847.915672:0:18696:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f5e2071d/0xce1582440fb1f527 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.915683:0:18696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f5e2071d/0xce1582440fb1f527 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.915699:0:18696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f5e2071d/0xce1582440fb1f527 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.915707:0:18696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f5e2071d/0xce1582440fb1f527 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263847.915709:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa60050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+7:2397:x1876178888697984:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 189us (337us total) trans 0 rc 0/0 00010000:00010000:3.0:1789263847.915719:0:18696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f5e2071d/0xce1582440fb1f527 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263847.915725:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 37 00010000:00010000:3.0:1789263847.915731:0:18696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd8841a3000 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:3.0:1789263847.915738:0:18696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5e2071d/0xce1582440fb1f527 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.915760:0:18696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5e2071d/0xce1582440fb1f527 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.915775:0:18696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f5e2071d/0xce1582440fb1f527 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.915784:0:18696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5e2071d/0xce1582440fb1f527 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263847.915844:0:18696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+6:2397:x1876178888697856:12345-192.168.203.20@tcp:1:lhsmtool_posix.0 Request processed in 2657us (2791us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263847.915852:0:18696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 37 00000100:00100000:2.0:1789263847.917241:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263847.917284:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888698240 00000100:00100000:3.0:1789263847.917290:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888698240 00000100:00100000:3.0:1789263847.917323:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 116 00000100:00100000:3.0:1789263847.917328:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+16:15802:x1876178888698240:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789263847.917399:0:17193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1f52e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.917414:0:17193:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50e00/0xce1582440fb1f424 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1229d expref: 16 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.917422:0:17193:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1f52e lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.917451:0:17193:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50e00/0xce1582440fb1f424 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1229d expref: 16 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.917482:0:17193:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50e00/0xce1582440fb1f424 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1229d expref: 16 pid: 17191 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263847.917507:0:17193:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88297ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17193:1876178898145408:192.168.203.20@tcp:104: 00000100:00100000:3.0:1789263847.917566:0:17193:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd883e68180 going to sleep for 11 seconds 00000100:00100000:2.0:1789263847.918983:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263847.919046:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888698368 00000100:00100000:0.0:1789263847.919053:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888698368 00010000:00010000:0.0:1789263847.919102:0:17179:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50e00/0xce1582440fb1f424 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1229d expref: 17 pid: 17191 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263847.919130:0:17193:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88297ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17193:1876178898145408:192.168.203.20@tcp:104: 00000100:00100000:0.0:1789263847.919154:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 38 00010000:00010000:3.0:1789263847.919167:0:17193:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1f52e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263847.919178:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa73480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+17:2397:x1876178888698368:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789263847.919190:0:17179:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789263847.919197:0:17179:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50e00/0xce1582440fb1f424 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1229d expref: 17 pid: 17191 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.919218:0:17179:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50e00/0xce1582440fb1f424 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1229d expref: 17 pid: 17191 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.919239:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50e00/0xce1582440fb1f424 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1229d expref: 17 pid: 17191 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.919254:0:17179:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9dd9bb585c00) 00010000:00010000:0.0:1789263847.919259:0:17179:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51000/0xce1582440fb1f486 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122c0 expref: 16 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.919267:0:17179:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1f52e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.919272:0:17179:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1f52e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.919277:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1f52e lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.919296:0:17179:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789263847.919317:0:17193:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1f52e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.919325:0:17193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1f52e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263847.919339:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa73480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+16:2397:x1876178888698368:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 167us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263847.919352:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 38 00010000:00010000:3.0:1789263847.919565:0:17193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531c00/0xce1582440fb1f535 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.919575:0:17193:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f4ef lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122dc expref: 16 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.919583:0:17193:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531c00/0xce1582440fb1f535 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.919613:0:17193:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f4ef lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122dc expref: 16 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.919627:0:17193:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f4ef lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122dc expref: 16 pid: 17192 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263847.919644:0:17193:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88297ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17193:1876178898145536:192.168.203.20@tcp:104: 00000100:00100000:3.0:1789263847.919702:0:17193:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd882616b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789263847.921544:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263847.921685:0:17193:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88297ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17193:1876178898145536:192.168.203.20@tcp:104: 00010000:00010000:3.0:1789263847.921719:0:17193:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531c00/0xce1582440fb1f535 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263847.921795:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888698496 00000100:00100000:0.0:1789263847.921804:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888698496 00010000:00010000:0.0:1789263847.921844:0:17177:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f4ef lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122dc expref: 17 pid: 17192 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263847.921889:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 39 00000100:00100000:0.0:1789263847.921899:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa72d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+17:2397:x1876178888698496:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789263847.921915:0:17177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789263847.921922:0:17177:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f4ef lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122dc expref: 17 pid: 17192 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.921951:0:17177:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f4ef lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122dc expref: 17 pid: 17192 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.921976:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50000/0xce1582440fb1f4ef lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122dc expref: 17 pid: 17192 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.921992:0:17177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9dd883cc7400) 00010000:00010000:0.0:1789263847.921998:0:17177:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531c00/0xce1582440fb1f535 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.922008:0:17177:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531c00/0xce1582440fb1f535 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.922016:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531c00/0xce1582440fb1f535 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263847.922113:0:17177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789263847.922179:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa72d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+16:2397:x1876178888698496:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 280us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263847.922187:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 39 00010000:00010000:3.0:1789263847.922417:0:17193:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531c00/0xce1582440fb1f535 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.922426:0:17193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531c00/0xce1582440fb1f535 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789263847.922612:0:17193:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934659 00000001:00080000:3.0:1789263847.922736:0:17193:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934660 00000001:00080000:3.0:1789263847.922784:0:17193:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934661 00000100:00100000:3.0:1789263847.922867:0:17193:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88297ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17193:1876178898145664:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789263847.922921:0:17193:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263847.922960:0:17193:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd883e68180 going to sleep for 11 seconds 00000100:00100000:1.0:1789263847.922973:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898145664 00000100:00100000:1.0:1789263847.922980:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898145664 00000100:00100000:1.0:1789263847.923030:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789263847.923039:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:17193:x1876178898145664:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789263847.923243:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:17193:x1876178898145664:12345-0@lo:1000:mdt00_002.0 Request processed in 205us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263847.923251:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789263847.923275:0:17193:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:3.0:1789263847.923282:0:17193:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9dd8838f2d80, transno 8589934598 00000100:00100000:3.0:1789263847.923293:0:17193:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88297ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17193:1876178898145664:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1789263847.923488:0:17193:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934662 00000100:00100000:3.0:1789263847.923525:0:17193:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88297ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17193:1876178898145792:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789263847.923554:0:17193:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263847.923576:0:17193:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd8826163c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789263847.923622:0:18524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898145792 00000100:00100000:2.0:1789263847.923637:0:18524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898145792 00000100:00100000:2.0:1789263847.923705:0:18524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789263847.923717:0:18524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:17193:x1876178898145792:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789263847.923916:0:18524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17193:x1876178898145792:12345-0@lo:1000:mdt00_002.0 Request processed in 201us (359us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1789263847.923929:0:18524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789263847.923951:0:17193:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88297ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17193:1876178898145792:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1789263847.924003:0:17193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531c00/0xce1582440fb1f535 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.924013:0:17193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531c00/0xce1582440fb1f535 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.924020:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531c00/0xce1582440fb1f535 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.924026:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981531c00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263847.924031:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531c00/0xce1582440fb1f535 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.924039:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531c00/0xce1582440fb1f535 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.924053:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9dd883cc7400) 00010000:00010000:3.0:1789263847.924056:0:17193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789263847.924060:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531c00/0xce1582440fb1f535 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.924066:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531c00/0xce1582440fb1f535 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.924126:0:17193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50c00/0xce1582440fb1f47f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.924133:0:17193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50c00/0xce1582440fb1f47f lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.924139:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50c00/0xce1582440fb1f47f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.924153:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd987f50c00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263847.924170:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50c00/0xce1582440fb1f47f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.924179:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50c00/0xce1582440fb1f47f lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.924189:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9dd9bb585c00) 00010000:00010000:3.0:1789263847.924191:0:17193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789263847.924198:0:17193:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51000/0xce1582440fb1f486 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122c0 expref: 19 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.924209:0:17193:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51000/0xce1582440fb1f486 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122c0 expref: 19 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.924217:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51000/0xce1582440fb1f486 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122c0 expref: 19 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.924248:0:17193:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51000/0xce1582440fb1f486 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122c0 expref: 19 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263847.924259:0:17193:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989ae0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17193:1876178898145920:192.168.203.20@tcp:105: 00000100:00100000:3.0:1789263847.924327:0:17193:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd98735a240 going to sleep for 11 seconds 00000100:00100000:3.0:1789263847.926224:0:17193:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989ae0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17193:1876178898145920:192.168.203.20@tcp:105: 00010000:00010000:3.0:1789263847.926262:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50c00/0xce1582440fb1f47f lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.926413:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50c00/0xce1582440fb1f47f lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.926475:0:17193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1f53c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263847.926484:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00010000:00010000:3.0:1789263847.926497:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1f53c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.926510:0:17193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1f53c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.926522:0:17193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1f53c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.926529:0:17193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1f53c lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.926536:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1f53c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.926578:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981530600 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263847.926581:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1f53c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.926586:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1f53c lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.926595:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9dd9bb585c00) 00010000:00010000:3.0:1789263847.926597:0:17193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789263847.926600:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1f53c lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.926608:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530600/0xce1582440fb1f53c lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.926616:0:17193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1f52e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.926620:0:17193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1f52e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.926623:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1f52e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.926626:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981531a00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263847.926628:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1f52e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.926631:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1f52e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.926637:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9dd9bb585c00) 00010000:00010000:3.0:1789263847.926639:0:17193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789263847.926641:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1f52e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.926646:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1f52e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263847.926903:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888698624 00000100:00100000:0.0:1789263847.926916:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888698624 00000100:00100000:2.0:1789263847.926937:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+20:15802:x1876178888698240:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 Request processed in 9602us (9695us total) trans 8589934663 rc 0/0 00000100:00100000:2.0:1789263847.926955:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 116 00000020:00080000:2.0:1789263847.926963:0:17193:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1789263847.926981:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 22 00000100:00100000:0.0:1789263847.926993:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9c0ae7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+20:15801:x1876178888698624:12345-192.168.203.20@tcp:49:lfs.0 00000040:00080000:3.0:1789263847.927008:0:17227:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789263847.927014:0:17227:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789263847.927037:0:17227:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:3.0:1789263847.927045:0:17227:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1789263847.927143:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9c0ae7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+19:15801:x1876178888698624:12345-192.168.203.20@tcp:49:lfs.0 Request processed in 151us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263847.927154:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 22 00000100:00100000:2.0:1789263847.928710:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263847.928771:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888698880 00000100:00100000:3.0:1789263847.928777:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888698880 00000100:00100000:3.0:1789263847.928811:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 23 00000100:00100000:3.0:1789263847.928818:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+19:15802:x1876178888698880:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789263847.929036:0:17194:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789263847.929473:0:17194:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934664 00010000:00010000:3.0:1789263847.929504:0:17194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531200/0xce1582440fb1f543 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.929518:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531200/0xce1582440fb1f543 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.929529:0:17194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531200/0xce1582440fb1f543 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.929537:0:17194:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531200/0xce1582440fb1f543 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.929543:0:17194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531200/0xce1582440fb1f543 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.929549:0:17194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531200/0xce1582440fb1f543 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263847.929571:0:17194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789263847.929681:0:17944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263847.929694:0:17944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531200/0xce1582440fb1f543 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263847.929704:0:17944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981531200 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263847.929708:0:17944:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531200/0xce1582440fb1f543 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263847.929718:0:17944:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531200/0xce1582440fb1f543 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263847.929735:0:17944:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9dd883cc7400) 00010000:00010000:1.0:1789263847.929738:0:17944:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789263847.929743:0:17944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531200/0xce1582440fb1f543 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263847.929749:0:17944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531200/0xce1582440fb1f543 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263847.929784:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263847.929786:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263847.929787:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789263847.929940:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+21:15802:x1876178888698880:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 Request processed in 1118us (1229us total) trans 8589934665 rc 0/0 00000100:00100000:3.0:1789263847.929950:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 23 00000020:00080000:3.0:1789263847.929955:0:17194:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789263847.930257:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263847.930375:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888699136 00000100:00100000:0.0:1789263847.930380:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888699136 00000100:00100000:0.0:1789263847.930414:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 117 00000100:00100000:0.0:1789263847.930421:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+21:15801:x1876178888699136:12345-192.168.203.20@tcp:58:lfs.0 00000040:00080000:0.0:1789263847.930523:0:17192:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].3, 136 off8600 00000100:00100000:0.0:1789263847.930570:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+21:15801:x1876178888699136:12345-192.168.203.20@tcp:58:lfs.0 Request processed in 149us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263847.930578:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 117 00000100:00100000:1.0:1789263847.945028:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263847.945116:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888699264 00000100:00100000:2.0:1789263847.945127:0:18722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888699264 00000100:00100000:2.0:1789263847.945205:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 118 00000100:00100000:2.0:1789263847.945217:0:18722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8838f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+21:15804:x1876178888699264:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:2.0:1789263847.945239:0:18722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263847.945257:0:18722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22c00/0xce1582440fb1f54a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d122f8 expref: -99 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.945316:0:18722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22000/0xce1582440fb1f551 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.945329:0:18722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22000/0xce1582440fb1f551 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.945341:0:18722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22000/0xce1582440fb1f551 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.945355:0:18722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22800/0xce1582440fb1f558 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.945364:0:18722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22800/0xce1582440fb1f558 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.945371:0:18722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22800/0xce1582440fb1f558 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.945446:0:18722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23c00/0xce1582440fb1f55f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.945457:0:18722:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23e00/0xce1582440fb1f471 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122b9 expref: 22 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.945465:0:18722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23c00/0xce1582440fb1f55f lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.945490:0:18722:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23e00/0xce1582440fb1f471 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122b9 expref: 22 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.945519:0:18722:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23e00/0xce1582440fb1f471 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122b9 expref: 22 pid: 17193 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263847.945533:0:18722:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa71c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18722:1876178898146048:192.168.203.20@tcp:104: 00000100:00100000:2.0:1789263847.945606:0:18722:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd98ff20a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789263847.946575:0:18722:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa71c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18722:1876178898146048:192.168.203.20@tcp:104: 00010000:00010000:2.0:1789263847.946591:0:18722:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23c00/0xce1582440fb1f55f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263847.946816:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263847.946895:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888699520 00000100:00100000:0.0:1789263847.946900:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888699520 00000100:00100000:0.0:1789263847.946932:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 24 00000100:00100000:0.0:1789263847.946940:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8838f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+23:14879:x1876178888699520:12345-192.168.203.20@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789263847.947128:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8838f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+24:14879:x1876178888699520:12345-192.168.203.20@tcp:35:ldlm_bl.0 Request processed in 187us (311us total) trans 8589934666 rc 0/0 00000100:00100000:0.0:1789263847.947148:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 24 00000100:00100000:3.0:1789263847.948315:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263847.948418:0:18344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888699648 00000100:00100000:1.0:1789263847.948424:0:18344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888699648 00010000:00010000:1.0:1789263847.948449:0:18344:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23e00/0xce1582440fb1f471 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122b9 expref: 24 pid: 17193 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263847.948488:0:18344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 40 00000100:00100000:1.0:1789263847.948497:0:18344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989ae0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+24:2398:x1876178888699648:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789263847.948507:0:18344:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789263847.948514:0:18344:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23e00/0xce1582440fb1f471 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122b9 expref: 24 pid: 17193 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263847.948536:0:18344:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23e00/0xce1582440fb1f471 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122b9 expref: 24 pid: 17193 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263847.948554:0:18344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23e00/0xce1582440fb1f471 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122b9 expref: 24 pid: 17193 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263847.948564:0:18344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9dd9bb585c00) 00010000:00010000:1.0:1789263847.948567:0:18344:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23c00/0xce1582440fb1f55f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263847.948573:0:18344:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23c00/0xce1582440fb1f55f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263847.948592:0:18344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23c00/0xce1582440fb1f55f lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263847.948609:0:18344:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789263847.948645:0:18722:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23c00/0xce1582440fb1f55f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263847.948654:0:18344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989ae0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+23:2398:x1876178888699648:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 156us (341us total) trans 0 rc 0/0 00010000:00010000:2.0:1789263847.948657:0:18722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23c00/0xce1582440fb1f55f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263847.948667:0:18344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 40 00000004:00200000:2.0:1789263847.948708:0:18722:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789263847.948719:0:18722:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789263847.948747:0:18722:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23c00/0xce1582440fb1f55f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.948761:0:18722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23c00/0xce1582440fb1f55f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.948770:0:18722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22000/0xce1582440fb1f551 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.948777:0:18722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22000/0xce1582440fb1f551 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.948784:0:18722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22000/0xce1582440fb1f551 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.948790:0:18722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bfa22000 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263847.948794:0:18722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22000/0xce1582440fb1f551 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.948802:0:18722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22000/0xce1582440fb1f551 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.948821:0:18722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9dd9bb595c00) 00010000:00010000:2.0:1789263847.948825:0:18722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789263847.948829:0:18722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22000/0xce1582440fb1f551 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.948835:0:18722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22000/0xce1582440fb1f551 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.948847:0:18722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22800/0xce1582440fb1f558 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.948863:0:18722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22800/0xce1582440fb1f558 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.948870:0:18722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22800/0xce1582440fb1f558 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.948876:0:18722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bfa22800 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263847.948879:0:18722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22800/0xce1582440fb1f558 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.948886:0:18722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22800/0xce1582440fb1f558 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.948896:0:18722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9dd882850d00) 00010000:00010000:2.0:1789263847.948900:0:18722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789263847.948903:0:18722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22800/0xce1582440fb1f558 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.948909:0:18722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22800/0xce1582440fb1f558 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.948938:0:18722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22c00/0xce1582440fb1f54a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122f8 expref: 23 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.948950:0:18722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23c00/0xce1582440fb1f55f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122f8 expref: 22 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263847.948956:0:18722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9dd9bb585c00) 00010000:00010000:2.0:1789263847.948958:0:18722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789263847.948966:0:18722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bfa23c00, rc 0) 00000100:00100000:2.0:1789263847.949002:0:18722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8838f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+22:15804:x1876178888699264:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 3789us (3983us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263847.949009:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 118 00000040:00080000:1.0:1789263848.284741:0:20471:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789263848.284751:0:20471:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789263848.284792:0:20471:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 4 count 4 00000040:00080000:1.0:1789263848.284801:0:20471:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1789263848.493347:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789263848.493367:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8838f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876178898146304:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789263848.493437:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263848.493446:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8838f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de026c8f-6636-4fc7-8061-42c8092f00f0:3620:1876178898146432:0@lo:400:kworker.0 00000100:00100000:2.0:1789263848.493475:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876178898146176:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789263848.493528:0:18701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898146304 00000100:00100000:3.0:1789263848.493550:0:18701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898146304 00000100:00100000:1.0:1789263848.493596:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8838f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898146560:0@lo:400:kworker.0 00000100:00100000:3.0:1789263848.493604:0:18701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789263848.493615:0:18701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3619:x1876178898146304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789263848.493654:0:18701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789263848.493673:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263848.493705:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8838f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898146816:0@lo:400:kworker.0 00000100:00100000:3.0:1789263848.493707:0:18701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3619:x1876178898146304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263848.493718:0:18701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789263848.493735:0:18701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898146176 00000100:00100000:3.0:1789263848.493738:0:18701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898146176 00000100:00100000:2.0:1789263848.493743:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263848.493759:0:18701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789263848.493766:0:18701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1876178898146176:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789263848.493769:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8838f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1876178898147328:0@lo:400:kworker.0 00002000:00000024:3.0:1789263848.493782:0:18701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 0 free 3923505152 avail 3691954176 00000100:00100000:0.0:1789263848.493787:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263848.493804:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263848.493831:0:18701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1876178898146176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263848.493837:0:18701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789263848.493840:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8838f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898146944:0@lo:400:kworker.0 00000100:00100000:2.0:1789263848.493859:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8838f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876178898146304:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789263848.493878:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263848.493881:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876178898146176:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789263848.493885:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898146432 00000100:00100000:3.0:1789263848.493890:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898146432 00000100:00100000:2.0:1789263848.493906:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789263848.493909:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8838f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1876178898147456:0@lo:400:kworker.0 00000100:00100000:2.0:1789263848.493913:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8838f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1876178898146688:0@lo:400:kworker.0 00000100:00100000:3.0:1789263848.493921:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789263848.493931:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd990734050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de026c8f-6636-4fc7-8061-42c8092f00f0+24:3620:x1876178898146432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263848.493947:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263848.493980:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263848.493991:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8838f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de026c8f-6636-4fc7-8061-42c8092f00f0:3620:1876178898146432:0@lo:400:kworker.0 00000100:00100000:3.0:1789263848.493993:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd990734050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de026c8f-6636-4fc7-8061-42c8092f00f0+24:3620:x1876178898146432:12345-0@lo:400:kworker.0 Request processed in 61us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263848.494002:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789263848.494008:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8838f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1876178898147200:0@lo:400:kworker.0 00000100:00100000:0.0:1789263848.494023:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898147328 00000100:00100000:0.0:1789263848.494026:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898147328 00000100:00100000:2.0:1789263848.494041:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263848.494057:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898147456 00000100:00100000:3.0:1789263848.494063:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898147456 00000100:00100000:2.0:1789263848.494066:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8838f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1876178898147712:0@lo:400:kworker.0 00000100:00100000:0.0:1789263848.494073:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898146688 00000100:00100000:0.0:1789263848.494101:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898146688 00000100:00100000:3.0:1789263848.494107:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898147200 00000100:00100000:3.0:1789263848.494113:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898147200 00000100:00100000:2.0:1789263848.494121:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263848.494138:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898147712 00000100:00100000:3.0:1789263848.494143:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789263848.494144:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898147712 00000100:00100000:2.0:1789263848.494163:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789263848.494168:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1876178898147328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789263848.494173:0:18722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88397ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1876178898147456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263848.494179:0:17192:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1789263848.494189:0:17192:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:1.0:1789263848.494192:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789263848.494208:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789263848.494213:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789263848.494220:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8838f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898147072:0@lo:400:kworker.0 00000100:00100000:0.0:1789263848.494241:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898146816 00000100:00100000:3.0:1789263848.494242:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1876178898147328:12345-0@lo:400:kworker.0 Request processed in 87us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263848.494244:0:18722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88397ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1876178898147456:12345-0@lo:400:kworker.0 Request processed in 73us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263848.494246:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898146816 00000100:00100000:2.0:1789263848.494258:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789263848.494268:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789263848.494276:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789263848.494280:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898146560 00000100:00100000:2.0:1789263848.494284:0:18722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1876178898146688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263848.494286:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898146560 00000100:00100000:3.0:1789263848.494292:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789263848.494302:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1876178898147200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789263848.494310:0:18722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1876178898146688:12345-0@lo:400:kworker.0 Request processed in 27us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263848.494318:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789263848.494318:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789263848.494333:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1876178898146816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789263848.494338:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263848.494339:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789263848.494345:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1876178898147200:12345-0@lo:400:kworker.0 Request processed in 44us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263848.494349:0:18722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1876178898147712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263848.494358:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789263848.494365:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8838f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3621:1876178898147584:0@lo:400:kworker.0 00000100:00100000:0.0:1789263848.494385:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1876178898146816:12345-0@lo:400:kworker.0 Request processed in 55us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263848.494390:0:19302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898146944 00000100:00100000:2.0:1789263848.494392:0:18722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1876178898147712:12345-0@lo:400:kworker.0 Request processed in 46us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263848.494395:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789263848.494396:0:19302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898146944 00000100:00100000:2.0:1789263848.494401:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789263848.494406:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263848.494440:0:19302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898147072 00000100:00100000:3.0:1789263848.494444:0:19302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898147072 00000100:00100000:1.0:1789263848.494453:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789263848.494463:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8838f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1876178898146560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263848.494473:0:19302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789263848.494481:0:19302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88397f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898146944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789263848.494512:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8838f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1876178898146560:12345-0@lo:400:kworker.0 Request processed in 50us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263848.494520:0:19302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88397f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898146944:12345-0@lo:400:kworker.0 Request processed in 40us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263848.494521:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789263848.494532:0:19302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789263848.494550:0:19302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789263848.494556:0:19302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8838f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1876178898147072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789263848.494580:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8838f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898146560:0@lo:400:kworker.0 00000100:00100000:3.0:1789263848.494587:0:19302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8838f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1876178898147072:12345-0@lo:400:kworker.0 Request processed in 29us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263848.494594:0:19302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789263848.494599:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8838f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898147072:0@lo:400:kworker.0 00000100:00080000:3.0:1789263848.494609:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789263848.494614:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789263848.494623:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898147584 00000100:00100000:3.0:1789263848.494626:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898147584 00000100:00100000:3.0:1789263848.494658:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789263848.494675:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8838f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898146944:0@lo:400:kworker.0 00000100:00100000:3.0:1789263848.494676:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8838f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1876178898147584:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1789263848.494697:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd8838f3b80 x1876178898147456/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263864 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263848.494708:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8838f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1876178898147456:0@lo:400:kworker.0 00000100:00100000:3.0:1789263848.494724:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8838f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1876178898147584:12345-0@lo:400:kworker.0 Request processed in 52us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263848.494731:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789263848.494742:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8838f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3621:1876178898147584:0@lo:400:kworker.0 00000100:00100000:0.0:1789263848.494743:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8838f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1876178898146688:0@lo:400:kworker.0 00000100:00080000:3.0:1789263848.494754:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789263848.494758:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8838f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1876178898147200:0@lo:400:kworker.0 00010000:00080000:0.0:1789263848.494775:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd8838f0700 x1876178898147712/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263864 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263848.494784:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8838f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1876178898147712:0@lo:400:kworker.0 00000100:00100000:0.0:1789263848.494795:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8838f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898146816:0@lo:400:kworker.0 00000100:00100000:0.0:1789263848.494806:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8838f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1876178898147328:0@lo:400:kworker.0 00010000:00010000:0.0:1789263848.749241:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789263848.941422:0:17227:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789263848.941431:0:17227:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789263848.941466:0:17227:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 4 count 4 00000040:00080000:3.0:1789263848.941475:0:17227:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1789263848.941611:0:17227:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989ae0700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17227:1876178898147840:192.168.203.20@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789263848.941702:0:17227:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd98735a300 going to sleep for 11 seconds 00000100:00100000:1.0:1789263848.943789:0:17227:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989ae0700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17227:1876178898147840:192.168.203.20@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789263848.944978:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263848.945137:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888699776 00000100:00100000:3.0:1789263848.945146:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888699776 00000100:00100000:3.0:1789263848.945234:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 119 00000100:00080000:0.0:1789263848.945243:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789263848.945244:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88397fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+22:15817:x1876178888699776:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789263848.945290:0:17193:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789263848.945396:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88397fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+22:15817:x1876178888699776:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 Request processed in 153us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263848.945404:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 119 00000100:00100000:3.0:1789263848.947334:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263848.947515:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888700032 00000100:00100000:1.0:1789263848.947526:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888700032 00000100:00100000:1.0:1789263848.947610:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 120 00000100:00100000:1.0:1789263848.947622:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989ae2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+22:15817:x1876178888700032:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789263848.947647:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263848.947674:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2c00/0xce1582440fb1f566 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d122ff expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263848.947809:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2400/0xce1582440fb1f56d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263848.947828:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2400/0xce1582440fb1f56d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263848.947842:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2400/0xce1582440fb1f56d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789263848.947854:0:17192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00010000:00010000:1.0:1789263848.947982:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2c00/0xce1582440fb1f566 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122ff expref: 25 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263848.948005:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2400/0xce1582440fb1f56d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122ff expref: 24 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263848.948015:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9dd9bb585c00) 00010000:00010000:1.0:1789263848.948018:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789263848.948022:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd8841a2400, rc 0) 00000100:00100000:1.0:1789263848.948190:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989ae2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+24:15817:x1876178888700032:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 569us (865us total) trans 8589934667 rc 0/0 00000100:00100000:1.0:1789263848.948199:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 120 00000100:00100000:2.0:1789263848.950373:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263848.950483:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888700160 00000100:00100000:0.0:1789263848.950493:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888700160 00000100:00100000:3.0:1789263848.950551:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263848.950560:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 4 00000100:00100000:0.0:1789263848.950573:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa73800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+24:2397:x1876178888700160:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789263848.950589:0:17177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789263848.950633:0:20485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888700416 00000100:00100000:2.0:1789263848.950637:0:20485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888700416 00000100:00100000:2.0:1789263848.950668:0:20485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 121 00000100:00100000:2.0:1789263848.950674:0:20485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989ae1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+25:15817:x1876178888700416:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789263848.950737:0:20485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23e00/0xce1582440fb1f57b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263848.950775:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2400/0xce1582440fb1f56d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122ff expref: 25 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263848.950816:0:20485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23e00/0xce1582440fb1f57b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263848.950832:0:20485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23e00/0xce1582440fb1f57b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263848.951027:0:20485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23e00/0xce1582440fb1f57b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263848.951035:0:20485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23e00/0xce1582440fb1f57b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263848.951042:0:20485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23e00/0xce1582440fb1f57b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263848.951048:0:20485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bfa23e00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263848.951052:0:20485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23e00/0xce1582440fb1f57b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263848.951059:0:20485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23e00/0xce1582440fb1f57b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263848.951068:0:20485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9dd9bb585c00) 00010000:00010000:2.0:1789263848.951071:0:20485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789263848.951116:0:20485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23e00/0xce1582440fb1f57b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263848.951124:0:20485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23e00/0xce1582440fb1f57b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263848.951264:0:20485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989ae1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+25:15817:x1876178888700416:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 Request processed in 588us (713us total) trans 8589934668 rc 0/0 00000100:00100000:2.0:1789263848.951271:0:20485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 121 00010000:00010000:0.0:1789263848.951333:0:17177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9dd9bb585c00) 00010000:00010000:0.0:1789263848.951342:0:17177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789263848.951362:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa73800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+24:2397:x1876178888700160:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 793us (997us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263848.951370:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 4 00000040:00080000:1.0:1789263848.951429:0:17227:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789263848.951434:0:17227:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789263848.952059:0:17227:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 4 00000040:00080000:1.0:1789263848.952070:0:17227:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1789263848.952952:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263848.953024:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888700672 00000100:00100000:0.0:1789263848.953032:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888700672 00000100:00100000:0.0:1789263848.953307:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 25 00000100:00100000:0.0:1789263848.953325:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+24:15817:x1876178888700672:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789263848.953520:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+25:15817:x1876178888700672:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 Request processed in 199us (570us total) trans 8589934669 rc 0/0 00000100:00100000:0.0:1789263848.953533:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 25 00000100:00100000:2.0:1789263849.005580:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd8838f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876178898147968:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789263849.005665:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263849.005708:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898148096:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789263849.005723:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898147968 00000100:00100000:0.0:1789263849.005731:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898147968 00000100:00100000:3.0:1789263849.005748:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263849.005786:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789263849.005797:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1876178898147968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789263849.005845:0:17196:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789263849.005894:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1876178898147968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263849.005902:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789263849.005939:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd8838f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876178898147968:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789263849.006703:0:18701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898148096 00000100:00100000:2.0:1789263849.006708:0:18701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898148096 00000100:00100000:2.0:1789263849.006758:0:18701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789263849.006772:0:18701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989ae1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898148096:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789263849.006796:0:18701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 0 free 3923505152 avail 3691954176 00000100:00100000:2.0:1789263849.006856:0:18701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989ae1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898148096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (1108us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263849.006863:0:18701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789263849.007003:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898148096:0@lo:13:osp-pre-0-1.0 00000040:00080000:1.0:1789263849.619423:0:20523:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789263849.619431:0:20523:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789263849.619461:0:20523:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 4 count 4 00000040:00080000:1.0:1789263849.619469:0:20523:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1789263849.684946:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263849.685009:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888700928 00000100:00100000:0.0:1789263849.685021:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888700928 00000100:00100000:0.0:1789263849.685115:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 122 00000100:00100000:0.0:1789263849.685128:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989ae0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+25:15837:x1876178888700928:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:0.0:1789263849.685172:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263849.685199:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51e00/0xce1582440fb1f582 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d12306 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263849.685324:0:17193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f589 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263849.685338:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f589 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263849.685349:0:17193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f589 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789263849.685359:0:17193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00010000:00010000:0.0:1789263849.685484:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51e00/0xce1582440fb1f582 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12306 expref: 28 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263849.685502:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f589 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12306 expref: 27 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263849.685512:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9dd9bb585c00) 00010000:00010000:0.0:1789263849.685516:0:17193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789263849.685519:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd987f51600, rc 0) 00000100:00100000:0.0:1789263849.685585:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989ae0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+27:15837:x1876178888700928:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 459us (650us total) trans 8589934670 rc 0/0 00000100:00100000:0.0:1789263849.685593:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 122 00000100:00100000:3.0:1789263849.687572:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263849.687618:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888701056 00000100:00100000:3.0:1789263849.687629:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888701056 00000100:00100000:3.0:1789263849.687688:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 123 00000100:00100000:3.0:1789263849.687700:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd884acc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+27:15837:x1876178888701056:12345-192.168.203.20@tcp:54:lfs.0 00010000:00010000:3.0:1789263849.687762:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1f597 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263849.687780:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1f597 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263849.687792:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1f597 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263849.687830:0:17192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1f597 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263849.687839:0:17192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1f597 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263849.687847:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1f597 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263849.687856:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981531a00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263849.687862:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1f597 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263849.687870:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1f597 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263849.687883:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9dd9bb585c00) 00010000:00010000:3.0:1789263849.687886:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789263849.687898:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1f597 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263849.687905:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531a00/0xce1582440fb1f597 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263849.687982:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd884acc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+27:15837:x1876178888701056:12345-192.168.203.20@tcp:54:lfs.0 Request processed in 285us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263849.687991:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 123 00000100:00100000:1.0:1789263849.736279:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263849.736671:0:18696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888701184 00000100:00100000:3.0:1789263849.736680:0:18696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888701184 00000100:00080000:0.0:1789263849.736746:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789263849.736752:0:18696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 38 00000100:00100000:3.0:1789263849.736765:0:18696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8838f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+6:2399:x1876178888701184:12345-192.168.203.20@tcp:101:cat.0 00010000:00010000:3.0:1789263849.736783:0:18696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263849.736811:0:18696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087b958fa/0xce1582440fb1f59e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d1230d expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789263849.736835:0:18696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 13, mtime: 0x6aa5ffe7, atime: 0x6aa5ffe7, ctime: 0x6aa5ffe7, blocks: 0x8 00010000:00010000:3.0:1789263849.736853:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=292s v=(0 0) 00010000:00010000:3.0:1789263849.736859:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789263849.736866:0:18696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087b958fa/0xce1582440fb1f59e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1230d expref: 7 pid: 18696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263849.736882:0:18696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000087b958fa/0xce1582440fb1f59e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1230d expref: 7 pid: 18696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263849.736892:0:18696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981530600, rc 0) 00000100:00100000:3.0:1789263849.736938:0:18696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8838f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+7:2399:x1876178888701184:12345-192.168.203.20@tcp:101:cat.0 Request processed in 178us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263849.736954:0:18696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 38 00000100:00100000:3.0:1789263849.739241:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263849.739322:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888701312 00000100:00100000:1.0:1789263849.739328:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888701312 00002000:00100000:1.0:1789263849.739365:0:18704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x22:0x0] (0->4095) req@ffff9dd884acc700 x1876178888701312/t0(0) o3->aea5b0bf-5091-4b59-8387-6d6e4df18cfc@192.168.203.20@tcp:685/0 lens 488/0 e 0 to 0 dl 1789263860 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1789263849.739375:0:18704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dd884acc700 with x1876178888701312 ext(0->4095) 00002000:00010000:1.0:1789263849.739381:0:18704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dd884acc700 00000100:00100000:1.0:1789263849.739411:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 3 00000100:00100000:1.0:1789263849.739420:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd884acc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+7:2400:x1876178888701312:12345-192.168.203.20@tcp:3:cat.0 00000100:00100000:1.0:1789263849.739577:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd884acc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+7:2400:x1876178888701312:12345-192.168.203.20@tcp:3:cat.0 Request processed in 159us (341us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789263849.739583:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 3 00002000:00100000:1.0:1789263849.739587:0:18704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x22:0x0] (0->4095) req@ffff9dd884acc700 x1876178888701312/t0(0) o3->aea5b0bf-5091-4b59-8387-6d6e4df18cfc@192.168.203.20@tcp:685/0 lens 488/4536 e 0 to 0 dl 1789263860 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1789263849.739593:0:18704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dd884acc700 with x1876178888701312 ext(0->4095) 00002000:00010000:1.0:1789263849.739604:0:18704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dd884acc700 00010000:00010000:3.0:1789263849.773809:0:20218:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789263850.029239:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898148224:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789263850.029336:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263850.029391:0:18524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898148224 00000100:00100000:1.0:1789263850.029399:0:18524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898148224 00000100:00100000:1.0:1789263850.029456:0:18524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789263850.029466:0:18524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1876178898148224:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789263850.029506:0:18524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1789263850.029560:0:18524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1876178898148224:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263850.029568:0:18524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789263850.029601:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898148224:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789263850.541426:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898148352:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789263850.541534:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263850.542525:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898148352 00000100:00100000:3.0:1789263850.542536:0:18700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898148352 00000100:00080000:0.0:1789263850.542600:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789263850.542616:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789263850.542628:0:18700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8838f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876178898148352:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789263850.542659:0:18700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789263850.542819:0:18700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8838f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876178898148352:12345-0@lo:13:osp-pre-1-1.0 Request processed in 193us (1286us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263850.542828:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789263850.542949:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898148352:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1789263850.797272:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789263850.940347:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263850.940430:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888701440 00000100:00100000:0.0:1789263850.940440:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888701440 00000100:00100000:0.0:1789263850.940492:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 159 00000100:00100000:0.0:1789263850.940501:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd990737850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9c31cd1-b03c-4865-98dc-92dea6862336+13:2399:x1876178888701440:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789263850.940581:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd990737850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9c31cd1-b03c-4865-98dc-92dea6862336+13:2399:x1876178888701440:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 80us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263850.940589:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 159 00000100:00100000:3.0:1789263850.941100:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263850.941123:0:20485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888701696 00000100:00100000:0.0:1789263850.941128:0:20485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888701696 00000100:00100000:3.0:1789263850.941149:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263850.941174:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263850.941182:0:20485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888702208 00000100:00100000:0.0:1789263850.941185:0:20485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888702208 00000100:00100000:1.0:1789263850.941197:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 40 00000100:00100000:3.0:1789263850.941199:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263850.941213:0:18722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+5:2399:x1876178888701696:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789263850.941220:0:20485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 41 00000100:00100000:0.0:1789263850.941229:0:20485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882a6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a1530e0-880b-4d94-ada1-a3a40d18af45+5:2399:x1876178888702208:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1789263850.941234:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263850.941275:0:18722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+5:2399:x1876178888701696:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 63us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263850.941282:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 40 00000100:00100000:1.0:1789263850.941296:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888701568 00000100:00100000:1.0:1789263850.941299:0:18722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888701568 00000100:00100000:1.0:1789263850.941319:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 42 00000100:00100000:1.0:1789263850.941325:0:18722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883b6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+27:2399:x1876178888701568:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789263850.941411:0:20485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882a6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a1530e0-880b-4d94-ada1-a3a40d18af45+5:2399:x1876178888702208:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 182us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263850.941419:0:20485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 41 00000100:00080000:0.0:1789263850.941440:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789263850.941445:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789263850.941472:0:19302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888701952 00000100:00100000:2.0:1789263850.941477:0:19302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888701952 00000100:00100000:2.0:1789263850.941514:0:19302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888702464 00000100:00100000:2.0:1789263850.941518:0:19302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888702464 00000100:00100000:2.0:1789263850.941547:0:19302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 11 00000100:00100000:2.0:1789263850.941555:0:19302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+7:2399:x1876178888701952:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1789263850.941690:0:18722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883b6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+27:2399:x1876178888701568:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 364us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263850.941698:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 42 00000100:00100000:3.0:1789263850.941709:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263850.941751:0:18698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888701824 00000100:00100000:1.0:1789263850.941755:0:18698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888701824 00000100:00100000:1.0:1789263850.941779:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 12 00000100:00100000:1.0:1789263850.941787:0:18698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9a1530e0-880b-4d94-ada1-a3a40d18af45+5:2399:x1876178888702464:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1789263850.941806:0:18696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 13 00000100:00100000:3.0:1789263850.941818:0:18696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883b6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+7:2399:x1876178888701824:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1789263850.941826:0:18698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9a1530e0-880b-4d94-ada1-a3a40d18af45+5:2399:x1876178888702464:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 39us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263850.941834:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 12 00000100:00100000:1.0:1789263850.941859:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263850.941942:0:19302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+7:2399:x1876178888701952:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 387us (791us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263850.941951:0:18696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883b6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+7:2399:x1876178888701824:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 135us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263850.941952:0:19302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 11 00000100:00100000:3.0:1789263850.941972:0:18696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 13 00000100:00080000:3.0:1789263850.942012:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789263850.942020:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263850.942042:0:18698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888702336 00000100:00100000:3.0:1789263850.942048:0:18698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888702336 00000100:00100000:1.0:1789263850.942051:0:20485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888702080 00000100:00100000:1.0:1789263850.942057:0:20485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888702080 00000100:00100000:3.0:1789263850.942116:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 14 00000100:00100000:3.0:1789263850.942126:0:18698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8838f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9a1530e0-880b-4d94-ada1-a3a40d18af45+5:2399:x1876178888702336:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1789263850.942247:0:20485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 43 00000100:00100000:1.0:1789263850.942255:0:20485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8838f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a1530e0-880b-4d94-ada1-a3a40d18af45+6:2399:x1876178888702080:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1789263850.942285:0:20485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8838f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a1530e0-880b-4d94-ada1-a3a40d18af45+6:2399:x1876178888702080:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 31us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263850.942292:0:20485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 43 00000100:00100000:3.0:1789263850.942410:0:18698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8838f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9a1530e0-880b-4d94-ada1-a3a40d18af45+5:2399:x1876178888702336:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 285us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263850.942418:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 14 00000100:00080000:3.0:1789263850.942439:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789263850.942444:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1789263851.569714:0:19510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00000001:00080000:0.0:1789263851.569727:0:19510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00000100:00100000:1.0:1789263851.657735:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263851.657834:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888702592 00000100:00100000:0.0:1789263851.657851:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888702592 00000100:00100000:0.0:1789263851.657943:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 124 00000100:00100000:0.0:1789263851.657972:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8838f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+27:15546:x1876178888702592:12345-192.168.203.20@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1789263851.658190:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8838f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+27:15546:x1876178888702592:12345-192.168.203.20@tcp:60:lhsmtool_posix.0 Request processed in 234us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263851.658201:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 124 00000100:00100000:2.0:1789263851.659868:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263851.660040:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888702720 00000100:00100000:3.0:1789263851.660053:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888702720 00000100:00100000:3.0:1789263851.660154:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 125 00000100:00100000:3.0:1789263851.660166:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88431df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+5:15546:x1876178888702720:12345-192.168.203.20@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1789263851.660263:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88431df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+5:15546:x1876178888702720:12345-192.168.203.20@tcp:60:lhsmtool_posix.0 Request processed in 99us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263851.660271:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 125 00000100:00100000:1.0:1789263851.661507:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263851.661591:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888702976 00000100:00100000:3.0:1789263851.661598:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888702976 00000100:00100000:3.0:1789263851.661637:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 26 00000100:00100000:3.0:1789263851.661646:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8838f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+27:15546:x1876178888702976:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789263851.661817:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8838f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+28:15546:x1876178888702976:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 Request processed in 171us (311us total) trans 8589934671 rc 0/0 00000100:00100000:3.0:1789263851.661824:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 26 00010000:00010000:1.0:1789263851.821300:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789263851.822245:0:17950:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:1.0:1789263852.811010:0:20719:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 21:44:12 (1789263852) 00010000:00010000:0.0:1789263852.846194:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789263853.613556:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88431ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:de026c8f-6636-4fc7-8061-42c8092f00f0:3619:1876178898148480:0@lo:400:kworker.0 00000100:00100000:2.0:1789263853.613589:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88431ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898148736:0@lo:400:kworker.0 00000100:00100000:0.0:1789263853.613683:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263853.613701:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263853.613742:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989afed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1876178898148992:0@lo:400:kworker.0 00000100:00100000:0.0:1789263853.613771:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263853.613794:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1876178898149504:0@lo:400:kworker.0 00000100:00100000:1.0:1789263853.613818:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9c09f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898148864:0@lo:400:kworker.0 00000100:00100000:0.0:1789263853.613826:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263853.613860:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1876178898150016:0@lo:400:kworker.0 00000100:00100000:1.0:1789263853.613861:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263853.613891:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898149376:0@lo:400:kworker.0 00000100:00100000:0.0:1789263853.613898:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263853.613925:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263853.613961:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1876178898149888:0@lo:400:kworker.0 00000100:00100000:1.0:1789263853.613996:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263853.614028:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88431c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898148608:0@lo:400:kworker.0 00000100:00100000:1.0:1789263853.614058:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263853.614102:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989afd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898149120:0@lo:400:kworker.0 00000100:00100000:1.0:1789263853.614144:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263853.614163:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1876178898149632:0@lo:400:kworker.0 00000100:00100000:0.0:1789263853.614192:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898148992 00000100:00100000:1.0:1789263853.614198:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263853.614201:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898148992 00000100:00100000:1.0:1789263853.614234:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898148480 00000100:00100000:1.0:1789263853.614240:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898148480 00000100:00100000:0.0:1789263853.614252:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898149504 00000100:00100000:0.0:1789263853.614257:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898149504 00000100:00100000:0.0:1789263853.614277:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898150016 00000100:00100000:0.0:1789263853.614280:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898150016 00000100:00100000:1.0:1789263853.614291:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789263853.614302:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd990735850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de026c8f-6636-4fc7-8061-42c8092f00f0+24:3619:x1876178898148480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263853.614311:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898149888 00000100:00100000:0.0:1789263853.614315:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898149888 00000100:00100000:0.0:1789263853.614330:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898149632 00000100:00100000:0.0:1789263853.614333:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898149632 00000100:00100000:0.0:1789263853.614355:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789263853.614362:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd990735850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de026c8f-6636-4fc7-8061-42c8092f00f0+24:3619:x1876178898148480:12345-0@lo:400:kworker.0 Request processed in 61us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263853.614364:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88397d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1876178898148992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789263853.614378:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789263853.614422:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88397d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1876178898148992:12345-0@lo:400:kworker.0 Request processed in 59us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263853.614428:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789263853.614435:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789263853.614441:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88397ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1876178898149504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263853.614461:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789263853.614474:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898149248:0@lo:400:kworker.0 00000100:00100000:0.0:1789263853.614474:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88397ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1876178898150016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789263853.614484:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88397ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1876178898149504:12345-0@lo:400:kworker.0 Request processed in 43us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263853.614498:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789263853.614515:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789263853.614524:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8838f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1876178898149888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263853.614537:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88397ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1876178898150016:12345-0@lo:400:kworker.0 Request processed in 66us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263853.614546:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789263853.614563:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789263853.614572:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263853.614578:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882437100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1876178898149632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789263853.614581:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8838f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1876178898149888:12345-0@lo:400:kworker.0 Request processed in 59us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263853.614594:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789263853.614626:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3621:1876178898149760:0@lo:400:kworker.0 00000100:00100000:0.0:1789263853.614652:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882437100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1876178898149632:12345-0@lo:400:kworker.0 Request processed in 79us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263853.614655:0:19981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898148736 00000100:00100000:0.0:1789263853.614661:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789263853.614667:0:19981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898148736 00000100:00100000:2.0:1789263853.614677:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789263853.614689:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789263853.614697:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789263853.614701:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789263853.614705:0:19981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898148864 00000100:00100000:1.0:1789263853.614709:0:19981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898148864 00000100:00100000:1.0:1789263853.614743:0:19981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898149376 00000100:00100000:2.0:1789263853.614748:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789263853.614748:0:19981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898149376 00000100:00080000:0.0:1789263853.614752:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789263853.614762:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789263853.614767:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883e33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898150144:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789263853.614783:0:19981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898149248 00000100:00100000:1.0:1789263853.614789:0:19981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898149248 00000100:00100000:0.0:1789263853.614801:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898149760 00000100:00100000:0.0:1789263853.614807:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898149760 00000100:00100000:2.0:1789263853.614817:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263853.614822:0:19981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789263853.614831:0:19981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3621:x1876178898148736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263853.614866:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789263853.614876:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1876178898149760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789263853.614904:0:19981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3621:x1876178898148736:12345-0@lo:400:kworker.0 Request processed in 74us (1204us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263853.614911:0:18699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789263853.614924:0:19981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789263853.614931:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1876178898149760:12345-0@lo:400:kworker.0 Request processed in 54us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263853.614939:0:18699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8838f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1876178898148864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263853.614945:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789263853.614951:0:19981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789263853.614966:0:19981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8838f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3618:x1876178898149376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263853.614986:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898148608 00000100:00100000:0.0:1789263853.614991:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898148608 00000100:00100000:0.0:1789263853.615027:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898149120 00000100:00100000:0.0:1789263853.615031:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898149120 00000100:00100000:1.0:1789263853.615035:0:19981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8838f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3618:x1876178898149376:12345-0@lo:400:kworker.0 Request processed in 72us (1110us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263853.615043:0:19981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789263853.615056:0:18699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8838f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1876178898148864:12345-0@lo:400:kworker.0 Request processed in 127us (1193us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263853.615060:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789263853.615064:0:19981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789263853.615133:0:19981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3621:x1876178898149248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789263853.615144:0:18699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789263853.615177:0:19981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3621:x1876178898149248:12345-0@lo:400:kworker.0 Request processed in 102us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263853.615184:0:19981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789263853.615206:0:19982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898150144 00000100:00100000:2.0:1789263853.615215:0:19982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898150144 00000100:00100000:1.0:1789263853.615253:0:18524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789263853.615264:0:18524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8838f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898149120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789263853.615274:0:19982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789263853.615288:0:19982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3621:x1876178898150144:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789263853.615291:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789263853.615297:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789263853.615304:0:18524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8838f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898149120:12345-0@lo:400:kworker.0 Request processed in 41us (1158us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263853.615311:0:18524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00002000:00000024:2.0:1789263853.615327:0:19982:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1789263853.615328:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989afd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898149120:0@lo:400:kworker.0 00000100:00100000:3.0:1789263853.615350:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1876178898149632:0@lo:400:kworker.0 00000100:00100000:3.0:1789263853.615374:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789263853.615391:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882434a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898150272:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789263853.615394:0:19982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3621:x1876178898150144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263853.615408:0:19982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789263853.615445:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263853.615512:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898150272 00000100:00100000:2.0:1789263853.615515:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934601 gen 2 00000100:00100000:3.0:1789263853.615517:0:18700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898150272 00000004:00080000:2.0:1789263853.615531:0:3618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934599 committed transno 8589934601 00000100:00100000:3.0:1789263853.615567:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000004:00080000:2.0:1789263853.615575:0:3618:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9dd88397f480, transno 8589934601 00000100:00100000:3.0:1789263853.615579:0:18700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883b6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1876178898150272:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789263853.615605:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9c09f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898148864:0@lo:400:kworker.0 00002000:00000024:3.0:1789263853.615608:0:18700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789263853.615648:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898149376:0@lo:400:kworker.0 00000100:00100000:3.0:1789263853.615684:0:18700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883b6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1876178898150272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263853.615687:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1876178898149888:0@lo:400:kworker.0 00000100:00100000:3.0:1789263853.615708:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789263853.615769:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882434a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898150272:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1789263853.615816:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd99f9a6d80 x1876178898150016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263869 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263853.615820:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd8838f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1876178898148608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263853.615834:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1876178898150016:0@lo:400:kworker.0 00000100:00100000:3.0:1789263853.615845:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88431ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:de026c8f-6636-4fc7-8061-42c8092f00f0:3619:1876178898148480:0@lo:400:kworker.0 00000100:00100000:3.0:1789263853.615859:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989afed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1876178898148992:0@lo:400:kworker.0 00000100:00100000:3.0:1789263853.615880:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1876178898149504:0@lo:400:kworker.0 00000100:00100000:0.0:1789263853.615888:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd8838f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1876178898148608:12345-0@lo:400:kworker.0 Request processed in 816us (1825us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263853.615898:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789263853.615950:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883e33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898150144:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789263853.615954:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88431c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898148608:0@lo:400:kworker.0 00000100:00100000:2.0:1789263853.615985:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88431ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898148736:0@lo:400:kworker.0 00000100:00100000:2.0:1789263853.616020:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898149248:0@lo:400:kworker.0 00010000:00080000:2.0:1789263853.616051:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd99f9a5880 x1876178898149760/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263869 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789263853.616064:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3621:1876178898149760:0@lo:400:kworker.0 00000001:00080000:3.0:1789263853.616900:0:18693:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00000001:00080000:3.0:1789263853.616909:0:18693:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:0.0:1789263853.616931:0:17172:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934671 is committed 00010000:00010000:3.0:1789263853.616948:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23200/0xce1582440fb1f519 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263853.616959:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23200/0xce1582440fb1f519 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263853.616966:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23200/0xce1582440fb1f519 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263853.616971:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bfa23200 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263853.616975:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23200/0xce1582440fb1f519 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789263853.616982:0:17172:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9dd9b7a8c780 refcount 2 committed 0 result 0 batchid 4294967518 00010000:00010000:3.0:1789263853.616983:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23200/0xce1582440fb1f519 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789263853.616990:0:17172:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9dd882508c00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9dd9b7a8c0c0 00000020:00080000:0.0:1789263853.616995:0:17172:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9dd882508800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9dd9bf66ae00 00010000:00010000:3.0:1789263853.617001:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9dd883cc7400) 00010000:00010000:3.0:1789263853.617009:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789263853.617013:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23200/0xce1582440fb1f519 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263853.617019:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23200/0xce1582440fb1f519 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18722 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789263853.617026:0:17172:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967517 batchid updated 00000020:00080000:0.0:1789263853.617045:0:17231:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967518 committed batchid 4294967517 00000020:00080000:0.0:1789263853.617148:0:17231:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967517 00010000:00010000:3.0:1789263853.869233:0:20218:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789263853.987952:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263853.988002:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888703232 00000100:00100000:3.0:1789263853.988011:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888703232 00000100:00100000:3.0:1789263853.988140:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 27 00000100:00100000:3.0:1789263853.988152:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882437b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+13:16517:x1876178888703232:12345-192.168.203.20@tcp:35:umount.0 00000100:00100000:3.0:1789263853.988390:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882437b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+14:16517:x1876178888703232:12345-192.168.203.20@tcp:35:umount.0 Request processed in 240us (444us total) trans 8589934672 rc 0/0 00000100:00100000:3.0:1789263853.988397:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 27 00000100:00080000:0.0:1789263853.988462:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789263853.990045:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263853.990225:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888703488 00000100:00100000:1.0:1789263853.990233:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888703488 00000100:00100000:1.0:1789263853.990280:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 28 00000100:00100000:1.0:1789263853.990288:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd998440050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+14:16517:x1876178888703488:12345-192.168.203.20@tcp:35:umount.0 00000100:00100000:1.0:1789263853.990582:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd998440050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+15:16517:x1876178888703488:12345-192.168.203.20@tcp:35:umount.0 Request processed in 294us (544us total) trans 8589934673 rc 0/0 00000100:00100000:1.0:1789263853.990591:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 28 00000100:00100000:1.0:1789263853.993282:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263853.993436:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263853.993518:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263853.993582:0:18344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888703616 00000100:00100000:0.0:1789263853.993591:0:18344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888703616 00000100:00100000:0.0:1789263853.993649:0:18344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888703744 00000100:00100000:0.0:1789263853.993652:0:18344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888703744 00000100:00100000:0.0:1789263853.993679:0:18344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 5 00000100:00100000:0.0:1789263853.993687:0:18344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882437b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f9c31cd1-b03c-4865-98dc-92dea6862336+14:2398:x1876178888703616:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789263853.993700:0:18344:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789263853.993718:0:18344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd883f59c00/0xce1582440fb1ed32 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12082 expref: 14 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263853.993734:0:18344:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789263853.993781:0:18344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882437b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f9c31cd1-b03c-4865-98dc-92dea6862336+13:2398:x1876178888703616:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 94us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263853.993789:0:18344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 5 00000100:00100000:0.0:1789263853.993804:0:18344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 6 00000100:00100000:0.0:1789263853.993809:0:18344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882436a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f9c31cd1-b03c-4865-98dc-92dea6862336+12:2397:x1876178888703744:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789263853.993821:0:18344:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789263853.993829:0:18344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd8841a3400/0xce1582440fb1ed39 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d120b3 expref: 12 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263853.993837:0:18344:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789263853.993855:0:18344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882436a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f9c31cd1-b03c-4865-98dc-92dea6862336+11:2397:x1876178888703744:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 45us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263853.993878:0:18344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 6 00000100:00100000:1.0:1789263853.994267:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263853.994316:0:18699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888704000 00000100:00100000:2.0:1789263853.994321:0:18699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888704000 00000100:00080000:1.0:1789263853.994427:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789263853.994469:0:18699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 39 00000100:00100000:2.0:1789263853.994479:0:18699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882436300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+5:2396:x1876178888704000:12345-192.168.203.20@tcp:9:umount.0 00000020:00000080:2.0:1789263853.994504:0:18699:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1eef2 00000100:00080000:2.0:1789263853.994521:0:18699:0:(import.c:65:import_set_state_nolock()) ffff9dd8810d4000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1789263853.994640:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888703872 00000100:00100000:3.0:1789263853.994645:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888703872 00000100:00100000:0.0:1789263853.994686:0:18344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 7 00000100:00100000:0.0:1789263853.994695:0:18344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa63450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f9c31cd1-b03c-4865-98dc-92dea6862336+11:2400:x1876178888703872:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789263853.994702:0:18344:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789263853.994712:0:18344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd9bfa23800/0xce1582440fb1f129 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d121e0 expref: 11 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263853.994721:0:18344:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789263853.994749:0:18344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa63450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f9c31cd1-b03c-4865-98dc-92dea6862336+10:2400:x1876178888703872:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 56us (1230us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263853.994755:0:18344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 7 00000001:00000004:2.0:1789263853.994816:0:18699:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934601 00000100:00100000:2.0:1789263853.994947:0:18699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882436300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+2:2396:x1876178888704000:12345-192.168.203.20@tcp:9:umount.0 Request processed in 470us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263853.994955:0:18699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 39 00010000:00010000:1.0:1789263853.995669:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789263853.998479:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263853.998560:0:19981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888704256 00000100:00100000:2.0:1789263853.998569:0:19981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888704256 00000100:00080000:1.0:1789263853.998629:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789263853.998684:0:19981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 40 00000100:00100000:2.0:1789263853.998694:0:19981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882436d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+6:2396:x1876178888704256:12345-192.168.203.20@tcp:9:umount.0 00000020:00000080:2.0:1789263853.998720:0:19981:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1eeeb 00000020:00010000:2.0:1789263853.998733:0:19981:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9dd883817000: total 0 00000100:00080000:2.0:1789263853.998737:0:19981:0:(import.c:65:import_set_state_nolock()) ffff9dd883811000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789263853.998779:0:19981:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000020:00010000:1.0:1789263853.998786:0:17944:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9dd883817000: total 0 00010000:00010000:1.0:1789263853.998846:0:17944:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9dd883817000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789263853.998903:0:17944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087b958fa/0xce1582440fb1f59e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1230d expref: 4 pid: 18696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263853.998921:0:19981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882436d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+3:2396:x1876178888704256:12345-192.168.203.20@tcp:9:umount.0 Request processed in 227us (446us total) trans 0 rc 0/0 00010000:00010000:1.0:1789263853.998928:0:17944:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9dd883817000, canceled 1 locks, left on hash table 0. 00000100:00100000:2.0:1789263853.998944:0:19981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 40 00010000:00010000:1.0:1789263853.998944:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263853.998949:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263853.998952:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789263854.002994:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263854.003056:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888705024 00000100:00100000:2.0:1789263854.003100:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888705024 00000100:00100000:2.0:1789263854.003173:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 126 00000100:00100000:2.0:1789263854.003183:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+15:2396:x1876178888705024:12345-192.168.203.20@tcp:39:umount.0 00000020:00000080:2.0:1789263854.003214:0:17192:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1eee4 00000020:00010000:2.0:1789263854.003232:0:17192:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9dd883815000: total 0 00000100:00080000:2.0:1789263854.003236:0:17192:0:(import.c:65:import_set_state_nolock()) ffff9dd883810000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789263854.003267:0:17192:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934673 00000020:00010000:0.0:1789263854.003337:0:17180:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9dd883815000: total 0 00010000:00010000:0.0:1789263854.003407:0:17180:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9dd883815000, canceled 0 locks, left on hash table 8. 00000100:00100000:2.0:1789263854.003417:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+14:2396:x1876178888705024:12345-192.168.203.20@tcp:39:umount.0 Request processed in 234us (431us total) trans 8589934674 rc 0/0 00000100:00100000:2.0:1789263854.003425:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 126 00010000:00010000:0.0:1789263854.003443:0:17180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9dd9bb595f00) 00010000:00010000:0.0:1789263854.003447:0:17180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789263854.003454:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530800/0xce1582440fb1ef7e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12169 expref: 13 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263854.003476:0:17180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9dd9bb585c00) 00010000:00010000:0.0:1789263854.003479:0:17180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789263854.003483:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23c00/0xce1582440fb1f55f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122f8 expref: 12 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263854.003494:0:17180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9dd9bb585c00) 00010000:00010000:0.0:1789263854.003496:0:17180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789263854.003510:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51600/0xce1582440fb1f589 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12306 expref: 11 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263854.003525:0:17180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd998414100) 00010000:00010000:0.0:1789263854.003527:0:17180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789263854.003531:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f50a00/0xce1582440fb1efbd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12177 expref: 10 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263854.003543:0:17180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9dd9bb585c00) 00010000:00010000:0.0:1789263854.003545:0:17180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789263854.003549:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51000/0xce1582440fb1f486 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d122c0 expref: 9 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263854.003565:0:17180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9dd9bb595a00) 00010000:00010000:0.0:1789263854.003567:0:17180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789263854.003569:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981531000/0xce1582440fb1ef62 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12162 expref: 8 pid: 18722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263854.003583:0:17180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9dd9bb595c00) 00010000:00010000:0.0:1789263854.003586:0:17180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789263854.003590:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981530e00/0xce1582440fb1f042 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d121a1 expref: 7 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263854.003602:0:17180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9dd9bb595c00) 00010000:00010000:0.0:1789263854.003604:0:17180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789263854.003608:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683c00/0xce1582440fb1f192 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12203 expref: 6 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263854.003622:0:17180:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9dd883815000, canceled 8 locks, left on hash table 0. 00010000:00010000:0.0:1789263854.003637:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263854.003639:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263854.003640:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789263854.007924:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263854.008020:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888705152 00000100:00100000:3.0:1789263854.008033:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888705152 00000100:00100000:3.0:1789263854.008150:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 127 00000100:00100000:3.0:1789263854.008163:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989ae0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+5:2396:x1876178888705152:12345-192.168.203.20@tcp:39:umount.0 00000020:00000080:3.0:1789263854.008197:0:17193:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1ed47 00000100:00080000:3.0:1789263854.008211:0:17193:0:(import.c:65:import_set_state_nolock()) ffff9dd987d97000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789263854.008234:0:17193:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:2.0:1789263854.008254:0:20218:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789263854.008426:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989ae0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aea5b0bf-5091-4b59-8387-6d6e4df18cfc+3:2396:x1876178888705152:12345-192.168.203.20@tcp:39:umount.0 Request processed in 267us (507us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1789263854.008435:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 127 00000100:00080000:1.0:1789263854.008599:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789263854.125275:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789263854.125299:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883f5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898150400:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789263854.125365:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263854.125415:0:19982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898150400 00000100:00100000:3.0:1789263854.125423:0:19982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898150400 00000100:00100000:1.0:1789263854.125433:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882436680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876178898150528:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789263854.125470:0:19982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789263854.125473:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263854.125482:0:19982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883b6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1876178898150400:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789263854.125514:0:18524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898150528 00000100:00100000:0.0:1789263854.125520:0:18524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898150528 00000100:00100000:0.0:1789263854.125553:0:18524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789263854.125561:0:18524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882435180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1876178898150528:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789263854.125589:0:18524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789263854.125633:0:18524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882435180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1876178898150528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263854.125640:0:18524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789263854.125671:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882436680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876178898150528:0@lo:41:osp-pre-1-0.0 00002000:00000024:3.0:1789263854.126282:0:19982:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1789263854.126333:0:19982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883b6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1876178898150400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 852us (966us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263854.126368:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883f5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898150400:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789263854.126525:0:19982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789263854.324019:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263854.324422:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888705408 00000100:00100000:2.0:1789263854.324443:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888705408 00000100:00100000:1.0:1789263854.324452:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263854.324486:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263854.324522:0:18344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888705280 00000100:00100000:1.0:1789263854.324530:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263854.324533:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888705536 00000100:00100000:0.0:1789263854.324534:0:18344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888705280 00000100:00100000:2.0:1789263854.324541:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888705536 00000100:00100000:1.0:1789263854.324581:0:18696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888705664 00000100:00100000:2.0:1789263854.324583:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 8 00000100:00100000:1.0:1789263854.324587:0:18696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888705664 00000100:00100000:2.0:1789263854.324601:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882436680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9c31cd1-b03c-4865-98dc-92dea6862336+12:2397:x1876178888705408:12345-192.168.203.20@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1789263854.324614:0:18344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 9 00010000:00010000:2.0:1789263854.324622:0:17178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789263854.324628:0:17177:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:0.0:1789263854.324633:0:18344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882437480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f9c31cd1-b03c-4865-98dc-92dea6862336+12:2398:x1876178888705536:12345-192.168.203.20@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1789263854.324643:0:17177:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00010000:00010000:2.0:1789263854.324653:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd987f51c00/0xce1582440fb1ef0e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12123 expref: 12 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263854.324653:0:18344:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789263854.324663:0:18696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 41 00000100:00100000:1.0:1789263854.324684:0:18696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882435500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9a1530e0-880b-4d94-ada1-a3a40d18af45+5:2396:x1876178888705664:12345-192.168.203.20@tcp:9:umount.0 00010000:00010000:0.0:1789263854.324686:0:18344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd981682600/0xce1582440fb1f106 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d121d2 expref: 11 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263854.324689:0:17178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789263854.324724:0:18344:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00000080:1.0:1789263854.324725:0:18696:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1ef31 00000100:00080000:1.0:1789263854.324744:0:18696:0:(import.c:65:import_set_state_nolock()) ffff9dd9ac8ff800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1789263854.324785:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882436680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9c31cd1-b03c-4865-98dc-92dea6862336+10:2397:x1876178888705408:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 180us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263854.324785:0:18344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882437480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f9c31cd1-b03c-4865-98dc-92dea6862336+10:2398:x1876178888705536:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 151us (288us total) trans 0 rc 0/0 00000001:00000004:1.0:1789263854.324798:0:18696:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934601 00000100:00100000:0.0:1789263854.324811:0:18344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 9 00000100:00100000:2.0:1789263854.324823:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 8 00000100:00100000:3.0:1789263854.324834:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 10 00000100:00100000:3.0:1789263854.324849:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882435f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9c31cd1-b03c-4865-98dc-92dea6862336+8:2398:x1876178888705280:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789263854.324861:0:17177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789263854.324878:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd9bfa23600/0xce1582440fb1ef07 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d120f2 expref: 8 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263854.324906:0:17177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789263854.324939:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882435f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9c31cd1-b03c-4865-98dc-92dea6862336+7:2398:x1876178888705280:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 96us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263854.324959:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 10 00000100:00100000:1.0:1789263854.324966:0:18696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882435500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9a1530e0-880b-4d94-ada1-a3a40d18af45+2:2396:x1876178888705664:12345-192.168.203.20@tcp:9:umount.0 Request processed in 284us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263854.324981:0:18696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 41 00010000:00010000:2.0:1789263854.325185:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789263854.325478:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789263854.329060:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263854.329222:0:18699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888705792 00000100:00100000:2.0:1789263854.329234:0:18699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888705792 00000100:00100000:2.0:1789263854.329332:0:18699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 42 00000100:00100000:2.0:1789263854.329344:0:18699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883f5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9a1530e0-880b-4d94-ada1-a3a40d18af45+5:2396:x1876178888705792:12345-192.168.203.20@tcp:9:umount.0 00000100:00080000:1.0:1789263854.329369:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:2.0:1789263854.330057:0:18699:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1ef2a 00000100:00080000:2.0:1789263854.330073:0:18699:0:(import.c:65:import_set_state_nolock()) ffff9dd987d90800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1789263854.330162:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1789263854.330190:0:18699:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:2.0:1789263854.330358:0:18699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883f5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9a1530e0-880b-4d94-ada1-a3a40d18af45+2:2396:x1876178888705792:12345-192.168.203.20@tcp:9:umount.0 Request processed in 1016us (1308us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263854.330367:0:18699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 42 00000100:00100000:0.0:1789263854.334360:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263854.334587:0:20485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888706048 00000100:00100000:1.0:1789263854.334598:0:20485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888706048 00000100:00100000:1.0:1789263854.334721:0:20485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 128 00000100:00100000:1.0:1789263854.334733:0:20485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883f5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a1530e0-880b-4d94-ada1-a3a40d18af45+6:2396:x1876178888706048:12345-192.168.203.20@tcp:39:umount.0 00000020:00000080:1.0:1789263854.334784:0:20485:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1ef1c 00000020:00010000:1.0:1789263854.334793:0:20485:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9dd9860fc800: total 0 00000100:00080000:1.0:1789263854.334798:0:20485:0:(import.c:65:import_set_state_nolock()) ffff9dd9862e3800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789263854.334836:0:20485:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934674 00000100:00100000:1.0:1789263854.335034:0:20485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883f5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9a1530e0-880b-4d94-ada1-a3a40d18af45+5:2396:x1876178888706048:12345-192.168.203.20@tcp:39:umount.0 Request processed in 302us (684us total) trans 8589934675 rc 0/0 00000100:00100000:1.0:1789263854.335042:0:20485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 128 00000100:00080000:2.0:1789263854.335110:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:3.0:1789263854.335461:0:17180:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9dd9860fc800: total 0 00010000:00010000:3.0:1789263854.335527:0:17180:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9dd9860fc800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1789263854.335569:0:17180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd998414100) 00010000:00010000:3.0:1789263854.335572:0:17180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789263854.335582:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd987f51200/0xce1582440fb1efcb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1217e expref: 4 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263854.335607:0:17180:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9dd9860fc800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1789263854.335621:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263854.335623:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263854.335625:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789263854.341004:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263854.341717:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888706176 00000100:00100000:2.0:1789263854.341730:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888706176 00000100:00100000:2.0:1789263854.341844:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 129 00000100:00100000:2.0:1789263854.341858:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882434380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a1530e0-880b-4d94-ada1-a3a40d18af45+5:2396:x1876178888706176:12345-192.168.203.20@tcp:39:umount.0 00000020:00000080:2.0:1789263854.341907:0:17192:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1ef23 00000100:00080000:2.0:1789263854.341917:0:17192:0:(import.c:65:import_set_state_nolock()) ffff9dd987d96000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789263854.341949:0:17192:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00010000:00010000:3.0:1789263854.342125:0:20218:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789263854.342174:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882434380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a1530e0-880b-4d94-ada1-a3a40d18af45+3:2396:x1876178888706176:12345-192.168.203.20@tcp:39:umount.0 Request processed in 318us (1180us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1789263854.342185:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 129 00000100:00080000:1.0:1789263854.342388:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789263854.354171:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263854.354267:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888706432 00000100:00100000:0.0:1789263854.354286:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888706432 00000100:00100000:0.0:1789263854.354384:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 161 00000100:00100000:0.0:1789263854.354394:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd990737050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9c31cd1-b03c-4865-98dc-92dea6862336+7:2396:x1876178888706432:12345-192.168.203.20@tcp:251:umount.0 00000020:00000080:0.0:1789263854.354443:0:17186:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1ed24 00000020:00010000:0.0:1789263854.354450:0:17186:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9dd883fdc800: total 0 00000100:00080000:0.0:1789263854.354455:0:17186:0:(import.c:65:import_set_state_nolock()) ffff9dd883fdf000 : changing import state from FULL to CLOSED 00000020:00010000:2.0:1789263854.354510:0:17181:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9dd883fdc800: total 0 00010000:00010000:2.0:1789263854.354517:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789263854.354598:0:17181:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9dd883fdc800, canceled 0 locks, left on hash table 1. 00000100:00100000:0.0:1789263854.354600:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd990737050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9c31cd1-b03c-4865-98dc-92dea6862336+3:2396:x1876178888706432:12345-192.168.203.20@tcp:251:umount.0 Request processed in 201us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263854.354613:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 161 00010000:00010000:2.0:1789263854.354643:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd883f59000/0xce1582440fb1ed2b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1207b expref: 2 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263854.354674:0:17181:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9dd883fdc800, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1789263854.354718:0:17181:0:(genops.c:885:class_export_put()) final put ffff9dd883fdc800/f9c31cd1-b03c-4865-98dc-92dea6862336 00010000:00010000:2.0:1789263854.354735:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789263854.354737:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789263854.354739:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789263854.354805:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd883fdc800/f9c31cd1-b03c-4865-98dc-92dea6862336 for MGS 00000020:00000080:0.0:1789263854.354872:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd883fdf000 for MGS 00010000:00010000:1.0:1789263854.893288:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789263855.100507:0:20915:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1789263855.115224:0:20915:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1789263855.115276:0:20915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883f58200/0xce1582440fb1ea7d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1ea84 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263855.115293:0:20915:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883f58200/0xce1582440fb1ea7d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1ea84 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263855.115302:0:20915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883f58200/0xce1582440fb1ea7d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xce1582440fb1ea84 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263855.115309:0:20915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff9dd883f58200/0xce1582440fb1ea7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xce1582440fb1ea84 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263855.115330:0:20915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789263855.115335:0:20915:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:3.0:1789263855.115351:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789263855.115361:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd883f58200/0xce1582440fb1ea7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xce1582440fb1ea84 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263855.115371:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883f58200 already unused, calling callback (ffffffffc12b1c20) 00000100:00080000:1.0:1789263855.115378:0:20915:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789263855.115385:0:20915:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789263855.115393:0:20915:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 10000000:00010000:3.0:1789263855.115402:0:17180:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd883f58200/0xce1582440fb1ea7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xce1582440fb1ea84 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263855.115413:0:17180:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd883f58200/0xce1582440fb1ea7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xce1582440fb1ea84 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789263855.115421:0:17180:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd883f58200/0xce1582440fb1ea7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xce1582440fb1ea84 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789263855.115429:0:17180:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00080000:1.0:1789263855.115430:0:20915:0:(import.c:65:import_set_state_nolock()) ffff9dd9bf99c800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 10000000:01000000:3.0:1789263855.115432:0:17180:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789263855.115436:0:17180:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789263855.115464:0:17180:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff9dd883f58200/0xce1582440fb1ea7d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xce1582440fb1ea84 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263855.115471:0:17180:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789263855.115485:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882434000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876178898150656:0@lo:39:umount.0 00010000:00010000:3.0:1789263855.115503:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd883f58200/0xce1582440fb1ea7d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xce1582440fb1ea84 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263855.115512:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd883f58200/0xce1582440fb1ea7d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xce1582440fb1ea84 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263855.115524:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263855.115527:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263855.115529:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789263855.115548:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883b6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de026c8f-6636-4fc7-8061-42c8092f00f0:3620:1876178898150784:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789263855.115555:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263855.115583:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263855.115652:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898150784 00000100:00100000:3.0:1789263855.115659:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898150784 00000100:00100000:1.0:1789263855.115661:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898150656 00000100:00100000:1.0:1789263855.115673:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898150656 00000100:00100000:1.0:1789263855.115712:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789263855.115714:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789263855.115721:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1876178898150656:12345-0@lo:39:umount.0 00000100:00100000:3.0:1789263855.115727:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882435880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de026c8f-6636-4fc7-8061-42c8092f00f0+24:3620:x1876178898150784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789263855.115742:0:17179:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000080:1.0:1789263855.115748:0:17193:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1eb41 00000100:00080000:1.0:1789263855.115756:0:17193:0:(import.c:65:import_set_state_nolock()) ffff9dd985680000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1789263855.115761:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd883e72400/0xce1582440fb1ea84 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xce1582440fb1ea7d expref: 24 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263855.115784:0:17179:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789263855.115793:0:20218:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789263855.115816:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3617:x1876178898150656:12345-0@lo:39:umount.0 Request processed in 97us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263855.115821:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000020:00000080:1.0:1789263855.115830:0:17193:0:(genops.c:885:class_export_put()) final put ffff9dd985685800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:3.0:1789263855.115839:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882435880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de026c8f-6636-4fc7-8061-42c8092f00f0+23:3620:x1876178898150784:12345-0@lo:103:ldlm_bl.0 Request processed in 116us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263855.115848:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1789263855.115858:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd9bf99c800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789263855.115876:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882434000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876178898150656:0@lo:39:umount.0 00000020:00000080:3.0:1789263855.115877:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd985685800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00080000:1.0:1789263855.115915:0:20915:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789263855.115918:0:20915:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789263855.115921:0:20915:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789263855.115934:0:479:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd985680000 for lustre-MDT0000 00000100:00100000:2.0:1789263855.115970:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883b6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de026c8f-6636-4fc7-8061-42c8092f00f0:3620:1876178898150784:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789263855.116789:0:20915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883f58c00/0xce1582440fb1e9ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1e9d5 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263855.116800:0:20915:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883f58c00/0xce1582440fb1e9ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1e9d5 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263855.116807:0:20915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883f58c00/0xce1582440fb1e9ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xce1582440fb1e9d5 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263855.116814:0:20915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff9dd883f58c00/0xce1582440fb1e9ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xce1582440fb1e9d5 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263855.116825:0:20915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789263855.116830:0:20915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883e73c00/0xce1582440fb1ed16 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1ed1d expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263855.116837:0:20915:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883e73c00/0xce1582440fb1ed16 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1ed1d expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263855.116855:0:20915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883e73c00/0xce1582440fb1ed16 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xce1582440fb1ed1d expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263855.116862:0:20915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff9dd883e73c00/0xce1582440fb1ed16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xce1582440fb1ed1d expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263855.116879:0:20915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789263855.116886:0:20915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd8841a2600/0xce1582440fb1f0f8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f0ff expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263855.116892:0:20915:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd8841a2600/0xce1582440fb1f0f8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1f0ff expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263855.116898:0:20915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd8841a2600/0xce1582440fb1f0f8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xce1582440fb1f0ff expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263855.116906:0:17944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789263855.116906:0:20915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff9dd8841a2600/0xce1582440fb1f0f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xce1582440fb1f0ff expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263855.116914:0:17944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd883f58c00/0xce1582440fb1e9ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xce1582440fb1e9d5 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263855.116923:0:17944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883f58c00 already unused, calling callback (ffffffffc12b1c20) 00010000:00010000:1.0:1789263855.116924:0:20915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:00010000:3.0:1789263855.116927:0:17944:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd883f58c00/0xce1582440fb1e9ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xce1582440fb1e9d5 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263855.116931:0:20915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883f59800/0xce1582440fb1e9c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1e9c7 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263855.116936:0:17944:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd883f58c00/0xce1582440fb1e9ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xce1582440fb1e9d5 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263855.116942:0:20915:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883f59800/0xce1582440fb1e9c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1e9c7 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789263855.116945:0:17944:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd883f58c00/0xce1582440fb1e9ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xce1582440fb1e9d5 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263855.116952:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 10000000:01000000:3.0:1789263855.116960:0:17944:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789263855.116962:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd883e73c00/0xce1582440fb1ed16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xce1582440fb1ed1d expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789263855.116963:0:17944:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1789263855.116967:0:20915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883f59800/0xce1582440fb1e9c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xce1582440fb1e9c7 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263855.116977:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883e73c00 already unused, calling callback (ffffffffc12b1c20) 10000000:00010000:0.0:1789263855.116982:0:17180:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd883e73c00/0xce1582440fb1ed16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xce1582440fb1ed1d expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263855.116987:0:17944:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff9dd883f58c00/0xce1582440fb1e9ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xce1582440fb1e9d5 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263855.117003:0:17180:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd883e73c00/0xce1582440fb1ed16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xce1582440fb1ed1d expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263855.117005:0:17944:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789263855.117005:0:20915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff9dd883f59800/0xce1582440fb1e9c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xce1582440fb1e9c7 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263855.117021:0:17944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd883f58c00/0xce1582440fb1e9ce lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xce1582440fb1e9d5 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789263855.117022:0:17180:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd883e73c00/0xce1582440fb1ed16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xce1582440fb1ed1d expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263855.117030:0:20915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1789263855.117038:0:20915:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1789263855.117043:0:20915:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1789263855.117065:0:20915:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1789263855.117069:0:20915:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1789263855.117097:0:20915:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00010000:00010000:3.0:1789263855.117101:0:17944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd883f58c00/0xce1582440fb1e9ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xce1582440fb1e9d5 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789263855.117105:0:17180:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000020:00000080:1.0:1789263855.117115:0:20915:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 10000000:01000000:0.0:1789263855.117122:0:17180:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00000020:00080000:1.0:1789263855.117125:0:20915:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9dd883fdd000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:3.0:1789263855.117126:0:17944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 10000000:01000000:0.0:1789263855.117126:0:17180:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1789263855.117133:0:17944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd8841a2600/0xce1582440fb1f0f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xce1582440fb1f0ff expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1789263855.117137:0:20915:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9dd9bfa36000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:3.0:1789263855.117148:0:17944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd8841a2600 already unused, calling callback (ffffffffc12b1c20) 00010000:00010000:0.0:1789263855.117149:0:17180:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff9dd883e73c00/0xce1582440fb1ed16 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xce1582440fb1ed1d expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1789263855.117150:0:20915:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9dd991568800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 10000000:00010000:3.0:1789263855.117155:0:17944:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd8841a2600/0xce1582440fb1f0f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xce1582440fb1f0ff expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1789263855.117166:0:20915:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9dd99156a000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:0.0:1789263855.117170:0:17180:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789263855.117178:0:17944:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd8841a2600/0xce1582440fb1f0f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xce1582440fb1f0ff expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1789263855.117183:0:20915:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9dd9860fc800 9a1530e0-880b-4d94-ada1-a3a40d18af45 192.168.203.20@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 10000000:00010000:3.0:1789263855.117188:0:17944:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd8841a2600/0xce1582440fb1f0f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xce1582440fb1f0ff expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263855.117191:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd883e73c00/0xce1582440fb1ed16 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xce1582440fb1ed1d expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1789263855.117193:0:20915:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9dd883815000 aea5b0bf-5091-4b59-8387-6d6e4df18cfc 192.168.203.20@tcp 4 (0 4 0) 1 0 0 0: 0000000000000000 8589934671 stale:0 00000020:00080000:1.0:1789263855.117207:0:20915:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9dd9890e8000) has exports, disconnecting them 10000000:01000000:3.0:1789263855.117208:0:17944:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789263855.117211:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd883e73c00/0xce1582440fb1ed16 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xce1582440fb1ed1d expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1789263855.117213:0:20915:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9dd883fdd000), last request at 1789263853 10000000:01000000:3.0:1789263855.117214:0:17944:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1789263855.117220:0:17944:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000020:00000080:1.0:1789263855.117221:0:20915:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1ece5 00010000:00010000:0.0:1789263855.117232:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00080000:1.0:1789263855.117237:0:20915:0:(import.c:65:import_set_state_nolock()) ffff9dd883fdf800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1789263855.117237:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd883f59800/0xce1582440fb1e9c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xce1582440fb1e9c7 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263855.117241:0:17944:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff9dd8841a2600/0xce1582440fb1f0f8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xce1582440fb1f0ff expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263855.117256:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883f59800 already unused, calling callback (ffffffffc12b1c20) 00010000:00010000:3.0:1789263855.117257:0:17944:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:0.0:1789263855.117262:0:17180:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd883f59800/0xce1582440fb1e9c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xce1582440fb1e9c7 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263855.117268:0:17944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd8841a2600/0xce1582440fb1f0f8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xce1582440fb1f0ff expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263855.117271:0:17180:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd883f59800/0xce1582440fb1e9c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xce1582440fb1e9c7 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1789263855.117277:0:20915:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dd883fdd000): rc 0 00000020:00000080:1.0:1789263855.117285:0:20915:0:(genops.c:885:class_export_put()) final put ffff9dd883fdd000/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:3.0:1789263855.117286:0:17944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd8841a2600/0xce1582440fb1f0f8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xce1582440fb1f0ff expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789263855.117288:0:17180:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd883f59800/0xce1582440fb1e9c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xce1582440fb1e9c7 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1789263855.117298:0:20915:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9dd9bfa36000), last request at 1789263853 00000020:00000080:1.0:1789263855.117306:0:20915:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1ec52 10000000:01000000:0.0:1789263855.117306:0:17180:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1789263855.117313:0:17180:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00000100:00080000:1.0:1789263855.117316:0:20915:0:(import.c:65:import_set_state_nolock()) ffff9dd9c08ee800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1789263855.117322:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789263855.117323:0:17180:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1789263855.117327:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263855.117331:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1789263855.117336:0:20915:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dd9bfa36000): rc 0 00000020:00000080:1.0:1789263855.117339:0:20915:0:(genops.c:885:class_export_put()) final put ffff9dd9bfa36000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1789263855.117340:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd883fdd000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00010000:00010000:0.0:1789263855.117345:0:17180:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff9dd883f59800/0xce1582440fb1e9c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xce1582440fb1e9c7 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1789263855.117351:0:20915:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9dd991568800), last request at 1789263818 00010000:00010000:0.0:1789263855.117353:0:17180:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00000080:1.0:1789263855.117359:0:20915:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1eb9c 00010000:00010000:0.0:1789263855.117364:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd883f59800/0xce1582440fb1e9c0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xce1582440fb1e9c7 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789263855.117366:0:20915:0:(import.c:65:import_set_state_nolock()) ffff9dd99156e000 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1789263855.117376:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd9bfa36000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00010000:00010000:0.0:1789263855.117377:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd883f59800/0xce1582440fb1e9c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xce1582440fb1e9c7 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1789263855.117382:0:20915:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dd991568800): rc 0 00000020:00000080:1.0:1789263855.117389:0:20915:0:(genops.c:885:class_export_put()) final put ffff9dd991568800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:1.0:1789263855.117396:0:20915:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9dd99156a000), last request at 1789263818 00010000:00010000:0.0:1789263855.117396:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263855.117400:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789263855.117403:0:20915:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1eb3a 00010000:00010000:0.0:1789263855.117405:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789263855.117411:0:20915:0:(import.c:65:import_set_state_nolock()) ffff9dd985680800 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1789263855.117413:0:479:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd883fdf800 for lustre-MDT0000 00000020:00000080:3.0:1789263855.117420:0:479:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd9c08ee800 for lustre-MDT0000 00000100:00100000:0.0:1789263855.117420:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883b6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:de026c8f-6636-4fc7-8061-42c8092f00f0:3619:1876178898151168:0@lo:103:ldlm_bl.0 00000001:00000004:1.0:1789263855.117424:0:20915:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934675 00000020:00000080:3.0:1789263855.117429:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd991568800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1789263855.117457:0:479:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd99156e000 for lustre-MDT0000 00010000:00010000:3.0:1789263855.117469:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789263855.117469:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1789263855.117500:0:20915:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dd99156a000): rc 0 00000100:00100000:0.0:1789263855.117506:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000004:00000080:1.0:1789263855.117508:0:20915:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb38e456f3ae0 00000100:00100000:0.0:1789263855.117514:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:de026c8f-6636-4fc7-8061-42c8092f00f0:3619:1876178898151040:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1789263855.117527:0:20915:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789263855.117531:0:20915:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00100000:0.0:1789263855.117539:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789263855.117570:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789263855.117712:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789263855.117730:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898151168 00000100:00100000:2.0:1789263855.117736:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898151168 00000100:00100000:2.0:1789263855.117777:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898151040 00000100:00100000:2.0:1789263855.117780:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898151040 00000100:00100000:2.0:1789263855.117801:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789263855.117808:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:de026c8f-6636-4fc7-8061-42c8092f00f0+24:3619:x1876178898151168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789263855.117817:0:17178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789263855.117829:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd9bfa22200/0xce1582440fb1f0ff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xce1582440fb1f0f8 expref: 24 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263855.117840:0:17178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789263855.117871:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:de026c8f-6636-4fc7-8061-42c8092f00f0+23:3619:x1876178898151168:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263855.117877:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789263855.117890:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789263855.117895:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:de026c8f-6636-4fc7-8061-42c8092f00f0+22:3619:x1876178898151040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789263855.117901:0:17178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789263855.117908:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd883f58800/0xce1582440fb1ed1d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xce1582440fb1ed16 expref: 22 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263855.117917:0:17178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789263855.117946:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:de026c8f-6636-4fc7-8061-42c8092f00f0+21:3619:x1876178898151040:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263855.117962:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:3.0:1789263855.117965:0:20218:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789263855.117976:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883b6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:de026c8f-6636-4fc7-8061-42c8092f00f0:3621:1876178898150912:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789263855.117981:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de026c8f-6636-4fc7-8061-42c8092f00f0:3620:1876178898151296:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789263855.118018:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263855.118028:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263855.118122:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898150912 00000100:00100000:0.0:1789263855.118127:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898150912 00000100:00100000:0.0:1789263855.118163:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898151296 00000100:00100000:0.0:1789263855.118167:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898151296 00000100:00100000:2.0:1789263855.118227:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789263855.118241:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789263855.118250:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883b6c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de026c8f-6636-4fc7-8061-42c8092f00f0+22:3620:x1876178898151296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789263855.118259:0:17177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789263855.118276:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd9bb805600/0xce1582440fb1e9c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xce1582440fb1e9c0 expref: 22 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263855.118286:0:17177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789263855.118322:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883b6c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de026c8f-6636-4fc7-8061-42c8092f00f0+21:3620:x1876178898151296:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263855.118329:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789263855.118368:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de026c8f-6636-4fc7-8061-42c8092f00f0:3620:1876178898151296:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789263855.118370:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:de026c8f-6636-4fc7-8061-42c8092f00f0:3619:1876178898151040:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789263855.118384:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883b6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:de026c8f-6636-4fc7-8061-42c8092f00f0:3619:1876178898151168:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789263855.118466:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9904fc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de026c8f-6636-4fc7-8061-42c8092f00f0+20:3621:x1876178898150912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789263855.118475:0:17179:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789263855.118484:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd883e73200/0xce1582440fb1e9d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xce1582440fb1e9ce expref: 20 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263855.118494:0:17179:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:1.0:1789263855.118496:0:20915:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1789263855.118511:0:20915:0:(import.c:65:import_set_state_nolock()) ffff9dd882698000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789263855.118531:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9904fc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de026c8f-6636-4fc7-8061-42c8092f00f0+19:3621:x1876178898150912:12345-0@lo:103:ldlm_bl.0 Request processed in 296us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263855.118538:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789263855.118554:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882434700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1876178898151424:0@lo:39:umount.0 00000100:00100000:0.0:1789263855.118564:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883b6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:de026c8f-6636-4fc7-8061-42c8092f00f0:3621:1876178898150912:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789263855.118595:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263855.118621:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898151424 00000100:00100000:1.0:1789263855.118626:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898151424 00000100:00100000:1.0:1789263855.118660:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789263855.118668:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1876178898151424:12345-0@lo:39:umount.0 00000020:00000080:1.0:1789263855.118690:0:17196:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1ebe9 00000100:00080000:1.0:1789263855.118697:0:17196:0:(import.c:65:import_set_state_nolock()) ffff9dd882b2e800 : changing import state from FULL to CLOSED 00000100:00080000:3.0:1789263855.118711:0:20915:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789263855.118715:0:20915:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000001:00000004:1.0:1789263855.118717:0:17196:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1789263855.118724:0:20915:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9dd88297ce00 x1876178898145792/t8589934600(8589934600) o1000->lustre-OST0000-osc-MDT0000@0@lo:24/4 lens 408/4320 e 0 to 0 dl 1789263863 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'mdt00_002.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1789263855.118740:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789263855.118749:0:20915:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934600 committed transno 8589934598 00000004:00080000:3.0:1789263855.118777:0:20915:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789263855.118818:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3617:x1876178898151424:12345-0@lo:39:umount.0 Request processed in 150us (225us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1789263855.118825:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:2.0:1789263855.118833:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd882698000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1789263855.118838:0:20915:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:2.0:1789263855.118839:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882434700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1876178898151424:0@lo:39:umount.0 00000100:00080000:3.0:1789263855.118851:0:20915:0:(import.c:65:import_set_state_nolock()) ffff9dd9c088f800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1789263855.118864:0:20915:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789263855.118866:0:20915:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934601 gen 3 00000100:00100000:2.0:1789263855.118873:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883b6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1876178898151552:0@lo:9:umount.0 00000004:00080000:3.0:1789263855.118876:0:20915:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789263855.118903:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263855.118924:0:19981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898151552 00000100:00100000:1.0:1789263855.118934:0:19981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898151552 00000100:00080000:3.0:1789263855.118940:0:20915:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1789263855.118951:0:20915:0:(import.c:65:import_set_state_nolock()) ffff9dd9bf998000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1789263855.118974:0:19981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789263855.118981:0:19981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3617:x1876178898151552:12345-0@lo:9:umount.0 00000100:00100000:0.0:1789263855.118995:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883b6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1876178898151680:0@lo:9:umount.0 00000020:00000080:1.0:1789263855.118996:0:19981:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1ed55 00000100:00080000:1.0:1789263855.119004:0:19981:0:(import.c:65:import_set_state_nolock()) ffff9dd883817800 : changing import state from FULL to CLOSED 00000100:00080000:2.0:1789263855.119025:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789263855.119032:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00000004:1.0:1789263855.119041:0:19981:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000020:00080000:3.0:1789263855.119063:0:20915:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9dd9890e8000) has no exports 00000100:00100000:0.0:1789263855.119074:0:18698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898151680 00000100:00100000:0.0:1789263855.119100:0:18698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898151680 00000100:00080000:3.0:1789263855.119130:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789263855.119149:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00010000:00010000:3.0:1789263855.119159:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789263855.119160:0:18698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1876178898151680:12345-0@lo:9:umount.0 00000100:00100000:1.0:1789263855.119174:0:19981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3617:x1876178898151552:12345-0@lo:9:umount.0 Request processed in 192us (269us total) trans 0 rc 0/0 00000020:00000080:0.0:1789263855.119176:0:18698:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1ed5c 00000100:00080000:0.0:1789263855.119185:0:18698:0:(import.c:65:import_set_state_nolock()) ffff9dd987d92800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1789263855.119186:0:19981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789263855.119218:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934600 gen 3 00000100:00080000:1.0:1789263855.119223:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd9c088f800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00010000:00010000:3.0:1789263855.119229:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789263855.119233:0:3617:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1789263855.119236:0:3617:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000001:00000004:0.0:1789263855.119238:0:18698:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934601 00000100:00100000:1.0:1789263855.119240:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883b6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1876178898151552:0@lo:9:umount.0 00000100:00100000:0.0:1789263855.119337:0:18698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3617:x1876178898151680:12345-0@lo:9:umount.0 Request processed in 180us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263855.119345:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:3.0:1789263855.119363:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd9bf998000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1789263855.119373:0:3617:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789263855.119375:0:3617:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789263855.119379:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883b6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1876178898151680:0@lo:9:umount.0 00000100:00100000:0.0:1789263855.149374:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883b6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898151808:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789263855.149447:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263855.149611:0:18524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898151808 00000100:00100000:1.0:1789263855.149620:0:18524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898151808 00000100:00100000:1.0:1789263855.149664:0:18524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789263855.149671:0:18524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3621:x1876178898151808:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:1.0:1789263855.149678:0:18524:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1789263855.149759:0:18524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3621:x1876178898151808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (311us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789263855.149765:0:18524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:02020000:0.0:1789263855.149938:0:3621:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:0.0:1789263855.156887:0:3621:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789263855.156922:0:3621:0:(import.c:65:import_set_state_nolock()) ffff9dd988506800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789263855.156929:0:3621:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1789263855.165765:0:3621:0:(import.c:65:import_set_state_nolock()) ffff9dd988506800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789263855.166316:0:3621:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 261 00000100:00080000:0.0:1789263855.166329:0:3621:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9dd988506800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:1.0:1789263855.166634:0:3621:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd882437800 x1876178898151936/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789263855.166774:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882437800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1876178898151936:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1789263855.166866:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263855.167303:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898151936 00000100:00100000:1.0:1789263855.167315:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898151936 00000100:00100000:1.0:1789263855.167371:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789263855.167382:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883b6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3617:x1876178898151936:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:1.0:1789263855.167423:0:17196:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1789263855.172706:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883b6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3617:x1876178898151936:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 5311us (5826us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789263855.172726:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:3.0:1789263855.172911:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd988506800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789263855.172918:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789263855.172922:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882437800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1876178898151936:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1789263855.661545:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883b6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898152064:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789263855.661655:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263855.661713:0:18701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898152064 00000100:00100000:3.0:1789263855.661725:0:18701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898152064 00000100:00080000:2.0:1789263855.661816:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789263855.661817:0:18701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789263855.661832:0:18701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876178898152064:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789263855.661893:0:18701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789263855.661962:0:18701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876178898152064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 132us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263855.661969:0:18701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789263855.662147:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883b6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898152064:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1789263855.917290:0:20218:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789263856.109407:0:17227:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789263856.109421:0:17227:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789263856.109448:0:17227:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 4 count 4 00000040:00080000:3.0:1789263856.109459:0:17227:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1789263856.941237:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263857.965441:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789263858.733787:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789263858.733792:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789263858.733795:0:38:0:(import.c:65:import_set_state_nolock()) ffff9dd988506800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789263858.733803:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 297 00000100:00080000:0.0:1789263858.733808:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789263858.733815:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9dd988506800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:2.0:1789263858.733818:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789263858.733837:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd98ff7f480 x1876178898152320/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789263858.733843:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:de026c8f-6636-4fc7-8061-42c8092f00f0:3618:1876178898152192:0@lo:400:kworker.0 00000100:00100000:1.0:1789263858.733895:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1876178898152320:0@lo:38:kworker.0 00000100:00100000:2.0:1789263858.733922:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263858.733989:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876178898152704:0@lo:400:kworker.0 00000100:00100000:2.0:1789263858.734017:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263858.734048:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1876178898153216:0@lo:400:kworker.0 00000100:00100000:2.0:1789263858.734072:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263858.734125:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1876178898152832:0@lo:400:kworker.0 00000100:00100000:2.0:1789263858.734157:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898152704 00000100:00100000:0.0:1789263858.734162:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263858.734163:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898152448:0@lo:400:kworker.0 00000100:00100000:2.0:1789263858.734166:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898152704 00000100:00100000:3.0:1789263858.734198:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263858.734207:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898153216 00000100:00100000:2.0:1789263858.734209:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898152832 00000100:00100000:0.0:1789263858.734212:0:18722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898153216 00000100:00100000:2.0:1789263858.734215:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898152832 00000100:00100000:1.0:1789263858.734223:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263858.734224:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1876178898152960:0@lo:400:kworker.0 00000100:00100000:2.0:1789263858.734246:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789263858.734254:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789263858.734256:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263858.734260:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1876178898153216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263858.734262:0:18722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3618:x1876178898152704:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1789263858.734272:0:18722:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1789263858.734273:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789263858.734279:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898152576:0@lo:400:kworker.0 00000100:00100000:1.0:1789263858.734286:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898152192 00000100:00100000:1.0:1789263858.734292:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898152192 00000100:00100000:3.0:1789263858.734321:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263858.734329:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789263858.734335:0:18722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3618:x1876178898152704:12345-0@lo:400:kworker.0 Request processed in 71us (314us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789263858.734342:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd990737450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+19:3618:x1876178898152192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263858.734347:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789263858.734349:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1876178898153216:12345-0@lo:400:kworker.0 Request processed in 90us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263858.734350:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1876178898153088:0@lo:400:kworker.0 00000100:00100000:2.0:1789263858.734363:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789263858.734368:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898152960 00000100:00100000:0.0:1789263858.734372:0:18722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898152960 00000100:00100000:2.0:1789263858.734390:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789263858.734394:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263858.734396:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd990737450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de026c8f-6636-4fc7-8061-42c8092f00f0+19:3618:x1876178898152192:12345-0@lo:400:kworker.0 Request processed in 56us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263858.734401:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3619:x1876178898152832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789263858.734410:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000020:00080000:2.0:1789263858.734412:0:17192:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1789263858.734422:0:18696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898152448 00000100:00100000:3.0:1789263858.734427:0:18696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898152448 00000100:00100000:0.0:1789263858.734444:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898153088 00000100:00100000:0.0:1789263858.734447:0:18722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898153088 00000100:00100000:1.0:1789263858.734455:0:20485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789263858.734461:0:18696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898152576 00000100:00100000:2.0:1789263858.734463:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3619:x1876178898152832:12345-0@lo:400:kworker.0 Request processed in 61us (300us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789263858.734466:0:18696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898152576 00000100:00100000:1.0:1789263858.734470:0:20485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883b6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1876178898152960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263858.734470:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789263858.734483:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789263858.734484:0:18722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883b6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3620:x1876178898153088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263858.734491:0:18696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000020:00080000:0.0:1789263858.734493:0:18722:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1789263858.734499:0:18696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883b6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898152448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789263858.734519:0:18699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789263858.734522:0:20485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883b6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1876178898152960:12345-0@lo:400:kworker.0 Request processed in 58us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263858.734529:0:18722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883b6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3620:x1876178898153088:12345-0@lo:400:kworker.0 Request processed in 46us (139us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789263858.734535:0:18699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883b6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898152576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789263858.734537:0:20485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789263858.734539:0:18696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883b6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898152448:12345-0@lo:400:kworker.0 Request processed in 37us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263858.734546:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789263858.734559:0:18696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789263858.734569:0:18524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898152320 00000100:00100000:1.0:1789263858.734574:0:18524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898152320 00000100:00100000:2.0:1789263858.734583:0:18699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883b6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898152576:12345-0@lo:400:kworker.0 Request processed in 54us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263858.734592:0:18699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789263858.734601:0:18524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789263858.734607:0:18524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882434e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3617:x1876178898152320:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1789263858.734618:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898152576:0@lo:400:kworker.0 00010000:02000000:1.0:1789263858.734622:0:18524:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:0.0:1789263858.734623:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789263858.734629:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789263858.734634:0:3620:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789263858.734634:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789263858.734639:0:3620:0:(import.c:65:import_set_state_nolock()) ffff9dd883814000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1789263858.734644:0:3620:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1789263858.734647:0:3618:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789263858.734654:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9dd99f96d000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:00080000:0.0:1789263858.734658:0:3619:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:02000400:2.0:1789263858.734661:0:3618:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1789263858.734663:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9dd8810d3800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:00080000:2.0:1789263858.734667:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9dd99f96d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:02000400:0.0:1789263858.734668:0:3619:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1789263858.734675:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9dd8810d3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789263858.734676:0:3618:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 261 00000100:00080000:0.0:1789263858.734682:0:3619:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 266 00000100:00080000:2.0:1789263858.734685:0:3618:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9dd99f96d000 using connection 192.168.203.120@tcp/0@lo 00000100:00080000:0.0:1789263858.734690:0:3619:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9dd8810d3800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:0.0:1789263858.734708:0:3619:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd989aedc00 x1876178898153344/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789263858.734713:0:3618:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd99f9a4a80 x1876178898153472/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789263858.734728:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1876178898152832:0@lo:400:kworker.0 00000100:00100000:2.0:1789263858.734731:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876178898152704:0@lo:400:kworker.0 00010000:00080000:2.0:1789263858.734751:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd9bfaac380 x1876178898153216/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263874 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263858.734754:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989aedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3617:1876178898153344:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1789263858.734768:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1876178898153216:0@lo:400:kworker.0 00000100:00100000:2.0:1789263858.734778:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:de026c8f-6636-4fc7-8061-42c8092f00f0:3618:1876178898152192:0@lo:400:kworker.0 00000100:00100000:0.0:1789263858.734785:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263858.734801:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898153344 00000100:00100000:2.0:1789263858.734805:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898153344 00000100:00100000:0.0:1789263858.734805:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3617:1876178898153472:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1789263858.734823:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789263858.734829:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263858.734834:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989aeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3617:x1876178898153344:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:2.0:1789263858.734844:0:17192:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1789263858.734855:0:20485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898153472 00000100:00100000:0.0:1789263858.734859:0:20485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898153472 00000100:00100000:2.0:1789263858.734884:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989aeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3617:x1876178898153344:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 50us (99us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789263858.734888:0:20485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789263858.734897:0:20485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989aef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3617:x1876178898153472:12345-0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1789263858.734898:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00010000:02000000:0.0:1789263858.734909:0:20485:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:2.0:1789263858.734931:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd8810d3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789263858.734938:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789263858.734938:0:20485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989aef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3617:x1876178898153472:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 40us (110us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789263858.734944:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989aedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3617:1876178898153344:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1789263858.734949:0:20485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:2.0:1789263858.734961:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd99f96d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789263858.734966:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789263858.734971:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3617:1876178898153472:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1789263858.737766:0:18524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882434e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3617:x1876178898152320:12345-0@lo:38:kworker.0 Request processed in 3154us (3541us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789263858.737777:0:18524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:2.0:1789263858.737882:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd988506800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789263858.737887:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789263858.737891:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1876178898152320:0@lo:38:kworker.0 00000100:00080000:3.0:1789263858.747793:0:3620:0:(import.c:65:import_set_state_nolock()) ffff9dd883814000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789263858.747804:0:3620:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 272 00000100:00080000:3.0:1789263858.747814:0:3620:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9dd883814000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:3.0:1789263858.747852:0:3620:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd883b6ed80 x1876178898153600/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789263858.747886:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1876178898153088:0@lo:400:kworker.0 00000100:00100000:3.0:1789263858.747916:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898152448:0@lo:400:kworker.0 00010000:00080000:3.0:1789263858.747925:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd9bfaac700 x1876178898152960/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263874 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263858.747932:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1876178898152960:0@lo:400:kworker.0 00000100:00100000:2.0:1789263858.748165:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883b6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3617:1876178898153600:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1789263858.748226:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263858.748277:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898153600 00000100:00100000:0.0:1789263858.748285:0:18722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898153600 00000100:00100000:0.0:1789263858.748326:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789263858.748334:0:18722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3617:x1876178898153600:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:0.0:1789263858.748348:0:18722:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1789263858.748397:0:18722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3617:x1876178898153600:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 62us (170us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789263858.748404:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:3.0:1789263858.748475:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd883814000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789263858.748480:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789263858.748483:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883b6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3617:1876178898153600:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:3.0:1789263858.989594:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789263859.245702:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989aef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898153728:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789263859.245773:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263859.245860:0:19982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898153728 00000100:00100000:3.0:1789263859.245868:0:19982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898153728 00000100:00100000:3.0:1789263859.245923:0:19982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789263859.245948:0:19982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1876178898153728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789263859.245978:0:19982:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1789263859.246041:0:19982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1876178898153728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263859.246049:0:19982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789263859.246062:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989aef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898153728:0@lo:13:osp-pre-0-1.0 00000001:00100000:1.0:1789263859.759856:0:18693:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789263859.759865:0:18693:0:(genops.c:885:class_export_put()) final put ffff9dd883813000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1789263859.759865:0:19510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789263859.759872:0:19510:0:(genops.c:885:class_export_put()) final put ffff9dd987d93800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1789263859.759889:0:18693:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9a1530e0-880b-4d94-ada1-a3a40d18af45 00000020:00000080:1.0:1789263859.759892:0:18693:0:(genops.c:885:class_export_put()) final put ffff9dd987d93000/9a1530e0-880b-4d94-ada1-a3a40d18af45 00000020:00000080:3.0:1789263859.760271:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd883813000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000001:00100000:0.0:1789263859.760277:0:19510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9a1530e0-880b-4d94-ada1-a3a40d18af45 00000001:00100000:1.0:1789263859.760278:0:18693:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of aea5b0bf-5091-4b59-8387-6d6e4df18cfc 00000020:00000080:0.0:1789263859.760283:0:19510:0:(genops.c:885:class_export_put()) final put ffff9dd98850c800/9a1530e0-880b-4d94-ada1-a3a40d18af45 00000020:00000080:1.0:1789263859.760284:0:18693:0:(genops.c:885:class_export_put()) final put ffff9dd883817000/aea5b0bf-5091-4b59-8387-6d6e4df18cfc 00000020:00000080:3.0:1789263859.760327:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd987d93800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1789263859.760351:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd987d93000/9a1530e0-880b-4d94-ada1-a3a40d18af45 for lustre-OST0000 00000020:00000080:3.0:1789263859.760373:0:479:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd883817800 for lustre-OST0000 00000020:00000080:3.0:1789263859.760379:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd883817000/aea5b0bf-5091-4b59-8387-6d6e4df18cfc for lustre-OST0000 00000020:00000080:3.0:1789263859.760399:0:479:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd987d92800 for lustre-OST0001 00000001:00100000:1.0:1789263859.760410:0:17172:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1789263859.760412:0:17923:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789263859.760415:0:17172:0:(genops.c:885:class_export_put()) final put ffff9dd99156a000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789263859.760418:0:479:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd987d90800 for lustre-OST0000 00000020:00000080:3.0:1789263859.760427:0:479:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd883811000 for lustre-OST0000 00000001:00080000:2.0:1789263859.760428:0:17923:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000001:00100000:1.0:1789263859.760429:0:17172:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9a1530e0-880b-4d94-ada1-a3a40d18af45 00000020:00000080:3.0:1789263859.760434:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd99156a000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1789263859.760435:0:17923:0:(genops.c:885:class_export_put()) final put ffff9dd882b2f800/lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1789263859.760438:0:17172:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934675 is committed 00000020:00000080:1.0:1789263859.760443:0:17172:0:(genops.c:885:class_export_put()) final put ffff9dd9860fc800/9a1530e0-880b-4d94-ada1-a3a40d18af45 00000001:00100000:2.0:1789263859.760449:0:17923:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 9a1530e0-880b-4d94-ada1-a3a40d18af45 00000001:00100000:1.0:1789263859.760453:0:17172:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of aea5b0bf-5091-4b59-8387-6d6e4df18cfc 00000001:00080000:2.0:1789263859.760460:0:17923:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000001:00080000:1.0:1789263859.760461:0:17172:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934674 is committed 00000020:00000080:2.0:1789263859.760466:0:17923:0:(genops.c:885:class_export_put()) final put ffff9dd987d91800/9a1530e0-880b-4d94-ada1-a3a40d18af45 00000020:00000080:1.0:1789263859.760472:0:17172:0:(genops.c:885:class_export_put()) final put ffff9dd883815000/aea5b0bf-5091-4b59-8387-6d6e4df18cfc 00000001:00100000:2.0:1789263859.760479:0:17923:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of aea5b0bf-5091-4b59-8387-6d6e4df18cfc 00000020:00000080:3.0:1789263859.760483:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd882b2f800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00080000:1.0:1789263859.760487:0:17172:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967518 batchid updated 00000001:00080000:2.0:1789263859.760488:0:17923:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:2.0:1789263859.760493:0:17923:0:(genops.c:885:class_export_put()) final put ffff9dd987d95000/aea5b0bf-5091-4b59-8387-6d6e4df18cfc 00000020:00080000:1.0:1789263859.760513:0:17231:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9dd9b7a8c780 refcount 1 committed 1 result 0 batchid 4294967518 00000020:00080000:1.0:1789263859.760518:0:17231:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9dd882508c00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9dd9b7a8c0c0 00000020:00000080:3.0:1789263859.760523:0:479:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd985680800 for lustre-MDT0000 00000020:00080000:1.0:1789263859.760524:0:17231:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9dd882508800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9dd9bf66ae00 00000020:00000080:3.0:1789263859.760534:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd9860fc800/9a1530e0-880b-4d94-ada1-a3a40d18af45 for lustre-MDT0000 00000020:00000080:3.0:1789263859.760567:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd987d91800/9a1530e0-880b-4d94-ada1-a3a40d18af45 for lustre-MDT0001 00000020:00000080:3.0:1789263859.760611:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd883815000/aea5b0bf-5091-4b59-8387-6d6e4df18cfc for lustre-MDT0000 00000020:00000080:3.0:1789263859.760644:0:479:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd882b2e800 for lustre-MDT0001 00000020:00000080:3.0:1789263859.760648:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd987d95000/aea5b0bf-5091-4b59-8387-6d6e4df18cfc for lustre-MDT0001 00000020:00000080:3.0:1789263859.760672:0:479:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd9862e3800 for lustre-MDT0000 00000020:00000080:3.0:1789263859.760675:0:479:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd987d96000 for lustre-MDT0001 00000020:00000080:3.0:1789263859.760678:0:479:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd883810000 for lustre-MDT0000 00000020:00000080:3.0:1789263859.760683:0:479:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd987d97000 for lustre-MDT0001 00000001:00100000:0.0:1789263859.760837:0:19510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of aea5b0bf-5091-4b59-8387-6d6e4df18cfc 00000020:00000080:1.0:1789263859.760841:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd98850c800/9a1530e0-880b-4d94-ada1-a3a40d18af45 for lustre-OST0001 00000020:00000080:0.0:1789263859.760842:0:19510:0:(genops.c:885:class_export_put()) final put ffff9dd8810d4800/aea5b0bf-5091-4b59-8387-6d6e4df18cfc 00000020:00000080:1.0:1789263859.760875:0:479:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd9ac8ff800 for lustre-OST0001 00000020:00000080:1.0:1789263859.760880:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd8810d4800/aea5b0bf-5091-4b59-8387-6d6e4df18cfc for lustre-OST0001 00000020:00000080:1.0:1789263859.760891:0:479:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd8810d4000 for lustre-OST0001 00000020:00080000:2.0:1789263859.766551:0:20915:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9dd9890e8000) has no exports 00000020:00000080:2.0:1789263859.791232:0:20915:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1ea1b 00000020:00000080:2.0:1789263859.791247:0:20915:0:(genops.c:885:class_export_put()) final put ffff9dd9885d4000/lustre-QMT0000_UUID 00000020:01000000:2.0:1789263859.791268:0:20915:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1789263859.791277:0:20915:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789263859.791286:0:20915:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789263859.791289:0:20915:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9dd8838999b8) has no exports 00000020:00000080:1.0:1789263859.791296:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd9885d4000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1789263859.791598:0:20915:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1ea14 00000020:00000080:2.0:1789263859.791604:0:20915:0:(genops.c:885:class_export_put()) final put ffff9dd98850f000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789263859.791659:0:20915:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789263859.791665:0:20915:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1789263859.791668:0:20915:0:(genops.c:885:class_export_put()) final put ffff9dd9bb781800/lustre-QMT0000_UUID 00000020:00000080:2.0:1789263859.791669:0:20915:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd9bb781800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1789263859.791675:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd98850f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1789263859.791678:0:20915:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:2.0:1789263859.791811:0:20915:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9dd883c8c120 - data ffff9dd9b3c520d8/ffff9dd8827e5400 00000020:01000000:2.0:1789263859.791911:0:20915:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9dd883c8ce40 - data ffff9dd8821975e8/ffff9dd9c1b64800 00000001:00000004:2.0:1789263859.805366:0:20915:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934675 00000100:00080000:3.0:1789263859.824883:0:20915:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789263859.824903:0:20915:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789263859.824917:0:20915:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9dd882434700 x1876178898151424/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789263865 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263859.824945:0:20915:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1789263859.826029:0:20915:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789263859.826034:0:20915:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934600 gen 4 00000004:00080000:3.0:1789263859.826054:0:20915:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789263859.826057:0:20915:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789263859.826319:0:17215:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789263859.826324:0:17215:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 2 count 1 00000040:00080000:0.0:1789263859.826334:0:17215:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:3.0:1789263859.826921:0:20915:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789263859.826925:0:20915:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934601 gen 4 00000004:00080000:3.0:1789263859.826938:0:20915:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789263859.826941:0:20915:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1789263859.827144:0:17217:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1789263859.827148:0:17217:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 3 count 1 00000040:00080000:3.0:1789263859.827158:0:17217:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:0.0:1789263859.827868:0:20915:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1e9e3 00000020:00000080:0.0:1789263859.827878:0:20915:0:(genops.c:885:class_export_put()) final put ffff9dd982b9c000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789263859.828245:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd982b9c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789263859.829124:0:20915:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1e9f8 00000020:00000080:0.0:1789263859.829139:0:20915:0:(genops.c:885:class_export_put()) final put ffff9dd88269c000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1789263859.829153:0:20915:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1789263859.829160:0:20915:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789263859.829176:0:20915:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789263859.829181:0:20915:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9dd9890e99b8) has no exports 00000020:00000080:1.0:1789263859.829231:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd88269c000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:0.0:1789263859.829399:0:20915:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1789263859.829408:0:20915:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1ea5a 00000020:00000080:0.0:1789263859.829413:0:20915:0:(genops.c:885:class_export_put()) final put ffff9dd9c088a800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1789263859.829425:0:20915:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1789263859.829429:0:20915:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789263859.829434:0:20915:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789263859.829437:0:20915:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9dd987318000) has no exports 00000020:00000080:0.0:1789263859.829444:0:20915:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1ea53 00000020:00000080:0.0:1789263859.829448:0:20915:0:(genops.c:885:class_export_put()) final put ffff9dd9bf99a000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789263859.829457:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd9c088a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1789263859.829469:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd9bf99a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1789263859.829873:0:20915:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1789263859.829877:0:20915:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789263859.829880:0:20915:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934601 gen 5 00000004:00080000:0.0:1789263859.829885:0:20915:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789263859.829888:0:20915:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789263859.829921:0:20915:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789263859.829928:0:20915:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789263859.829934:0:479:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd9bf998000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1789263859.829934:0:20915:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1ea45 00000020:00000080:0.0:1789263859.829941:0:20915:0:(genops.c:885:class_export_put()) final put ffff9dd9c0888800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789263859.829945:0:479:0:(genops.c:885:class_export_put()) final put ffff9dd9c0889000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789263859.829949:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd9c0889000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1789263859.829952:0:20915:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:01000000:3.0:1789263859.829956:0:479:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789263859.829957:0:20915:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789263859.829962:0:20915:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789263859.829966:0:20915:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9dd98731b370) has no exports 00000020:00000080:0.0:1789263859.829970:0:20915:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1ea3e 00000020:00000080:0.0:1789263859.829973:0:20915:0:(genops.c:885:class_export_put()) final put ffff9dd9c088d000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789263859.830053:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd9c0888800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1789263859.830065:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd9c088d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1789263859.830450:0:20915:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1789263859.830453:0:20915:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789263859.830455:0:20915:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934600 gen 5 00000004:00080000:0.0:1789263859.830459:0:20915:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789263859.830461:0:20915:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789263859.830480:0:479:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd9c088f800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1789263859.830500:0:20915:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789263859.830510:0:20915:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789263859.830513:0:20915:0:(genops.c:885:class_export_put()) final put ffff9dd9c088a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789263859.830516:0:20915:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd9c088a000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1789263859.830521:0:20915:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000004:01000000:0.0:1789263859.830579:0:20915:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1789263859.830584:0:20915:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1ea30 00000020:00000080:0.0:1789263859.830589:0:20915:0:(genops.c:885:class_export_put()) final put ffff9dd9c088b000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1789263859.830600:0:20915:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:0.0:1789263859.830604:0:20915:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789263859.830608:0:20915:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789263859.830612:0:20915:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff9dd9890eb370) has no exports 00000020:00000080:0.0:1789263859.830616:0:20915:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1ea29 00000020:00000080:3.0:1789263859.830622:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd9c088b000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1789263859.830622:0:20915:0:(genops.c:885:class_export_put()) final put ffff9dd88269e800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789263859.830639:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd88269e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1789263859.832127:0:20915:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1789263859.832133:0:20915:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789263859.832136:0:20915:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789263859.832141:0:20915:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789263859.832175:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd882698000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1789263859.832192:0:20915:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789263859.832200:0:20915:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789263859.832205:0:20915:0:(genops.c:885:class_export_put()) final put ffff9dd88269e000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789263859.832207:0:20915:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd88269e000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1789263859.832217:0:20915:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789263859.832293:0:20915:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789263859.832298:0:20915:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789263859.832301:0:20915:0:(genops.c:885:class_export_put()) final put ffff9dd982b9d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789263859.832328:0:20915:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd982b9d000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1789263859.832332:0:20915:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789263859.832406:0:20915:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1e9ff 00000020:00000080:1.0:1789263859.832411:0:20915:0:(genops.c:885:class_export_put()) final put ffff9dd88269b000/lustre-MDD0000_UUID 00000020:01000000:1.0:1789263859.832420:0:20915:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1789263859.832424:0:20915:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789263859.832428:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd88269b000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1789263859.832429:0:20915:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789263859.832434:0:20915:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9dd9890ecd28) has no exports 00000020:00000080:1.0:1789263859.832460:0:20915:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789263859.832463:0:20915:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1789263859.832466:0:20915:0:(genops.c:885:class_export_put()) final put ffff9dd982b9e000/lustre-MDD0000_UUID 00000020:00000080:1.0:1789263859.832468:0:20915:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd982b9e000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1789263859.832473:0:20915:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1789263859.832509:0:20915:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1ea06 00000020:00000080:1.0:1789263859.832513:0:20915:0:(genops.c:885:class_export_put()) final put ffff9dd882698800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1789263859.832531:0:20915:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dd882a35000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1789263859.832540:0:20915:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dd882a35000 3 00000020:01000004:1.0:1789263859.832543:0:20915:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9dd882a35000 from lustre-MDT0000 00000020:00000080:1.0:1789263859.832566:0:20915:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789263859.832569:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd882698800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789263859.832570:0:20915:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1789263859.832576:0:20915:0:(genops.c:885:class_export_put()) final put ffff9dd982b98000/lustre-MDT0000_UUID 00000020:00000080:1.0:1789263859.832579:0:20915:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd982b98000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1789263859.832586:0:20915:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1789263859.832622:0:20915:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1789263859.832625:0:20915:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1789263859.832627:0:20915:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1789263859.832630:0:20915:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789263859.832633:0:20915:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789263859.832644:0:20915:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9dd9838d5800 de026c8f-6636-4fc7-8061-42c8092f00f0 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789263859.832650:0:20915:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9dd9c09c4d28) has exports, disconnecting them 00000020:00080000:1.0:1789263859.832655:0:20915:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9dd9838d5800), last request at 1789263813 00000020:00000080:1.0:1789263859.832670:0:20915:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1e9ab 00000020:00010000:1.0:1789263859.832677:0:20915:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9dd9838d5800: total 0 00000100:00080000:1.0:1789263859.832681:0:20915:0:(import.c:65:import_set_state_nolock()) ffff9dd9838d4000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1789263859.832693:0:20915:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dd9838d5800): rc 0 00000020:00080000:1.0:1789263859.832697:0:20915:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9dd9c09c4d28) has no exports 00000020:00010000:3.0:1789263859.832701:0:20218:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9dd9838d5800: total 0 00010000:00010000:3.0:1789263859.832755:0:20218:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9dd9838d5800, canceled 0 locks, left on hash table 13. 00000100:00100000:1.0:1789263859.832781:0:17187:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9dd9b7958e00:17187] 2 exiting: rc = 0 00010000:00010000:3.0:1789263859.832786:0:20218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd981530200/0xce1582440fb1ec36 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xce1582440fb1ec2f expref: 14 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263859.832810:0:20218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd9bb805200/0xce1582440fb1eb87 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xce1582440fb1eb80 expref: 13 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263859.832822:0:20218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd981683200/0xce1582440fb1f0f1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xce1582440fb1f0ea expref: 12 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263859.832834:0:20218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd9bb805400/0xce1582440fb1e9b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xce1582440fb1e9b2 expref: 11 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263859.832854:0:20218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd9bb804200/0xce1582440fb1eca6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xce1582440fb1ec9f expref: 10 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263859.832869:0:20218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd9bb804a00/0xce1582440fb1eac3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xce1582440fb1eabc expref: 9 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263859.832889:0:20218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd9bb804400/0xce1582440fb1ecd0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xce1582440fb1ecc9 expref: 8 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263859.832889:0:17185:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9dd9b7959200:17185] 0 exiting: rc = 1 00010000:00010000:3.0:1789263859.832907:0:20218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd9bb804e00/0xce1582440fb1eadf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xce1582440fb1ead8 expref: 7 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263859.832919:0:20218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd9bb804600/0xce1582440fb1ead1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xce1582440fb1eaca expref: 6 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263859.832935:0:20218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd883f58e00/0xce1582440fb1ed0f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xce1582440fb1ed08 expref: 5 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263859.832956:0:20218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd883e72a00/0xce1582440fb1ec0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xce1582440fb1ec05 expref: 4 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263859.832978:0:20218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd9bfa22400/0xce1582440fb1f0e3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xce1582440fb1f0dc expref: 3 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263859.832979:0:17186:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9dd9acb14a00:17186] 1 exiting: rc = 0 00010000:00010000:3.0:1789263859.833004:0:20218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd981682000/0xce1582440fb1f0d5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xce1582440fb1f0ce expref: 2 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263859.833018:0:20218:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9dd9838d5800, canceled 13 locks, left on hash table 0. 00000020:00000080:3.0:1789263859.833043:0:20218:0:(genops.c:885:class_export_put()) final put ffff9dd9838d5800/de026c8f-6636-4fc7-8061-42c8092f00f0 00010000:00010000:3.0:1789263859.833055:0:20218:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263859.833057:0:20218:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263859.833060:0:20218:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789263859.833064:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1789263859.833069:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd9838d5800/de026c8f-6636-4fc7-8061-42c8092f00f0 for MGS 00000100:00100000:1.0:1789263859.833105:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263859.833117:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1789263859.833124:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd9838d4000 for MGS 00000100:00100000:1.0:1789263859.833130:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263859.833141:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263859.833148:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263859.833153:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263859.833159:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263859.833165:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263859.833183:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263859.833188:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263859.833194:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263859.833200:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263859.833205:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263859.833210:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263859.833217:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263859.833224:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263859.833230:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263859.833234:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263859.833239:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263859.833243:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263859.833248:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263859.833253:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263859.833257:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263859.833263:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263859.833274:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263859.833279:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263859.833284:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263859.833288:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263859.833293:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263859.833297:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263859.833302:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263859.833307:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263859.833311:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263859.833316:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263859.833320:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263859.833325:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263859.833330:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263859.833335:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263859.833340:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263859.833345:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263859.833349:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263859.833354:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263859.833359:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263859.833368:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263859.833373:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263859.833377:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263859.833382:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263859.833387:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263859.833392:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263859.833397:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263859.833401:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263859.833406:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263859.833411:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263859.833416:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263859.833421:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263859.833425:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263859.833430:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263859.833435:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263859.833447:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263859.833453:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263859.833458:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263859.833462:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263859.833467:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1789263859.834046:0:20915:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9dd883b2d9c0 - data ffff9dd9836de0d8/ffff9dd9bf6d5400 00000020:01000000:1.0:1789263859.834175:0:20915:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9dd8840bf000 - data ffff9dd9b3e64bd0/ffff9dd99f9a3400 00000020:00000080:1.0:1789263859.834630:0:20915:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1e98f 00000020:00000080:1.0:1789263859.834636:0:20915:0:(genops.c:885:class_export_put()) final put ffff9dd882a36000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1789263859.834646:0:20915:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dd882a35000 from MGS, refs=2 00000020:01000004:1.0:1789263859.834649:0:20915:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dd882a35000 2 00000020:01000004:1.0:1789263859.834652:0:20915:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9dd882a35000 from MGS 00000020:00000080:3.0:1789263859.834658:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd882a36000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789263859.834671:0:20915:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789263859.834676:0:20915:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1789263859.834678:0:20915:0:(genops.c:885:class_export_put()) final put ffff9dd882a37000/MGS 00000020:00000080:1.0:1789263859.834680:0:20915:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd882a37000/MGS for MGS 00000020:01000000:1.0:1789263859.834684:0:20915:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1789263859.834731:0:20915:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1789263859.834735:0:20915:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789263859.834743:0:20915:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789263859.834747:0:20915:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9dd88400e800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789263859.834752:0:20915:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff9dd9873199b8) has exports, disconnecting them 00000020:00080000:1.0:1789263859.834755:0:20915:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9dd88400e800), last request at 1789263814 00000020:00000080:1.0:1789263859.834758:0:20915:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1ea92 00000020:00080000:1.0:1789263859.834766:0:20915:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dd88400e800): rc 0 00000020:00000080:1.0:1789263859.834769:0:20915:0:(genops.c:885:class_export_put()) final put ffff9dd88400e800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1789263859.834784:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd88400e800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1789263859.836135:0:20915:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1789263859.836143:0:20915:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789263859.836147:0:20915:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789263859.836154:0:20915:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789263859.836185:0:479:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd9bf99c800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1789263859.836423:0:20915:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789263859.836429:0:20915:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1789263859.836434:0:20915:0:(genops.c:885:class_export_put()) final put ffff9dd9bf99a800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1789263859.836437:0:20915:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd9bf99a800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1789263859.836445:0:20915:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1789263859.836534:0:20915:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dd882a35000 1 00000020:00000080:0.0:1789263859.836544:0:20915:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1e981 00000020:00000080:0.0:1789263859.836550:0:20915:0:(genops.c:885:class_export_put()) final put ffff9dd882a35800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1789263859.836561:0:20915:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1789263859.836566:0:20915:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789263859.836567:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd882a35800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789263859.836571:0:20915:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789263859.836580:0:20915:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9dd9c09c0000) has no exports 00000020:00000080:0.0:1789263859.854040:0:20915:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789263859.854052:0:20915:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1789263859.854065:0:20915:0:(genops.c:885:class_export_put()) final put ffff9dd882a33000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789263859.854069:0:20915:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd882a33000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1789263859.854121:0:20915:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1789263859.854231:0:20915:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9dd882a36800 00000020:02000400:0.0:1789263859.854323:0:20915:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1789263860.013191:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789263860.781316:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789263860.781353:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883b6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898153856:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789263860.781449:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263860.781886:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898153856 00000100:00100000:1.0:1789263860.781897:0:18700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898153856 00000100:00080000:2.0:1789263860.781955:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789263860.781983:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789263860.781997:0:18700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1876178898153856:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789263860.782023:0:18700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789263860.782144:0:18700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1876178898153856:12345-0@lo:13:osp-pre-1-1.0 Request processed in 150us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263860.782152:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789263860.782271:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883b6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898153856:0@lo:13:osp-pre-1-1.0 00000040:00080000:1.0:1789263861.037772:0:17950:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789263861.038240:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789263861.277865:0:21115:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1789263861.283220:0:21115:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:1.0:1789263861.283271:0:21115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883e73e00/0xce1582440fb1eb80 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1eb87 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263861.283286:0:21115:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883e73e00/0xce1582440fb1eb80 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1eb87 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263861.283295:0:21115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883e73e00/0xce1582440fb1eb80 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xce1582440fb1eb87 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263861.283302:0:21115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff9dd883e73e00/0xce1582440fb1eb80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xce1582440fb1eb87 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263861.283343:0:21115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789263861.283349:0:21115:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:3.0:1789263861.283365:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789263861.283374:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd883e73e00/0xce1582440fb1eb80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xce1582440fb1eb87 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789263861.283378:0:21115:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789263861.283384:0:21115:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00010000:00010000:3.0:1789263861.283386:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883e73e00 already unused, calling callback (ffffffffc12b1c20) 00000100:00080000:1.0:1789263861.283391:0:21115:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 10000000:00010000:3.0:1789263861.283392:0:17181:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd883e73e00/0xce1582440fb1eb80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xce1582440fb1eb87 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789263861.283400:0:21115:0:(import.c:65:import_set_state_nolock()) ffff9dd99f96d000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:3.0:1789263861.283404:0:17181:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd883e73e00/0xce1582440fb1eb80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xce1582440fb1eb87 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789263861.283407:0:21115:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789263861.283409:0:21115:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789263861.283413:0:21115:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:00010000:3.0:1789263861.283422:0:17181:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd883e73e00/0xce1582440fb1eb80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xce1582440fb1eb87 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789263861.283428:0:17181:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789263861.283431:0:17181:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789263861.283433:0:17181:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789263861.283470:0:17181:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff9dd883e73e00/0xce1582440fb1eb80 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xce1582440fb1eb87 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263861.283477:0:17181:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789263861.283509:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd883e73e00/0xce1582440fb1eb80 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xce1582440fb1eb87 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263861.283516:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd883e73e00/0xce1582440fb1eb80 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xce1582440fb1eb87 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263861.283527:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883b6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:de026c8f-6636-4fc7-8061-42c8092f00f0:3621:1876178898153984:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789263861.283529:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263861.283532:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263861.283535:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789263861.283587:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263861.283640:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898153984 00000100:00100000:3.0:1789263861.283649:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898153984 00000100:00100000:3.0:1789263861.283694:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789263861.283702:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3621:x1876178898153984:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1789263861.283709:0:17178:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789263861 with bad export cookie 14849918575156783531 00010000:00010000:1.0:1789263861.284199:0:21115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883e72600/0xce1582440fb1ead8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1eadf expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263861.284206:0:21115:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883e72600/0xce1582440fb1ead8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1eadf expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263861.284210:0:21115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883e72600/0xce1582440fb1ead8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xce1582440fb1eadf expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263861.284213:0:21115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff9dd883e72600/0xce1582440fb1ead8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xce1582440fb1eadf expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263861.284225:0:21115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789263861.284228:0:21115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883e73000/0xce1582440fb1ed08 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1ed0f expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263861.284232:0:21115:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883e73000/0xce1582440fb1ed08 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1ed0f expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263861.284242:0:21115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883e73000/0xce1582440fb1ed08 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xce1582440fb1ed0f expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263861.284246:0:21115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff9dd883e73000/0xce1582440fb1ed08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xce1582440fb1ed0f expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263861.284256:0:21115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789263861.284260:0:21115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd987f51800/0xce1582440fb1f0ea lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f0f1 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263861.284263:0:21115:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd987f51800/0xce1582440fb1f0ea lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1f0f1 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263861.284267:0:21115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd987f51800/0xce1582440fb1f0ea lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xce1582440fb1f0f1 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263861.284271:0:21115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff9dd987f51800/0xce1582440fb1f0ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xce1582440fb1f0f1 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263861.284279:0:21115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1789263861.284282:0:21115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883e72c00/0xce1582440fb1eaca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1ead1 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263861.284286:0:21115:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883e72c00/0xce1582440fb1eaca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1ead1 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263861.284287:0:17944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789263861.284295:0:21115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883e72c00/0xce1582440fb1eaca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xce1582440fb1ead1 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263861.284297:0:17944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd883e72600/0xce1582440fb1ead8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xce1582440fb1eadf expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263861.284317:0:17944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883e72600 already unused, calling callback (ffffffffc12b1c20) 00010000:00010000:1.0:1789263861.284318:0:21115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff9dd883e72c00/0xce1582440fb1eaca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xce1582440fb1ead1 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789263861.284323:0:17944:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd883e72600/0xce1582440fb1ead8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xce1582440fb1eadf expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263861.284334:0:17944:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd883e72600/0xce1582440fb1ead8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xce1582440fb1eadf expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789263861.284342:0:17944:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd883e72600/0xce1582440fb1ead8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xce1582440fb1eadf expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263861.284344:0:21115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:1.0:1789263861.284351:0:21115:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 10000000:01000000:0.0:1789263861.284352:0:17944:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789263861.284357:0:17944:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:0.0:1789263861.284359:0:17944:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00000020:01000004:1.0:1789263861.284382:0:21115:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:1.0:1789263861.284386:0:21115:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00010000:00010000:0.0:1789263861.284390:0:17944:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff9dd883e72600/0xce1582440fb1ead8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xce1582440fb1eadf expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1789263861.284391:0:21115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789263861.284399:0:21115:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00010000:00010000:0.0:1789263861.284399:0:17944:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00080000:1.0:1789263861.284408:0:21115:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9dd990818800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789263861.284415:0:21115:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9dd99f96f000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:0.0:1789263861.284420:0:17944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd883e72600/0xce1582440fb1ead8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xce1582440fb1eadf expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1789263861.284421:0:21115:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff9dd9bf8f0000) has exports, disconnecting them 00000020:00080000:1.0:1789263861.284428:0:21115:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9dd990818800), last request at 1789263858 00010000:00010000:0.0:1789263861.284433:0:17944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd883e72600/0xce1582440fb1ead8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xce1582440fb1eadf expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1789263861.284437:0:21115:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1ecfa 00000100:00080000:1.0:1789263861.284454:0:21115:0:(import.c:65:import_set_state_nolock()) ffff9dd99081f800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1789263861.284454:0:17944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789263861.284461:0:17944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd883e73000/0xce1582440fb1ed08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xce1582440fb1ed0f expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263861.284468:0:17944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883e73000 already unused, calling callback (ffffffffc12b1c20) 10000000:00010000:0.0:1789263861.284471:0:17944:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd883e73000/0xce1582440fb1ed08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xce1582440fb1ed0f expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263861.284480:0:17944:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd883e73000/0xce1582440fb1ed08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xce1582440fb1ed0f expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263861.284483:0:20218:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789263861.284490:0:20218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd987f51800/0xce1582440fb1f0ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xce1582440fb1f0f1 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1789263861.284497:0:21115:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dd990818800): rc 0 10000000:00010000:0.0:1789263861.284501:0:17944:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd883e73000/0xce1582440fb1ed08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xce1582440fb1ed0f expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263861.284502:0:20218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd987f51800 already unused, calling callback (ffffffffc12b1c20) 00000020:00000080:1.0:1789263861.284502:0:21115:0:(genops.c:885:class_export_put()) final put ffff9dd990818800/lustre-MDT0001-lwp-OST0001_UUID 10000000:01000000:0.0:1789263861.284511:0:17944:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:00010000:2.0:1789263861.284514:0:20218:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd987f51800/0xce1582440fb1f0ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xce1582440fb1f0f1 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789263861.284516:0:17944:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00000020:00080000:1.0:1789263861.284517:0:21115:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9dd99f96f000), last request at 1789263858 10000000:01000000:0.0:1789263861.284521:0:17944:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00000020:00000080:1.0:1789263861.284526:0:21115:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1ec60 00000100:00080000:1.0:1789263861.284535:0:21115:0:(import.c:65:import_set_state_nolock()) ffff9dd99f96b800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1789263861.284536:0:20218:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd987f51800/0xce1582440fb1f0ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xce1582440fb1f0f1 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263861.284541:0:17944:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff9dd883e73000/0xce1582440fb1ed08 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xce1582440fb1ed0f expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1789263861.284544:0:21115:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dd99f96f000): rc 0 00000020:00000080:1.0:1789263861.284550:0:21115:0:(genops.c:885:class_export_put()) final put ffff9dd99f96f000/lustre-MDT0001-lwp-OST0000_UUID 10000000:00010000:2.0:1789263861.284553:0:20218:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd987f51800/0xce1582440fb1f0ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xce1582440fb1f0f1 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263861.284558:0:17944:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000004:00000080:1.0:1789263861.284560:0:21115:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb38e41dd7ae0 00010000:00010000:0.0:1789263861.284567:0:17944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd883e73000/0xce1582440fb1ed08 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xce1582440fb1ed0f expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789263861.284569:0:20218:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789263861.284575:0:20218:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1789263861.284579:0:20218:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000100:00080000:1.0:1789263861.284579:0:21115:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:0.0:1789263861.284587:0:17944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd883e73000/0xce1582440fb1ed08 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xce1582440fb1ed0f expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263861.284590:0:21115:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff9dd883b6ce00 x1876178898151808/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789263871 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1789263861.284605:0:20218:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff9dd987f51800/0xce1582440fb1f0ea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xce1582440fb1f0f1 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263861.284609:0:21115:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00010000:00010000:0.0:1789263861.284610:0:17944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789263861.284617:0:17944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd883e72c00/0xce1582440fb1eaca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xce1582440fb1ead1 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263861.284631:0:17944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883e72c00 already unused, calling callback (ffffffffc12b1c20) 10000000:00010000:0.0:1789263861.284636:0:17944:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd883e72c00/0xce1582440fb1eaca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xce1582440fb1ead1 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263861.284641:0:20218:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789263861.284648:0:17944:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd883e72c00/0xce1582440fb1eaca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xce1582440fb1ead1 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789263861.284655:0:17944:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd883e72c00/0xce1582440fb1eaca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xce1582440fb1ead1 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789263861.284662:0:17944:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1789263861.284665:0:17944:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:2.0:1789263861.284667:0:20218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd987f51800/0xce1582440fb1f0ea lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xce1582440fb1f0f1 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789263861.284668:0:17944:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1789263861.284680:0:20218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd987f51800/0xce1582440fb1f0ea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xce1582440fb1f0f1 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263861.284685:0:17944:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff9dd883e72c00/0xce1582440fb1eaca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xce1582440fb1ead1 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263861.284694:0:17944:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789263861.284696:0:20218:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789263861.284700:0:20218:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789263861.284703:0:20218:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263861.284704:0:17944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd883e72c00/0xce1582440fb1eaca lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xce1582440fb1ead1 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263861.284712:0:17944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd883e72c00/0xce1582440fb1eaca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xce1582440fb1ead1 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263861.284724:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789263861.284727:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989aece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:de026c8f-6636-4fc7-8061-42c8092f00f0:3619:1876178898154240:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789263861.284728:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263861.284731:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789263861.284746:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989aed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:de026c8f-6636-4fc7-8061-42c8092f00f0:3618:1876178898154112:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789263861.284796:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1789263861.284823:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd990818800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000100:00100000:2.0:1789263861.284868:0:20829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898154240 00000020:00000080:0.0:1789263861.284868:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd99f96f000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000100:00100000:2.0:1789263861.284880:0:20829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898154240 00000020:00000080:0.0:1789263861.284904:0:479:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd99081f800 for lustre-MDT0001 00000020:00000080:0.0:1789263861.284912:0:479:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd99f96b800 for lustre-MDT0001 00000100:00100000:2.0:1789263861.284916:0:20829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789263861.284923:0:20829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3619:x1876178898154240:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789263861.284929:0:20829:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789263861 with bad export cookie 14849918575156783531 00010000:00010000:0.0:1789263861.284932:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789263861.284945:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263861.284994:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898154112 00000100:00100000:0.0:1789263861.285000:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898154112 00000100:00100000:2.0:1789263861.285010:0:20829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3619:x1876178898154240:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (214us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789263861.285024:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789263861.285031:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989aedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3618:x1876178898154112:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789263861.285034:0:20829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00020000:0.0:1789263861.285039:0:17179:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789263861 with bad export cookie 14849918575156783531 00000100:00100000:0.0:1789263861.285109:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989aedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3618:x1876178898154112:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (164us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789263861.285117:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789263861.285124:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de026c8f-6636-4fc7-8061-42c8092f00f0:3620:1876178898154368:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1789263861.285150:0:3618:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.120@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789263861.285160:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9dd9838d1800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1789263861.285164:0:3618:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.120@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:2.0:1789263861.285169:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263861.285201:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:1.0:1789263861.285378:0:21115:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789263861.285382:0:21115:0:(import.c:65:import_set_state_nolock()) ffff9dd988506800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1789263861.285482:0:21115:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789263861.285484:0:21115:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:1.0:1789263861.285493:0:21115:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1789263861.285550:0:21115:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1789263861.285563:0:21115:0:(import.c:65:import_set_state_nolock()) ffff9dd9bf999000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1789263861.285576:0:21115:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789263861.285578:0:21115:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:1.0:1789263861.285584:0:21115:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1789263861.285626:0:21115:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1789263861.285632:0:21115:0:(import.c:65:import_set_state_nolock()) ffff9dd9862e7800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1789263861.285655:0:21115:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9dd9bf8f0000) has no exports 00010000:00010000:1.0:1789263861.285782:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789263861.285814:0:3619:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.120@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789263861.293863:0:3618:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.120@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1789263861.293870:0:3618:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1789263861.293878:0:3618:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dd883b6e680 x1876178898153984/t0(0) o103->MGC192.168.203.120@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789263877 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263861.293889:0:3618:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dd989aece00 x1876178898154240/t0(0) o103->MGC192.168.203.120@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789263877 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263861.293896:0:3618:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dd989aed180 x1876178898154112/t0(0) o103->MGC192.168.203.120@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789263877 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263861.293902:0:3618:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dd99f9a7480 x1876178898154368/t0(0) o103->MGC192.168.203.120@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789263877 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1789263861.293914:0:3618:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1789263861.293916:0:3618:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1789263861.293917:0:3618:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1789263861.293937:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9dd9838d1800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789263861.293942:0:3618:0:(import.c:510:import_select_connection()) MGC192.168.203.120@tcp: connect to NID 0@lo last attempt 256 00000100:00080000:0.0:1789263861.293951:0:3618:0:(import.c:624:import_select_connection()) MGC192.168.203.120@tcp: import ffff9dd9838d1800 using connection 192.168.203.120@tcp/0@lo 00000100:00080000:1.0:1789263861.293955:0:3619:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9dd9838d1800 already not connected (conn 2, was 1): CONNECTING 00000100:00100000:1.0:1789263861.294012:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883b6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:de026c8f-6636-4fc7-8061-42c8092f00f0:3621:1876178898153984:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789263861.294019:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883b6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898151808:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789263861.294218:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989aef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de026c8f-6636-4fc7-8061-42c8092f00f0:0:1876178898154496:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789263861.294310:0:20829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898154368 00000100:00100000:1.0:1789263861.294318:0:20829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898154368 00000100:00100000:0.0:1789263861.294323:0:3618:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd9bfaac700 x1876178898154880/t0(0) o250->MGC192.168.203.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789263861.294342:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989aed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:de026c8f-6636-4fc7-8061-42c8092f00f0:3618:1876178898154112:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789263861.294352:0:20829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789263861.294359:0:20829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3620:x1876178898154368:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1789263861.294366:0:20829:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789263861 with bad export cookie 14849918575156783531 00000100:00100000:1.0:1789263861.294430:0:20829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3620:x1876178898154368:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (9261us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789263861.294437:0:20829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789263861.294439:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989aece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:de026c8f-6636-4fc7-8061-42c8092f00f0:3619:1876178898154240:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789263861.294497:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de026c8f-6636-4fc7-8061-42c8092f00f0:3620:1876178898154368:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789263861.294551:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882435c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1876178898154624:0@lo:9:umount.0 00000100:00100000:2.0:1789263861.294600:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263861.294632:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882434700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1876178898154752:0@lo:9:umount.0 00000100:00100000:0.0:1789263861.294632:0:18698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898154624 00000100:00100000:0.0:1789263861.294638:0:18698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898154624 00000100:00100000:2.0:1789263861.294663:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263861.294686:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:de026c8f-6636-4fc7-8061-42c8092f00f0:3617:1876178898154880:0@lo:250:ptlrpcd_00_00.0 00000100:00100000:0.0:1789263861.294688:0:18698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898154752 00000100:00100000:0.0:1789263861.294693:0:18698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898154752 00000400:00000100:2.0:1789263861.294716:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876178898154880 offset 0 length 520: 4 00000100:00100000:0.0:1789263861.294717:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789263861.294729:0:18698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1876178898154624:12345-0@lo:9:umount.0 00000020:00000080:0.0:1789263861.294751:0:18698:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1ec8a 00000100:00080000:0.0:1789263861.294759:0:18698:0:(import.c:65:import_set_state_nolock()) ffff9dd8810d6800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1789263861.294762:0:18696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789263861.294773:0:18696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1876178898154752:12345-0@lo:9:umount.0 00000020:00000080:2.0:1789263861.294789:0:18696:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1ed4e 00000100:00080000:2.0:1789263861.294796:0:18696:0:(import.c:65:import_set_state_nolock()) ffff9dd883fd9000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789263861.294797:0:18698:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000001:00000004:2.0:1789263861.294832:0:18696:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934601 00000100:00100000:0.0:1789263861.294925:0:18698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3617:x1876178898154624:12345-0@lo:9:umount.0 Request processed in 198us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263861.294932:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789263861.294943:0:18696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3617:x1876178898154752:12345-0@lo:9:umount.0 Request processed in 171us (279us total) trans 0 rc 0/0 00000100:00080000:0.0:1789263861.294950:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789263861.294952:0:18696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00010000:0.0:1789263861.294966:0:20218:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789263861.294975:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789263861.294999:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd9bf999000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789263861.295015:0:3617:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789263861.295017:0:3617:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789263861.295020:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882435c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1876178898154624:0@lo:9:umount.0 00000100:00080000:2.0:1789263861.295029:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd9862e7800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789263861.295036:0:3617:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789263861.295037:0:3617:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789263861.295039:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882434700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1876178898154752:0@lo:9:umount.0 00000400:00000100:3.0:1789263861.297879:0:17178:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1876178898153984 offset 224 length 224: 4 00000100:00100000:3.0:1789263861.297947:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3621:x1876178898153984:12345-0@lo:103:ldlm_bl.0 Request processed in 14198us (14312us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789263861.297960:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000020:00080000:0.0:1789263861.303367:0:21115:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9dd9bf8f0000) has no exports 00000020:01000000:1.0:1789263861.328750:0:21115:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9dd9c0988540 - data ffff9dd9b3eea510/ffff9dd8827e7000 00000020:01000000:1.0:1789263861.328914:0:21115:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9dd882730b40 - data ffff9dd882043a20/ffff9dd9ab806c00 00000001:00000004:1.0:1789263861.338432:0:21115:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:3.0:1789263861.358881:0:21115:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789263861.358889:0:21115:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789263861.358896:0:21115:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1789263861.359906:0:21115:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789263861.359910:0:21115:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:3.0:1789263861.359924:0:21115:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789263861.359926:0:21115:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1789263861.360580:0:17931:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1789263861.360584:0:17931:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:2.0:1789263861.360595:0:17931:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:3.0:1789263861.361050:0:21115:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789263861.361054:0:21115:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:3.0:1789263861.361091:0:21115:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789263861.361093:0:21115:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789263861.361320:0:17933:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789263861.361324:0:17933:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:0.0:1789263861.361333:0:17933:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:3.0:1789263861.361960:0:21115:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1eaed 00000020:00000080:3.0:1789263861.361968:0:21115:0:(genops.c:885:class_export_put()) final put ffff9dd9885dd000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789263861.361998:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd9885dd000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1789263861.362562:0:21115:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1eb02 00000020:00000080:3.0:1789263861.362571:0:21115:0:(genops.c:885:class_export_put()) final put ffff9dd9885de800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1789263861.362577:0:21115:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:3.0:1789263861.362581:0:21115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789263861.362590:0:21115:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789263861.362594:0:21115:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9dd9bf8f4d28) has no exports 00000020:00000080:0.0:1789263861.362607:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd9885de800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000004:01000000:3.0:1789263861.362733:0:21115:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1789263861.362740:0:21115:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1eb5d 00000020:00000080:3.0:1789263861.362744:0:21115:0:(genops.c:885:class_export_put()) final put ffff9dd9bf99d000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1789263861.362753:0:21115:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:3.0:1789263861.362756:0:21115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789263861.362760:0:21115:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789263861.362762:0:21115:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9dd9c1ba8000) has no exports 00000020:00000080:3.0:1789263861.362773:0:21115:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1eb56 00000020:00000080:0.0:1789263861.362775:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd9bf99d000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1789263861.362777:0:21115:0:(genops.c:885:class_export_put()) final put ffff9dd9b7a90800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789263861.362799:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd9b7a90800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1789263861.363112:0:21115:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:3.0:1789263861.363116:0:21115:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789263861.363119:0:21115:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:3.0:1789263861.363123:0:21115:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789263861.363131:0:21115:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789263861.363167:0:21115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789263861.363174:0:21115:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789263861.363179:0:21115:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1eb48 00000020:00000080:3.0:1789263861.363183:0:21115:0:(genops.c:885:class_export_put()) final put ffff9dd988504000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1789263861.363188:0:21115:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:3.0:1789263861.363191:0:21115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789263861.363193:0:479:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd9862e7800 for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1789263861.363194:0:21115:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789263861.363199:0:21115:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9dd9b79819b8) has no exports 00000020:00000080:3.0:1789263861.363203:0:21115:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1eb33 00000020:00000080:0.0:1789263861.363204:0:479:0:(genops.c:885:class_export_put()) final put ffff9dd988500800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789263861.363206:0:21115:0:(genops.c:885:class_export_put()) final put ffff9dd9bf99f000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789263861.363208:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd988500800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:0.0:1789263861.363215:0:479:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789263861.363299:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd988504000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1789263861.363309:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd9bf99f000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1789263861.363546:0:21115:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:3.0:1789263861.363549:0:21115:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789263861.363551:0:21115:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:3.0:1789263861.363554:0:21115:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789263861.363556:0:21115:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789263861.363585:0:21115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789263861.363590:0:479:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd9bf999000 for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1789263861.363591:0:21115:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789263861.363599:0:479:0:(genops.c:885:class_export_put()) final put ffff9dd9b7a92800/lustre-MDT0001-mdtlov_UUID 00000004:01000000:3.0:1789263861.363602:0:21115:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1789263861.363603:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd9b7a92800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1789263861.363609:0:21115:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1eb25 00000020:01000000:0.0:1789263861.363611:0:479:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789263861.363615:0:21115:0:(genops.c:885:class_export_put()) final put ffff9dd988502800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1789263861.363620:0:21115:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:3.0:1789263861.363624:0:21115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789263861.363627:0:21115:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789263861.363629:0:21115:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff9dd9c1ba99b8) has no exports 00000020:00000080:3.0:1789263861.363633:0:21115:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1eb1e 00000020:00000080:3.0:1789263861.363636:0:21115:0:(genops.c:885:class_export_put()) final put ffff9dd988503000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789263861.363664:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd988502800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1789263861.363673:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd988503000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1789263861.366156:0:21115:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:2.0:1789263861.366163:0:21115:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789263861.366177:0:21115:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789263861.366183:0:21115:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789263861.366223:0:21115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789263861.366233:0:21115:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789263861.366256:0:21115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789263861.366260:0:21115:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789263861.366264:0:21115:0:(genops.c:885:class_export_put()) final put ffff9dd9c08ea000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789263861.366268:0:21115:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd9c08ea000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1789263861.366274:0:21115:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789263861.366408:0:21115:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1eb09 00000020:00000080:2.0:1789263861.366414:0:21115:0:(genops.c:885:class_export_put()) final put ffff9dd9885db000/lustre-MDD0001_UUID 00000020:01000000:2.0:1789263861.366419:0:21115:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:2.0:1789263861.366423:0:21115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789263861.366428:0:21115:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789263861.366431:0:21115:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9dd9bf8f3370) has no exports 00000020:00000080:2.0:1789263861.366451:0:21115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789263861.366455:0:21115:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:2.0:1789263861.366458:0:21115:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1eb10 00000020:00000080:2.0:1789263861.366462:0:21115:0:(genops.c:885:class_export_put()) final put ffff9dd9885de000/lustre-MDT0001-osd_UUID 00000020:01000004:2.0:1789263861.366469:0:21115:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dd9b7a92000 from lustre-MDT0001, refs=2 00000020:01000004:2.0:1789263861.366472:0:21115:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dd9b7a92000 2 00000020:01000004:2.0:1789263861.366475:0:21115:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9dd9b7a92000 from lustre-MDT0001 00000020:00000080:2.0:1789263861.366500:0:21115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789263861.366503:0:21115:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:2.0:1789263861.366506:0:21115:0:(genops.c:885:class_export_put()) final put ffff9dd9885df800/lustre-MDT0001_UUID 00000020:00000080:2.0:1789263861.366508:0:21115:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd9885df800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:2.0:1789263861.366513:0:21115:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:2.0:1789263861.366539:0:21115:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:2.0:1789263861.366543:0:21115:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:2.0:1789263861.366546:0:21115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789263861.366548:0:21115:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789263861.366554:0:21115:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9dd991569000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789263861.366565:0:21115:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff9dd9c09c3370) has exports, disconnecting them 00000020:00080000:2.0:1789263861.366570:0:21115:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9dd991569000), last request at 1789263818 00000020:00000080:2.0:1789263861.366573:0:21115:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1eb95 00000020:00080000:2.0:1789263861.366586:0:21115:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dd991569000): rc 0 00000020:00000080:2.0:1789263861.366589:0:21115:0:(genops.c:885:class_export_put()) final put ffff9dd991569000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1789263861.367419:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd988506800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1789263861.367431:0:38:0:(genops.c:885:class_export_put()) final put ffff9dd988502000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789263861.367433:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd988502000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:0.0:1789263861.367444:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789263861.367560:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd9885db000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:0.0:1789263861.367564:0:38:0:(genops.c:885:class_export_put()) final put ffff9dd9885da800/lustre-MDD0001_UUID 00000020:00000080:0.0:1789263861.367566:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd9885da800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:0.0:1789263861.367571:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:0.0:1789263861.367763:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd9885de000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1789263861.367768:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd991569000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:0.0:1789263861.368135:0:21115:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:0.0:1789263861.368140:0:21115:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789263861.368144:0:21115:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789263861.368161:0:21115:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789263861.368194:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd99f96d000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1789263861.368338:0:21115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789263861.368345:0:21115:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:0.0:1789263861.368348:0:21115:0:(genops.c:885:class_export_put()) final put ffff9dd99f969800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:0.0:1789263861.368351:0:21115:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd99f969800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:0.0:1789263861.368354:0:21115:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:0.0:1789263861.368387:0:21115:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dd9b7a92000 1 00000020:00000080:0.0:1789263861.368393:0:21115:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1eab5 00000020:00000080:0.0:1789263861.368398:0:21115:0:(genops.c:885:class_export_put()) final put ffff9dd9c08e8800/lustre-MDT0001-osd_UUID 00000020:01000000:0.0:1789263861.368407:0:21115:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:0.0:1789263861.368414:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd9c08e8800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1789263861.368422:0:21115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789263861.368427:0:21115:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789263861.368430:0:21115:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff9dd98731cd28) has no exports 00000020:00000080:0.0:1789263861.379592:0:21115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789263861.379605:0:21115:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:0.0:1789263861.379615:0:21115:0:(genops.c:885:class_export_put()) final put ffff9dd9b7a91800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789263861.379620:0:21115:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd9b7a91800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:0.0:1789263861.379625:0:21115:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:0.0:1789263861.379767:0:21115:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9dd9b7a96000 00000020:01000000:0.0:1789263861.379789:0:21115:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1789263861.379793:0:21115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789263861.379798:0:21115:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789263861.379802:0:21115:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9dd9c09c19b8) has no exports 00000100:00100000:3.0:1789263861.379988:0:20485:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9dd9bf66ba00:20485] 4 exiting: rc = 0 00000100:00100000:0.0:1789263861.379990:0:17193:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9dd9895ce200:17193] 2 exiting: rc = 0 00000100:00100000:2.0:1789263861.380041:0:17191:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9dd9895ce800:17191] 0 exiting: rc = 1 00000100:00100000:0.0:1789263861.380231:0:18722:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9dd88434d000:18722] 3 exiting: rc = 0 00000100:00100000:3.0:1789263861.380232:0:17192:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9dd9c0884800:17192] 1 exiting: rc = 0 00000100:00100000:0.0:1789263861.380347:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.380357:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.380365:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.380373:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.380393:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.380402:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.380410:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.380419:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.380430:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.380441:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.380451:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.380464:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.380472:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.380491:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.380501:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.380508:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.380517:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.380524:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.380533:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.380541:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.380549:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.380556:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.380565:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.380574:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.380581:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.380590:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.380598:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.380606:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.380615:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.380623:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.380630:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.380638:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.380645:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.380655:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.380666:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.380676:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.380688:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.380696:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.380702:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.380716:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.380722:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.380727:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.380733:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.380739:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.380745:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.380751:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.380759:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.380767:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.380775:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.380782:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.380790:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.380797:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.380805:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.380812:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.380821:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.380828:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.380835:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.380843:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.380851:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.380859:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.380867:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.380875:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.380883:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.380890:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.384129:0:17195:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9dd9ac8af200:17195] 1 exiting: rc = 0 00000100:00100000:3.0:1789263861.384174:0:17194:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9dd9ac8aec00:17194] 0 exiting: rc = 1 00000100:00100000:0.0:1789263861.384214:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.384223:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.384230:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.384236:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.384243:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.384250:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.384256:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.384262:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.384266:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.384270:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.384284:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.384288:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.384292:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.384297:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.384300:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.384305:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.384310:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.384317:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.384322:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.384328:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.384340:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.384347:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.384355:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.384362:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.384368:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.384373:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.384377:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.384385:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.384395:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.384414:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.384428:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.384433:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.384439:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.384444:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.384450:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.384457:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.384464:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.384472:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.384480:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.384488:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.384495:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.384501:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.384508:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.384514:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.384521:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.384536:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.384544:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.384551:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.384558:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.384572:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.384578:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.384585:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.384593:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.384604:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.384615:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.384625:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.384636:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.384644:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.384649:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.384654:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.384660:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.384668:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.384674:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.384681:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263861.385310:0:17196:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9dd9ac8afe00:17196] 0 exiting: rc = 1 00000100:00100000:3.0:1789263861.385325:0:18524:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff9dd988c3ae00:18524] 2 exiting: rc = 0 00000100:00100000:2.0:1789263861.385341:0:17197:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9dd9ac8afc00:17197] 1 exiting: rc = 0 00000100:00100000:0.0:1789263861.385425:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.385435:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.385441:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.385448:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.385453:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.385459:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.385465:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.385471:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.385477:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.385482:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.385500:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.385507:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.385513:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.385519:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.385526:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.385532:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.385545:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.385552:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.385558:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.385563:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.385568:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.385574:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.385592:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.385597:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.385601:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.385605:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.385609:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.385612:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.385616:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.385619:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.385623:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.385627:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.385631:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.385635:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.385648:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.385652:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.385655:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.385659:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.385662:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.385715:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.385721:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.385725:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.385731:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.385738:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.385746:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.385754:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.385784:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.385794:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.385802:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.385810:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.385818:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.385834:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.385842:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.385851:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.385864:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.385874:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.385878:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.385886:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.385905:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.385911:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.385914:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.385920:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.385925:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.385934:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263861.394674:0:17199:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9dd9c0a9d200:17199] 1 exiting: rc = 0 00000100:00100000:3.0:1789263861.394684:0:17198:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9dd9c0a9d000:17198] 0 exiting: rc = 1 00000100:00100000:2.0:1789263861.394759:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.394774:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.394788:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.394801:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.394812:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.394824:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.394833:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.394842:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.394853:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.394858:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.394865:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.394877:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.394895:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.394906:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.394920:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.394945:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.394956:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.394965:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.394974:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.394984:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.394993:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.395002:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.395020:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.395034:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.395054:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.395112:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.395125:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.395136:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.395148:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.395158:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.395170:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.395181:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.395192:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.395203:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.395216:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.395229:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.395242:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.395253:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.395269:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.395279:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.395288:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.395297:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.395306:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.395315:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.395326:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.395336:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.395345:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.395356:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.395368:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.395378:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.395389:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.395401:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.395414:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.395426:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.395438:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.395448:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.395459:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.395470:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.395481:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.395496:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.395512:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.395524:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.395535:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.395543:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.395976:0:17200:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9dd883b9f200:17200] 0 exiting: rc = 1 00000100:00100000:3.0:1789263861.396000:0:17201:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9dd9c0a9d800:17201] 1 exiting: rc = 0 00000100:00100000:2.0:1789263861.396054:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.396072:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.396199:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.396210:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.396221:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.396231:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.396242:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.396252:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.396260:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.396272:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.396284:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.396296:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.396349:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.396361:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.396371:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.396381:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.396391:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.396401:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.396411:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.396421:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.396429:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.396437:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.396446:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.396455:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.396463:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.396471:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.396478:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.396487:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.396499:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.396512:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.396532:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.396540:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.396635:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.396644:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.396653:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.396661:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.396669:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.396681:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.396691:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.396698:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.396708:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.396720:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.396731:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.396741:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.396754:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.396767:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.396780:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.396791:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.396799:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.396815:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.396825:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.396837:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.396847:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.396857:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.396868:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.396879:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.396890:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.396901:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.396912:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.396923:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.396934:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.396946:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.396955:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.396966:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263861.397981:0:17203:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9dd98f4dc600:17203] 1 exiting: rc = 0 00000100:00100000:0.0:1789263861.398101:0:17202:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9dd9b79cec00:17202] 0 exiting: rc = 1 00000100:00100000:2.0:1789263861.398139:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.398156:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.398163:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.398170:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.398177:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.398189:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.398196:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.398204:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.398211:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.398218:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.398227:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.398238:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.398250:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.398256:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.398260:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.398271:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.398279:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.398285:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.398293:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.398301:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.398308:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.398314:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.398321:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.398327:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.398333:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.398340:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.398346:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.398352:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.398360:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.398366:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.398373:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.398380:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.398387:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.398393:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.398399:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.398405:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.398420:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.398428:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.398436:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.398444:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.398454:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.398463:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.398469:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.398474:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.398486:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.398492:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.398499:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.398505:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.398512:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.398519:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.398527:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.398534:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.398542:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.398549:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.398556:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.398565:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.398571:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.398576:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.398582:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.398588:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.398594:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.398601:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.398608:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.398615:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263861.399262:0:17204:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9dd99852da00:17204] 0 exiting: rc = 1 00000100:00100000:3.0:1789263861.399330:0:17205:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9dd9acb3b400:17205] 1 exiting: rc = 0 00000100:00100000:0.0:1789263861.399434:0:17206:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9dd9acb85e00:17206] 2 exiting: rc = 0 00000100:00100000:2.0:1789263861.399487:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.399496:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.399504:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.399535:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.399544:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.399552:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.399560:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.399576:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.399602:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.399611:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.399617:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.399623:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.399632:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.399638:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.399644:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.399651:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.399660:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.399667:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.399676:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.399684:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.399692:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.399699:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.399707:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.399714:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.399722:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.399730:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.399738:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.399766:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.399777:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.399786:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.399797:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.399807:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.399813:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.399827:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.399834:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.399841:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.399848:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.399854:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.399861:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.399870:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.399878:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.399885:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.399901:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.399910:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.399917:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.399924:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.399931:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.399938:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.399946:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.399953:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.399960:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.399995:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.400005:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.400016:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.400024:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.400030:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.400036:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.400044:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.400051:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.400058:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.400102:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.400114:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.400123:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263861.400132:0:21115:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1789263861.403998:0:21115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789263861.404008:0:21115:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1789263861.404013:0:21115:0:(genops.c:885:class_export_put()) final put ffff9dd98f4c7800/MDS_uuid 00000020:00000080:2.0:1789263861.404016:0:21115:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd98f4c7800/MDS_uuid for MDS 00000020:01000000:2.0:1789263861.404020:0:21115:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1789263861.404277:0:21115:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:0.0:1789263862.061183:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789263862.891235:0:21316:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1789263862.898428:0:21316:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1789263862.898500:0:21316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883f59e00/0xce1582440fb1ec2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1ec36 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263862.898522:0:21316:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883f59e00/0xce1582440fb1ec2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1ec36 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263862.898532:0:21316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883f59e00/0xce1582440fb1ec2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xce1582440fb1ec36 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263862.898540:0:21316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff9dd883f59e00/0xce1582440fb1ec2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xce1582440fb1ec36 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263862.898568:0:21316:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789263862.898597:0:21316:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:1.0:1789263862.898614:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263862.898633:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd883f59e00/0xce1582440fb1ec2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xce1582440fb1ec36 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263862.898648:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883f59e00 already unused, calling callback (ffffffffc12b1c20) 10000000:00010000:1.0:1789263862.898653:0:17181:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd883f59e00/0xce1582440fb1ec2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xce1582440fb1ec36 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263862.898666:0:17181:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd883f59e00/0xce1582440fb1ec2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xce1582440fb1ec36 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789263862.898674:0:17181:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd883f59e00/0xce1582440fb1ec2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xce1582440fb1ec36 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789263862.898680:0:17181:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789263862.898682:0:17181:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789263862.898686:0:17181:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789263862.898705:0:17181:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9dd9838d1800 00010000:00010000:1.0:1789263862.898709:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd883f59e00/0xce1582440fb1ec2f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xce1582440fb1ec36 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263862.898717:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd883f59e00/0xce1582440fb1ec2f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xce1582440fb1ec36 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789263862.898719:0:21316:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789263862.898724:0:21316:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00010000:00010000:1.0:1789263862.898731:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789263862.898732:0:21316:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00010000:00010000:1.0:1789263862.898733:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789263862.898741:0:21316:0:(import.c:65:import_set_state_nolock()) ffff9dd8810d3800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1789263862.898748:0:21316:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789263862.898750:0:21316:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789263862.898753:0:21316:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1789263862.898757:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789263862.899545:0:21316:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789263862.899548:0:21316:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789263862.899552:0:21316:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1789263862.899577:0:21316:0:(import.c:65:import_set_state_nolock()) ffff9dd8810d1800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1789263862.899644:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3617:1876178898155008:0@lo:39:umount.0 00000400:00000100:2.0:1789263862.899698:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876178898155008 offset 0 length 224: 4 00010000:00010000:0.0:1789263863.085235:0:20218:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789263863.853188:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) de026c8f-6636-4fc7-8061-42c8092f00f0->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789263863.853197:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) de026c8f-6636-4fc7-8061-42c8092f00f0->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789263863.853201:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789263863.853204:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789263863.853209:0:38:0:(import.c:65:import_set_state_nolock()) ffff9dd883814000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789263863.853216:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 301 00000100:00080000:0.0:1789263863.853222:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789263863.853229:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9dd883814000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:0.0:1789263863.853278:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd9bfaaea00 x1876178898155136/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789263863.853429:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1876178898155264:0@lo:400:kworker.0 00000400:00000100:1.0:1789263863.853478:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876178898155264 offset 0 length 224: 4 00000100:00100000:2.0:1789263863.853759:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3617:1876178898155136:0@lo:38:kworker.0 00000400:00000100:2.0:1789263863.853778:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876178898155136 offset 0 length 520: 4 00010000:00010000:2.0:1789263864.109255:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263865.133250:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789263865.902096:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) de026c8f-6636-4fc7-8061-42c8092f00f0->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789263865.902108:0:479:0:(pinger.c:247:ptlrpc_pinger_process_import()) de026c8f-6636-4fc7-8061-42c8092f00f0->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789263865.902111:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789263865.902114:0:479:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789263865.902247:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883b6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1876178898155392:0@lo:400:kworker.0 00000400:00000100:0.0:1789263865.902300:0:3619:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876178898155392 offset 0 length 224: 4 00010000:00010000:1.0:1789263866.157270:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789263866.414194:0:19510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789263866.414202:0:19510:0:(genops.c:885:class_export_put()) final put ffff9dd883fdb800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789263866.414288:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd883fdb800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1789263866.414399:0:479:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd883fd9000 for lustre-OST0001 00000001:00100000:3.0:1789263866.928566:0:18693:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789263866.928574:0:18693:0:(genops.c:885:class_export_put()) final put ffff9dd8810d3000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789263866.928624:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd8810d3000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1789263866.928671:0:479:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd8810d6800 for lustre-OST0000 00010000:00010000:0.0:1789263867.181282:0:20218:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789263868.205279:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789263868.911386:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) de026c8f-6636-4fc7-8061-42c8092f00f0->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789263868.911394:0:479:0:(pinger.c:247:ptlrpc_pinger_process_import()) de026c8f-6636-4fc7-8061-42c8092f00f0->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789263868.911396:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789263868.911398:0:479:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789263868.911478:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882437800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1876178898155520:0@lo:400:kworker.0 00000400:00000100:2.0:1789263868.911531:0:3620:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876178898155520 offset 0 length 224: 4 00010000:00010000:0.0:1789263869.229293:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263870.253238:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263871.277178:0:20218:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789263871.981279:0:3617:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789263861/real 1789263861] req@ffff9dd9bfaac700 x1876178898154880/t0(0) o250->MGC192.168.203.120@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789263871 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789263871.981312:0:3617:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9dd9bfaac700 x1876178898154880/t0(0) o250->MGC192.168.203.120@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789263871 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789263871.981337:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd9838d1800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789263871.981355:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1789263871.981359:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:de026c8f-6636-4fc7-8061-42c8092f00f0:3617:1876178898154880:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:3.0:1789263871.981366:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) de026c8f-6636-4fc7-8061-42c8092f00f0->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789263871.981373:0:479:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1789263871.981376:0:479:0:(import.c:65:import_set_state_nolock()) ffff9dd9838d1800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789263871.981383:0:479:0:(import.c:510:import_select_connection()) MGC192.168.203.120@tcp: connect to NID 0@lo last attempt 303 00000100:00080000:3.0:1789263871.981388:0:479:0:(import.c:589:import_select_connection()) MGC192.168.203.120@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789263871.981398:0:479:0:(import.c:624:import_select_connection()) MGC192.168.203.120@tcp: import ffff9dd9838d1800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:3.0:1789263871.981439:0:479:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd883b6d180 x1876178898155648/t0(0) o250->MGC192.168.203.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789263871.981459:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789263871.981462:0:479:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789263871.981519:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789263871.981532:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883b6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1876178898155776:0@lo:400:kworker.0 00000100:00100000:2.0:1789263871.981543:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883b6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:de026c8f-6636-4fc7-8061-42c8092f00f0:3617:1876178898155648:0@lo:250:kworker.0 00000400:00000100:0.0:1789263871.981576:0:3620:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876178898155776 offset 0 length 224: 4 00000400:00000100:2.0:1789263871.981581:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876178898155648 offset 0 length 520: 4 00010000:00010000:2.0:1789263872.301467:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789263873.005210:0:3617:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789263862/real 1789263862] req@ffff9dd9bfaaf480 x1876178898155008/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789263872 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789263873.005240:0:3617:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9dd9bfaaf480 x1876178898155008/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789263872 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789263873.005261:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd8810d1800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1789263873.005272:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3617:1876178898155008:0@lo:39:umount.0 00000100:00080000:0.0:1789263873.005299:0:21316:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789263873.005309:0:21316:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789263873.005317:0:21316:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789263873.006193:0:21316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883f59600/0xce1582440fb1ec05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1ec0c expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263873.006209:0:21316:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883f59600/0xce1582440fb1ec05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1ec0c expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263873.006218:0:21316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883f59600/0xce1582440fb1ec05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xce1582440fb1ec0c expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263873.006226:0:21316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff9dd883f59600/0xce1582440fb1ec05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xce1582440fb1ec0c expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263873.006249:0:21316:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789263873.006257:0:21316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd987f50200/0xce1582440fb1f0dc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f0e3 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263873.006261:0:21316:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd987f50200/0xce1582440fb1f0dc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1f0e3 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263873.006279:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789263873.006284:0:21316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd987f50200/0xce1582440fb1f0dc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xce1582440fb1f0e3 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263873.006289:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd883f59600/0xce1582440fb1ec05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xce1582440fb1ec0c expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263873.006292:0:21316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff9dd987f50200/0xce1582440fb1f0dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xce1582440fb1f0e3 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263873.006328:0:21316:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789263873.006340:0:21316:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00010000:00010000:3.0:1789263873.006343:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883f59600 already unused, calling callback (ffffffffc12b1c20) 10000000:00010000:3.0:1789263873.006349:0:17180:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd883f59600/0xce1582440fb1ec05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xce1582440fb1ec0c expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263873.006358:0:17180:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd883f59600/0xce1582440fb1ec05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xce1582440fb1ec0c expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263873.006358:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:00010000:3.0:1789263873.006367:0:17180:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd883f59600/0xce1582440fb1ec05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xce1582440fb1ec0c expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263873.006370:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd987f50200/0xce1582440fb1f0dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xce1582440fb1f0e3 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789263873.006372:0:17180:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789263873.006376:0:17180:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00000020:01000004:0.0:1789263873.006379:0:21316:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 10000000:01000000:3.0:1789263873.006381:0:17180:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00000020:01000000:0.0:1789263873.006387:0:21316:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00010000:00010000:1.0:1789263873.006390:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd987f50200 already unused, calling callback (ffffffffc12b1c20) 00000020:00000080:0.0:1789263873.006391:0:21316:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 10000000:00010000:1.0:1789263873.006399:0:17181:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd987f50200/0xce1582440fb1f0dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xce1582440fb1f0e3 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1789263873.006400:0:21316:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00010000:00010000:3.0:1789263873.006407:0:17180:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9dd9838d1800 00000020:00080000:0.0:1789263873.006408:0:21316:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9dd9c1bab370) has no exports 00010000:00010000:3.0:1789263873.006421:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd883f59600/0xce1582440fb1ec05 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xce1582440fb1ec0c expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263873.006425:0:17181:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd987f50200/0xce1582440fb1f0dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xce1582440fb1f0e3 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263873.006429:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd883f59600/0xce1582440fb1ec05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xce1582440fb1ec0c expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789263873.006440:0:17181:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd987f50200/0xce1582440fb1f0dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xce1582440fb1f0e3 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789263873.006441:0:21316:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9dd9c1bab370) has no exports 00010000:00010000:3.0:1789263873.006451:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789263873.006454:0:17181:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789263873.006455:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263873.006458:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789263873.006460:0:17181:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1789263873.006464:0:17181:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789263873.006481:0:17181:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9dd9838d1800 00010000:00010000:1.0:1789263873.006485:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd987f50200/0xce1582440fb1f0dc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xce1582440fb1f0e3 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263873.006492:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd987f50200/0xce1582440fb1f0dc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xce1582440fb1f0e3 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263873.006504:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263873.006505:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263873.006507:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1789263873.008025:0:21316:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9dd883c8c960 - data ffff9dd9b3e67870/ffff9dd884a79800 00000020:01000000:0.0:1789263873.008228:0:21316:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9dd985d3cea0 - data ffff9dd9b3d63af8/ffff9dd987c39000 00100000:10000000:0.0:1789263873.017578:0:21316:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1789263873.022317:0:21316:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1ec1a 00000020:00000080:1.0:1789263873.022329:0:21316:0:(genops.c:885:class_export_put()) final put ffff9dd98a660800/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1789263873.022342:0:21316:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dd9bfa35800 from lustre-OST0000, refs=2 00000020:01000004:1.0:1789263873.022345:0:21316:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dd9bfa35800 2 00000020:01000004:1.0:1789263873.022348:0:21316:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9dd9bfa35800 from lustre-OST0000 00000020:00000080:3.0:1789263873.022357:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd98a660800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1789263873.022378:0:21316:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789263873.022387:0:21316:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1789263873.022391:0:21316:0:(genops.c:885:class_export_put()) final put ffff9dd9862e5000/lustre-OST0000_UUID 00000020:00000080:1.0:1789263873.022393:0:21316:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd9862e5000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1789263873.022401:0:21316:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1789263873.022457:0:21316:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1789263873.022463:0:21316:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1789263873.022466:0:21316:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789263873.022472:0:21316:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789263873.022478:0:21316:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9dd8810d0800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789263873.022490:0:21316:0:(genops.c:1553:class_disconnect_exports()) OBD device 23 (ffff9dd9c1bacd28) has exports, disconnecting them 00000020:00080000:1.0:1789263873.022495:0:21316:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9dd8810d0800), last request at 1789263824 00000020:00000080:1.0:1789263873.022499:0:21316:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1ec44 00000020:00080000:1.0:1789263873.022509:0:21316:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dd8810d0800): rc 0 00000020:00000080:1.0:1789263873.022515:0:21316:0:(genops.c:885:class_export_put()) final put ffff9dd8810d0800/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1789263873.022547:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd8810d0800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1789263873.023144:0:21316:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1789263873.023148:0:21316:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789263873.023152:0:21316:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789263873.023157:0:21316:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789263873.023195:0:479:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd8810d3800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1789263873.023338:0:21316:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789263873.023344:0:21316:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1789263873.023348:0:21316:0:(genops.c:885:class_export_put()) final put ffff9dd98a661800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1789263873.023351:0:21316:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd98a661800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1789263873.023359:0:21316:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1789263873.023412:0:21316:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1789263873.023421:0:21316:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789263873.023432:0:21316:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789263873.023437:0:21316:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9dd8810d6000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789263873.023442:0:21316:0:(genops.c:1553:class_disconnect_exports()) OBD device 24 (ffff9dd99f9c0000) has exports, disconnecting them 00000020:00080000:0.0:1789263873.023445:0:21316:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9dd8810d6000), last request at 1789263824 00000020:00000080:0.0:1789263873.023448:0:21316:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1ec59 00000020:00080000:0.0:1789263873.023457:0:21316:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dd8810d6000): rc 0 00000020:00000080:0.0:1789263873.023463:0:21316:0:(genops.c:885:class_export_put()) final put ffff9dd8810d6000/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1789263873.023490:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd8810d6000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:1.0:1789263873.024882:0:21316:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:1.0:1789263873.024895:0:21316:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789263873.024898:0:21316:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789263873.024902:0:21316:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789263873.024942:0:479:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd8810d1800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1789263873.025152:0:21316:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789263873.025159:0:21316:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:1.0:1789263873.025164:0:21316:0:(genops.c:885:class_export_put()) final put ffff9dd8810d2800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:1.0:1789263873.025167:0:21316:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd8810d2800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:1.0:1789263873.025172:0:21316:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:1.0:1789263873.025226:0:21316:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dd9bfa35800 1 00000020:00000080:1.0:1789263873.025231:0:21316:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1ebf7 00000020:00000080:1.0:1789263873.025237:0:21316:0:(genops.c:885:class_export_put()) final put ffff9dd9bfa33800/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1789263873.025247:0:21316:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1789263873.025251:0:21316:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789263873.025256:0:21316:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789263873.025259:0:21316:0:(genops.c:1558:class_disconnect_exports()) OBD device 20 (ffff9dd88389b370) has no exports 00000020:00000080:3.0:1789263873.025283:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd9bfa33800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1789263873.039315:0:21316:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789263873.039328:0:21316:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1789263873.039333:0:21316:0:(genops.c:885:class_export_put()) final put ffff9dd9bfa35000/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1789263873.039338:0:21316:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd9bfa35000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1789263873.039343:0:21316:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1789263873.039452:0:21316:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9dd9bfa32000 00000020:02000400:0.0:1789263873.039492:0:21316:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1789263873.325191:0:20218:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789263874.349207:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789263874.390336:0:21518:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1789263874.397466:0:21518:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1789263874.397547:0:21518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd981531e00/0xce1582440fb1ecc9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1ecd0 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263874.397563:0:21518:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd981531e00/0xce1582440fb1ecc9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1ecd0 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263874.397571:0:21518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd981531e00/0xce1582440fb1ecc9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xce1582440fb1ecd0 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263874.397579:0:21518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff9dd981531e00/0xce1582440fb1ecc9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xce1582440fb1ecd0 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263874.397598:0:21518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789263874.397602:0:21518:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1789263874.397631:0:21518:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789263874.397639:0:21518:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dd9bfaaea00 x1876178898155136/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789263878 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1789263874.397649:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1789263874.397654:0:21518:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00010000:00010000:3.0:1789263874.397658:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd981531e00/0xce1582440fb1ecc9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xce1582440fb1ecd0 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789263874.397660:0:21518:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789263874.397668:0:21518:0:(import.c:65:import_set_state_nolock()) ffff9dd883814000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00010000:00010000:3.0:1789263874.397670:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981531e00 already unused, calling callback (ffffffffc12b1c20) 00000100:00080000:1.0:1789263874.397675:0:21518:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 10000000:00010000:3.0:1789263874.397677:0:17180:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd981531e00/0xce1582440fb1ecc9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xce1582440fb1ecd0 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263874.397681:0:21518:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dd9bfaaea00 x1876178898155136/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789263878 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1789263874.397691:0:17180:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd981531e00/0xce1582440fb1ecc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xce1582440fb1ecd0 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263874.397697:0:21518:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 10000000:00010000:3.0:1789263874.397701:0:17180:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd981531e00/0xce1582440fb1ecc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xce1582440fb1ecd0 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263874.397703:0:21518:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 5s for inflight to error out 10000000:01000000:3.0:1789263874.397711:0:17180:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789263874.397714:0:17180:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789263874.397719:0:17180:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789263874.397734:0:17180:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9dd9838d1800 00010000:00010000:3.0:1789263874.397741:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd981531e00/0xce1582440fb1ecc9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xce1582440fb1ecd0 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263874.397741:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3617:1876178898155136:0@lo:38:kworker.0 00010000:00010000:3.0:1789263874.397764:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd981531e00/0xce1582440fb1ecc9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xce1582440fb1ecd0 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263874.397774:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263874.397775:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263874.397778:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789263874.398563:0:21518:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789263874.398573:0:21518:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dd9bfaaf800 x1876178898155264/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263879 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789263874.398596:0:21518:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dd883b6dc00 x1876178898155392/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263881 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789263874.398618:0:21518:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dd882437800 x1876178898155520/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263884 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789263874.398635:0:21518:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dd883b6fb80 x1876178898155776/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263887 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789263874.398643:0:21518:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789263874.398648:0:21518:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1789263874.398657:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1876178898155264:0@lo:400:kworker.0 00000100:00080000:1.0:1789263874.398670:0:21518:0:(import.c:65:import_set_state_nolock()) ffff9dd883fde000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789263874.398677:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883b6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1876178898155392:0@lo:400:kworker.0 00000100:00100000:2.0:1789263874.398705:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883b6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1876178898155776:0@lo:400:kworker.0 00000100:00100000:2.0:1789263874.398739:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882437800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1876178898155520:0@lo:400:kworker.0 00000100:00100000:1.0:1789263874.398750:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882437480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3617:1876178898155904:0@lo:39:umount.0 00000400:00000100:1.0:1789263874.398800:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876178898155904 offset 0 length 224: 4 00010000:00010000:1.0:1789263875.373228:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789263876.397393:0:20218:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789263877.165176:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) de026c8f-6636-4fc7-8061-42c8092f00f0->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789263877.165201:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) de026c8f-6636-4fc7-8061-42c8092f00f0->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1789263877.421328:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263878.445276:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263879.469307:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789263880.493684:0:20218:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789263881.517375:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789263882.285493:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) de026c8f-6636-4fc7-8061-42c8092f00f0->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789263882.285501:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) de026c8f-6636-4fc7-8061-42c8092f00f0->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1789263882.542447:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263883.565329:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789263884.589309:0:20218:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789263884.653206:0:3617:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789263874/real 1789263874] req@ffff9dd882437480 x1876178898155904/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789263884 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789263884.653242:0:3617:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9dd882437480 x1876178898155904/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789263884 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789263884.653262:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd883fde000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1789263884.653270:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882437480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3617:1876178898155904:0@lo:39:umount.0 00000100:00080000:1.0:1789263884.653281:0:21518:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789263884.653288:0:21518:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789263884.653292:0:21518:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1789263884.654304:0:21518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883f58600/0xce1582440fb1ec9f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1eca6 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263884.654317:0:21518:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883f58600/0xce1582440fb1ec9f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1eca6 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263884.654326:0:21518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd883f58600/0xce1582440fb1ec9f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xce1582440fb1eca6 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263884.654334:0:21518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff9dd883f58600/0xce1582440fb1ec9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xce1582440fb1eca6 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263884.654358:0:21518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789263884.654365:0:21518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd8841a3a00/0xce1582440fb1f0ce lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f0d5 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263884.654371:0:21518:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd8841a3a00/0xce1582440fb1f0ce lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1f0d5 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263884.654379:0:21518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd8841a3a00/0xce1582440fb1f0ce lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xce1582440fb1f0d5 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263884.654386:0:21518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff9dd8841a3a00/0xce1582440fb1f0ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xce1582440fb1f0d5 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263884.654397:0:17944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789263884.654405:0:17944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd883f58600/0xce1582440fb1ec9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xce1582440fb1eca6 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263884.654418:0:17944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883f58600 already unused, calling callback (ffffffffc12b1c20) 00010000:00010000:1.0:1789263884.654422:0:21518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:00010000:2.0:1789263884.654423:0:17944:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd883f58600/0xce1582440fb1ec9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xce1582440fb1eca6 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789263884.654429:0:21518:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00010000:00010000:2.0:1789263884.654438:0:17944:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd883f58600/0xce1582440fb1ec9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xce1582440fb1eca6 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789263884.654448:0:17944:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd883f58600/0xce1582440fb1ec9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xce1582440fb1eca6 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263884.654451:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:2.0:1789263884.654453:0:17944:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789263884.654457:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd8841a3a00/0xce1582440fb1f0ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xce1582440fb1f0d5 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789263884.654465:0:17944:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00000020:01000004:1.0:1789263884.654465:0:21518:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00010000:00010000:3.0:1789263884.654467:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd8841a3a00 already unused, calling callback (ffffffffc12b1c20) 10000000:01000000:2.0:1789263884.654470:0:17944:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00000020:01000000:1.0:1789263884.654472:0:21518:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 10000000:00010000:3.0:1789263884.654473:0:17180:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd8841a3a00/0xce1582440fb1f0ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xce1582440fb1f0d5 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1789263884.654481:0:21518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00010000:00010000:3.0:1789263884.654482:0:17180:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd8841a3a00/0xce1582440fb1f0ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xce1582440fb1f0d5 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263884.654483:0:17944:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9dd9838d1800 00010000:00010000:2.0:1789263884.654488:0:17944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd883f58600/0xce1582440fb1ec9f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xce1582440fb1eca6 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1789263884.654489:0:21518:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 10000000:00010000:3.0:1789263884.654490:0:17180:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd8841a3a00/0xce1582440fb1f0ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xce1582440fb1f0d5 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1789263884.654497:0:21518:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff9dd9b7983370) has no exports 10000000:01000000:3.0:1789263884.654507:0:17180:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789263884.654508:0:17944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd883f58600/0xce1582440fb1ec9f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xce1582440fb1eca6 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789263884.654509:0:17180:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1789263884.654511:0:17180:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1789263884.654526:0:17180:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9dd9838d1800 00010000:00010000:3.0:1789263884.654528:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd8841a3a00/0xce1582440fb1f0ce lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xce1582440fb1f0d5 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263884.654530:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1789263884.654531:0:21518:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff9dd9b7983370) has no exports 00010000:00010000:2.0:1789263884.654535:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263884.654536:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd8841a3a00/0xce1582440fb1f0ce lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xce1582440fb1f0d5 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263884.654540:0:17944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263884.654558:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263884.654560:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263884.654561:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1789263884.656257:0:21518:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9dd883b2d900 - data ffff9dd9b3dba1b0/ffff9dd9bf6dac00 00000020:01000000:1.0:1789263884.656376:0:21518:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9dd883b2d2a0 - data ffff9dd9b3c53798/ffff9dd9ab88e400 00100000:10000000:1.0:1789263884.665678:0:21518:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1789263884.669301:0:21518:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1ecb4 00000020:00000080:0.0:1789263884.669315:0:21518:0:(genops.c:885:class_export_put()) final put ffff9dd9860fb800/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1789263884.669324:0:21518:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dd9bf6c0800 from lustre-OST0001, refs=2 00000020:01000004:0.0:1789263884.669328:0:21518:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dd9bf6c0800 2 00000020:01000004:0.0:1789263884.669331:0:21518:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9dd9bf6c0800 from lustre-OST0001 00000020:00000080:2.0:1789263884.669334:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd9860fb800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1789263884.669360:0:21518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789263884.669368:0:21518:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1789263884.669371:0:21518:0:(genops.c:885:class_export_put()) final put ffff9dd990819000/lustre-OST0001_UUID 00000020:00000080:0.0:1789263884.669373:0:21518:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd990819000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1789263884.669382:0:21518:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1789263884.669490:0:21518:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import de026c8f-6636-4fc7-8061-42c8092f00f0->MGS 00010000:00010000:0.0:1789263884.669510:0:21518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd883e73a00/0xce1582440fb1eabc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xce1582440fb1eac3 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789263884.669522:0:21518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd883e73a00/0xce1582440fb1eabc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xce1582440fb1eac3 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789263884.669536:0:21518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1789263884.669540:0:21518:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1789263884.669543:0:21518:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1789263884.669562:0:21518:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9dd9838d1800 00010000:00010000:0.0:1789263884.669565:0:21518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd883e73a00/0xce1582440fb1eabc lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xce1582440fb1eac3 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263884.669584:0:21518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd883f59a00/0xce1582440fb1e9b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xce1582440fb1e9b9 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789263884.669596:0:21518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd883f59a00/0xce1582440fb1e9b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xce1582440fb1e9b9 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789263884.669602:0:21518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789263884.669605:0:21518:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1789263884.669607:0:21518:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1789263884.669618:0:21518:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9dd9838d1800 00010000:00010000:0.0:1789263884.669621:0:21518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd883f59a00/0xce1582440fb1e9b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xce1582440fb1e9b9 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789263884.669644:0:21518:0:(import.c:65:import_set_state_nolock()) ffff9dd9838d1800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1789263884.669648:0:21518:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1789263884.669651:0:21518:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1789263884.669652:0:21518:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1789263884.669657:0:21518:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1789263884.669669:0:21518:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dd883b6d180 x1876178898155648/t0(0) o250->MGC192.168.203.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789263886 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1789263884.669684:0:21518:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1789263884.669693:0:21518:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000100:00100000:2.0:1789263884.669719:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883b6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:de026c8f-6636-4fc7-8061-42c8092f00f0:3617:1876178898155648:0@lo:250:kworker.0 10000000:01000000:0.0:1789263884.669750:0:21518:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1789263884.669763:0:21518:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1e99d 00000020:00000080:0.0:1789263884.669770:0:21518:0:(genops.c:885:class_export_put()) final put ffff9dd985a04800/de026c8f-6636-4fc7-8061-42c8092f00f0 00000020:01000000:0.0:1789263884.669781:0:21518:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.120@tcp (flags='') 00000020:00000080:0.0:1789263884.669785:0:21518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789263884.669791:0:21518:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.120@tcp: forcing exports to disconnect: 0/3 00000020:00000080:2.0:1789263884.669792:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd985a04800/de026c8f-6636-4fc7-8061-42c8092f00f0 for MGC192.168.203.120@tcp 00000020:00080000:0.0:1789263884.669795:0:21518:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9dd9bf8f19b8) has no exports 10000000:01000000:2.0:1789263884.669829:0:17189:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1789263884.669838:0:21518:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.203.120@tcp: client import never connected 00000100:00080000:0.0:1789263884.669842:0:21518:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1789263884.669845:0:21518:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1789263884.669847:0:21518:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1789263884.669849:0:21518:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1789263884.669891:0:479:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd9838d1800 for MGC192.168.203.120@tcp 00000020:00000080:0.0:1789263884.669920:0:21518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789263884.669926:0:21518:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.120@tcp (uuid de026c8f-6636-4fc7-8061-42c8092f00f0) 00000020:00000080:0.0:1789263884.669929:0:21518:0:(genops.c:885:class_export_put()) final put ffff9dd9838d7000/de026c8f-6636-4fc7-8061-42c8092f00f0 00000020:00000080:0.0:1789263884.669932:0:21518:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd9838d7000/de026c8f-6636-4fc7-8061-42c8092f00f0 for MGC192.168.203.120@tcp 00000020:01000000:0.0:1789263884.669936:0:21518:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.120@tcp (de026c8f-6636-4fc7-8061-42c8092f00f0) 00000020:01000000:0.0:1789263884.670313:0:21518:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1789263884.670317:0:21518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789263884.670322:0:21518:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789263884.670332:0:21518:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9dd883816000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789263884.670338:0:21518:0:(genops.c:1553:class_disconnect_exports()) OBD device 27 (ffff9dd88380cd28) has exports, disconnecting them 00000020:00080000:0.0:1789263884.670343:0:21518:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9dd883816000), last request at 1789263830 00000020:00000080:0.0:1789263884.670346:0:21518:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1ecde 00000020:00080000:0.0:1789263884.670355:0:21518:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dd883816000): rc 0 00000020:00000080:0.0:1789263884.670357:0:21518:0:(genops.c:885:class_export_put()) final put ffff9dd883816000/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1789263884.670386:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd883816000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1789263884.671212:0:21518:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1789263884.671216:0:21518:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789263884.671220:0:21518:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789263884.671225:0:21518:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789263884.671259:0:479:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd883814000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1789263884.671397:0:21518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789263884.671403:0:21518:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1789263884.671412:0:21518:0:(genops.c:885:class_export_put()) final put ffff9dd9bf6c0000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1789263884.671415:0:21518:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd9bf6c0000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1789263884.671423:0:21518:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:1.0:1789263884.671478:0:21518:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1789263884.671481:0:21518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789263884.671485:0:21518:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789263884.671489:0:21518:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9dd883fdb000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789263884.671498:0:21518:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff9dd99f9c4d28) has exports, disconnecting them 00000020:00080000:1.0:1789263884.671501:0:21518:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9dd883fdb000), last request at 1789263830 00000020:00000080:1.0:1789263884.671505:0:21518:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1ecf3 00000020:00080000:1.0:1789263884.671523:0:21518:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dd883fdb000): rc 0 00000020:00000080:1.0:1789263884.671527:0:21518:0:(genops.c:885:class_export_put()) final put ffff9dd883fdb000/lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1789263884.671559:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd883fdb000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:0.0:1789263884.672756:0:21518:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:0.0:1789263884.672761:0:21518:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789263884.672765:0:21518:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789263884.672769:0:21518:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789263884.672811:0:479:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd883fde000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:2.0:1789263884.672830:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1789263884.672882:0:20218:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1789263884.672943:0:17944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:3.0:1789263884.673108:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:0.0:1789263884.673206:0:17176:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9dd9bfa49e00:17176] 1 exiting: rc = 0 00000100:00100000:2.0:1789263884.673212:0:17175:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9dd9bfa49a00:17175] 0 exiting: rc = 1 00000100:00100000:3.0:1789263884.673270:0:19527:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff9dd88253f000:19527] 2 exiting: rc = 0 00000100:00100000:0.0:1789263884.673315:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263884.673624:0:20829:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff9dd8843a3a00:20829] 4 exiting: rc = 0 00000100:00100000:0.0:1789263884.673624:0:18344:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9dd988dcaa00:18344] 3 exiting: rc = 0 00000100:00100000:2.0:1789263884.673634:0:17177:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9dd9c1b62800:17177] 0 exiting: rc = 1 00000100:00100000:0.0:1789263884.673727:0:17179:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9dd9c1b62c00:17179] 2 exiting: rc = 0 00000100:00100000:3.0:1789263884.673766:0:17178:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9dd9c1b63400:17178] 1 exiting: rc = 0 00000100:00100000:0.0:1789263884.673804:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263884.673817:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263884.673830:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263884.673840:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263884.673847:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263884.673854:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263884.673864:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263884.673876:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263884.673884:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263884.673892:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263884.673900:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263884.673920:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263884.673932:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263884.673939:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263884.673946:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263884.673953:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263884.673961:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263884.673967:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263884.673973:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263884.673982:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263884.673994:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263884.674002:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263884.674010:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263884.674017:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263884.674028:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263884.674039:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263884.674047:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263884.674055:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263884.674063:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263884.674071:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263884.674114:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263884.674124:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263884.674135:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263884.674148:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263884.674157:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263884.674164:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263884.674171:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263884.674179:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263884.674187:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263884.674200:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263884.674207:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263884.674214:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263884.674221:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263884.674230:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263884.674235:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263884.674238:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263884.674241:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263884.674244:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263884.674249:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263884.674254:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263884.674259:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263884.674264:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263884.674269:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263884.674274:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263884.674279:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263884.674285:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263884.674290:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263884.674295:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263884.674300:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263884.674305:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263884.674309:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263884.674313:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263884.674318:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263884.674323:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1789263884.674915:0:21518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789263884.674929:0:21518:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:0.0:1789263884.674933:0:21518:0:(genops.c:885:class_export_put()) final put ffff9dd883fda000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:0.0:1789263884.674937:0:21518:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd883fda000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:0.0:1789263884.674942:0:21518:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:0.0:1789263884.674987:0:21518:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dd9bf6c0800 1 00000020:00000080:0.0:1789263884.674992:0:21518:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xce1582440fb1ec98 00000020:00000080:0.0:1789263884.674998:0:21518:0:(genops.c:885:class_export_put()) final put ffff9dd8810d2000/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1789263884.675014:0:21518:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1789263884.675018:0:21518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789263884.675022:0:21518:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789263884.675026:0:21518:0:(genops.c:1558:class_disconnect_exports()) OBD device 25 (ffff9dd88389cd28) has no exports 00000020:00000080:3.0:1789263884.675043:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd8810d2000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1789263884.689296:0:21518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789263884.689308:0:21518:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1789263884.689314:0:21518:0:(genops.c:885:class_export_put()) final put ffff9dd9bf6c3000/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1789263884.689318:0:21518:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd9bf6c3000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1789263884.689323:0:21518:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1789263884.689626:0:21518:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9dd9bf6c6000 00000020:01000000:3.0:1789263884.689646:0:21518:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1789263884.689650:0:21518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789263884.689654:0:21518:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789263884.689658:0:21518:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff9dd883898000) has no exports 00000020:00000080:3.0:1789263884.689678:0:21518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789263884.689683:0:21518:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1789263884.689685:0:21518:0:(genops.c:885:class_export_put()) final put ffff9dd9bfa31800/OSS_uuid 00000020:00000080:3.0:1789263884.689688:0:21518:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd9bfa31800/OSS_uuid for OSS 00000020:01000000:3.0:1789263884.689691:0:21518:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:0.0:1789263884.689738:0:17188:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1789263884.689803:0:18698:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9dd8840a4600:18698] 1 exiting: rc = 0 00000100:00100000:2.0:1789263884.689806:0:19302:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9dd8840ece00:19302] 3 exiting: rc = 0 00000100:00100000:2.0:1789263884.689894:0:18696:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9dd98e7ea600:18696] 0 exiting: rc = 1 00000100:00100000:1.0:1789263884.689947:0:19981:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff9dd88488b600:19981] 4 exiting: rc = 0 00000100:00100000:2.0:1789263884.689978:0:18699:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9dd9c0b60800:18699] 2 exiting: rc = 0 00000100:00100000:3.0:1789263884.690018:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263884.690027:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263884.690034:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263884.690043:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263884.690048:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263884.690063:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263884.690068:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263884.690074:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263884.690104:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263884.690114:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263884.690121:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263884.690132:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263884.690139:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263884.690146:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263884.690152:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263884.690157:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263884.690162:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263884.690167:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263884.690172:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263884.690176:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263884.690181:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263884.690187:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263884.690192:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263884.690197:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263884.690202:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263884.690207:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263884.690212:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263884.690217:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263884.690222:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263884.690227:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263884.690232:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263884.690236:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263884.690242:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263884.690248:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263884.690252:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263884.690257:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263884.690262:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263884.690267:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263884.690272:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263884.690277:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263884.690289:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263884.690294:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263884.690300:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263884.690305:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263884.690309:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263884.690315:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263884.690320:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263884.690324:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263884.690329:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263884.690334:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263884.690339:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263884.690344:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263884.690349:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263884.690354:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263884.690358:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263884.690364:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263884.690369:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263884.690373:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263884.690378:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263884.690383:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263884.690389:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263884.690394:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263884.690400:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789263884.690405:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263884.691172:0:18701:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9dd988d43800:18701] 1 exiting: rc = 0 00000100:00100000:2.0:1789263884.691204:0:19982:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9dd884b39200:19982] 2 exiting: rc = 0 00000100:00100000:0.0:1789263884.691209:0:18700:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9dd988e3b600:18700] 0 exiting: rc = 1 00000100:00100000:2.0:1789263884.691431:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.691438:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.691447:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.691456:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.691466:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.691475:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.691486:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.691504:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.691512:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.691523:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.691531:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.691539:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.691550:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.691561:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.691569:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.691579:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.691588:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.691600:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.691609:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.691620:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.691630:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.691641:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.691651:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.691662:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.691670:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.691679:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.691690:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.691700:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.691713:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.691723:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.691734:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.691744:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.691754:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.691765:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.691775:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.691784:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.691794:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.691805:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.691815:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.691824:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.691835:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.691845:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.691860:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.691872:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.691883:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.691893:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.691918:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.691930:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.691946:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.691954:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.691963:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.691972:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.691980:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.691989:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.691998:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.692007:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.692017:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.692026:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.692037:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.692047:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.692070:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.692101:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.692114:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.692125:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789263884.694034:0:18702:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9dd9c0ae3400:18702] 0 exiting: rc = 1 00000100:00100000:1.0:1789263884.694097:0:18704:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9dd882a21000:18704] 2 exiting: rc = 0 00000100:00100000:3.0:1789263884.694102:0:18703:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9dd88268f600:18703] 1 exiting: rc = 0 00000100:00100000:2.0:1789263884.694176:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.694191:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.694198:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.694203:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.694209:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.694215:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.694220:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.694226:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.694232:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.694237:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.694257:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.694264:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.694270:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.694284:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.694290:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.694295:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.694300:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.694306:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.694311:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.694317:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.694322:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.694328:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.694334:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.694339:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.694345:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.694351:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.694357:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.694363:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.694368:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.694373:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.694379:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.694384:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.694388:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.694394:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.694413:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.694420:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.694426:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.694431:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.694437:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.694441:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.694445:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.694449:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.694452:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.694456:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.694459:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.694463:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.694466:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.694469:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.694478:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.694482:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.694485:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.694490:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.694496:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.694501:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.694507:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.694511:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.694515:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.694518:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.694522:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.694527:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.694532:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.694536:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.694539:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.694543:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263884.697522:0:18705:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9dd988dfc800:18705] 0 exiting: rc = 1 00000100:00100000:3.0:1789263884.697524:0:18706:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9dd988dc8e00:18706] 1 exiting: rc = 0 00000100:00100000:2.0:1789263884.697660:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.697667:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.697672:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.697677:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.697683:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.697688:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.697693:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.697698:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.697703:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.697708:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.697713:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.697718:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.697723:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.697728:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.697734:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.697739:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.697744:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.697749:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.697754:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.697771:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.697777:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.697782:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.697787:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.697792:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.697798:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.697803:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.697809:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.697814:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.697820:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.697826:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.697831:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.697836:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.697840:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.697843:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.697847:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.697851:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.697856:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.697862:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.697866:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.697871:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.697877:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.697882:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.697887:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.697892:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.697897:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.697912:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.697919:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.697924:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.697936:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.697943:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.697947:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.697952:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.697958:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.697963:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.697974:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.697979:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.697985:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.697990:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.697995:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.698000:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.698004:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.698015:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.698020:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.698026:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789263884.698589:0:18707:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9dd883cbda00:18707] 0 exiting: rc = 1 00000100:00100000:0.0:1789263884.698670:0:18708:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9dd988e39e00:18708] 1 exiting: rc = 0 00000100:00100000:2.0:1789263884.698780:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.698807:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.698815:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.698822:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.698829:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.698835:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.698841:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.698848:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.698855:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.698862:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.698867:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.698875:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.698881:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.698914:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.698921:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.698926:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.698933:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.698938:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.698949:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.698956:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.698961:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.698967:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.698971:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.698974:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.698978:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.698998:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.699003:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.699008:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.699012:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.699016:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.699019:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.699024:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.699027:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.699031:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.699034:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.699037:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.699041:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.699054:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.699058:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.699062:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.699065:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.699069:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.699073:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.699169:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.699202:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.699209:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.699214:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.699219:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.699225:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.699246:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.699252:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.699256:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.699260:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.699265:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.699270:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.699277:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.699283:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.699289:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.699294:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.699299:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.699312:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.699318:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.699324:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789263884.699336:0:21518:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1789263884.703840:0:21518:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1789263891.211996:0:22282:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg320-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1789263894.837326:0:22883:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789263894.837331:0:22883:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1789263894.837333:0:22883:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1789263894.837438:0:22883:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9dd9ac8fd000 00000020:01000004:2.0:1789263894.837453:0:22883:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1789263894.837460:0:22883:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789263894.837472:0:22883:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9dd9b7980000) 00000020:00000080:2.0:1789263894.837484:0:22883:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789263894.864230:0:22883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1789263894.865099:0:22883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1789263894.866046:0:22883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1789263894.866306:0:22883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1789263894.866433:0:22883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1789263894.866562:0:22883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1789263894.866716:0:22883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1789263894.866888:0:22883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1789263894.867010:0:22883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1789263894.867151:0:22883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1789263894.867288:0:22883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1789263894.867442:0:22883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1789263894.867598:0:22883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1789263894.867833:0:22883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1789263894.869039:0:22883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1789263894.870092:0:22883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1789263894.870270:0:22883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1789263894.870433:0:22883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1789263894.870605:0:22883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1789263894.870796:0:22883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1789263894.870975:0:22883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1789263894.871147:0:22883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1789263894.871434:0:22883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1789263894.871565:0:22883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1789263894.871755:0:22883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1789263894.871922:0:22883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1789263894.872057:0:22883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1789263894.872233:0:22883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1789263894.872405:0:22883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1789263894.872549:0:22883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1789263894.873001:0:22883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1789263894.873167:0:22883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1789263894.873321:0:22883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1789263894.873470:0:22883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1789263894.873629:0:22883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1789263894.873798:0:22883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1789263894.873985:0:22883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1789263894.874163:0:22883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1789263894.874332:0:22883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1789263894.874495:0:22883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1789263894.874668:0:22883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1789263894.874821:0:22883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1789263894.875000:0:22883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1789263894.875168:0:22883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1789263894.875325:0:22883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1789263894.875470:0:22883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1789263894.875615:0:22883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1789263894.876052:0:22883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1789263894.876368:0:22883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1789263894.876535:0:22883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1789263894.876875:0:22883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1789263894.877016:0:22883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1789263894.877324:0:22883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:01000000:2.0:1789263894.877687:0:22883:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789263894.877871:0:22883:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1789263894.877877:0:22883:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789263894.877886:0:22883:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xce1582440fb1f5ac 00000020:01000004:2.0:1789263894.877891:0:22883:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1789263894.877894:0:22883:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1789263894.877897:0:22883:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9dd9ac8fd000 from MGS 00000020:01000004:2.0:1789263894.877899:0:22883:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1789263894.877907:0:22883:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9dd9b7984d28) 00000020:00000080:2.0:1789263894.877914:0:22883:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1789263894.877955:0:22883:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dd9ac8fd000 from MGS, refs=2 00080000:01000000:2.0:1789263894.877960:0:22883:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789263894.877964:0:22883:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xce1582440fb1f5ba 00000100:00100000:2.0:1789263894.878043:0:22883:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1789263894.878194:0:22883:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1789263894.878198:0:22883:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1789263894.878733:0:22883:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1789263894.878741:0:22883:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1789263894.879233:0:22883:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789263894.879384:0:22883:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1789263894.879390:0:22883:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1789263894.879708:0:22883:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1789263894.879715:0:22883:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1789263894.879945:0:22883:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1789263894.879952:0:22883:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1789263894.880302:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789263894.880304:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789263894.880306:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789263894.880452:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789263894.880454:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789263894.880457:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263894.880901:0:22883:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1789263894.883149:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1789263894.884812:0:22883:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1789263894.885262:0:22895:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1789263894.885276:0:22883:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1789263894.885305:0:22883:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789263894.885679:0:22883:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1789263894.885977:0:22883:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789263894.886132:0:22883:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1789263894.886138:0:22883:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1789263894.886549:0:22883:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1789263894.886557:0:22883:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1789263894.886760:0:22883:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1789263894.886768:0:22883:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:2.0:1789263894.887148:0:22900:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:3.0:1789263894.887328:0:22883:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1789263894.887342:0:22883:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.120@tcp' 00000020:01000004:3.0:1789263894.887344:0:22883:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1789263894.887365:0:22883:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.120@tcp (typ=mgc) 00000020:00000080:3.0:1789263894.887376:0:22883:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.120@tcp (ffff9dd8838099b8) 00000020:00000080:3.0:1789263894.887397:0:22883:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1789263894.887471:0:22883:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dd882755800@MGC192.168.203.120@tcp: add connection 192.168.203.120@tcp at head 00010000:00010000:3.0:1789263894.887601:0:22883:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.120@tcp-0 is initialized 00000040:01000000:3.0:1789263894.887614:0:22883:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.120@tcp ctxt 1 is initialized 10000000:01000000:3.0:1789263894.887850:0:22901:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1789263894.887888:0:22883:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.120@tcp (uuid ec0ec848-5fac-4f6a-ba8a-daed864d309d) 00000020:00000080:2.0:1789263894.887905:0:22883:0:(genops.c:1385:class_connect()) connect: client ec0ec848-5fac-4f6a-ba8a-daed864d309d, cookie 0xce1582440fb1f5c8 00000100:00080000:2.0:1789263894.887914:0:22883:0:(import.c:510:import_select_connection()) MGC192.168.203.120@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789263894.887919:0:22883:0:(import.c:624:import_select_connection()) MGC192.168.203.120@tcp: import ffff9dd882755800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:2.0:1789263894.887951:0:22883:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd99f9a4380 x1876178898156032/t0(0) o250->MGC192.168.203.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789263894.887974:0:22883:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import ec0ec848-5fac-4f6a-ba8a-daed864d309d->MGS 00000020:01000004:2.0:1789263894.887992:0:22883:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1789263894.887997:0:22883:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1789263894.888006:0:22883:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9dd9b7983370) 00000100:00100000:3.0:1789263894.888008:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ec0ec848-5fac-4f6a-ba8a-daed864d309d:3617:1876178898156032:0@lo:250:mount.lustre.0 00000020:00000080:2.0:1789263894.888019:0:22883:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1789263894.888067:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263894.888144:0:22896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898156032 00000100:00100000:3.0:1789263894.888149:0:22896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898156032 00000100:00100000:3.0:1789263894.888177:0:22896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789263894.888182:0:22896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9ab807450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3617:x1876178898156032:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1789263894.888201:0:22896:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from ec0ec848-5fac-4f6a-ba8a-daed864d309d@0@lo t0 exp 0000000000000000 cur 337 last 0 00000020:00000080:3.0:1789263894.888227:0:22896:0:(genops.c:1385:class_connect()) connect: client ec0ec848-5fac-4f6a-ba8a-daed864d309d, cookie 0xce1582440fb1f5d6 00000100:00080000:3.0:1789263894.888360:0:22896:0:(import.c:65:import_set_state_nolock()) ffff9dd882754800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789263894.888411:0:22896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9ab807450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+5:3617:x1876178898156032:12345-0@lo:250:mount.lustre.0 Request processed in 227us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263894.888419:0:22896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789263894.888433:0:3617:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.120@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1789263894.888447:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.120@tcp: connect to target with instance 0 00000100:00080000:0.0:1789263894.888453:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.120@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1789263894.888457:0:3617:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1789263894.888461:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd882755800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1789263894.888464:0:3617:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1789263894.888473:0:3617:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1789263894.888480:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ec0ec848-5fac-4f6a-ba8a-daed864d309d:3617:1876178898156032:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1789263894.893501:0:22883:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789263894.893653:0:22883:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1789263894.893657:0:22883:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1789263894.894029:0:22883:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1789263894.894034:0:22883:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1789263894.894255:0:22883:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1789263894.894261:0:22883:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1789263894.894750:0:22883:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789263894.894880:0:22883:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1789263894.894883:0:22883:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1789263894.895238:0:22883:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1789263894.895245:0:22883:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1789263894.914497:0:22883:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789263894.914669:0:22883:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1789263894.914675:0:22883:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1789263894.915488:0:22883:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1789263894.915496:0:22883:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1789263894.915894:0:22883:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789263894.916037:0:22883:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789263894.916042:0:22883:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1789263894.916440:0:22883:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789263894.916447:0:22883:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1789263894.916791:0:22883:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789263894.916935:0:22883:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789263894.916941:0:22883:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1789263894.917247:0:22883:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789263894.917258:0:22883:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1789263894.917620:0:22883:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789263894.917720:0:22883:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789263894.917724:0:22883:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1789263894.918025:0:22883:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789263894.918031:0:22883:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1789263894.927789:0:22883:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789263894.927979:0:22883:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789263894.927985:0:22883:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1789263894.928799:0:22883:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789263894.928804:0:22883:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1789263894.929405:0:22883:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789263894.929410:0:22883:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1789263894.929941:0:22883:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1789263894.929968:0:22883:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1789263894.929973:0:22883:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.120@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1789263894.930059:0:22883:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.120@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789263894.930105:0:22883:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.120@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1789263894.930109:0:22883:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789263894.930110:0:22883:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789263894.930111:0:22883:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789263894.930112:0:22883:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789263894.930114:0:22883:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789263894.930115:0:22883:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789263894.930116:0:22883:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789263894.930117:0:22883:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789263894.930119:0:22883:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789263894.930120:0:22883:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789263894.930122:0:22883:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1789263894.930124:0:22883:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789263894.930124:0:22883:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789263894.930125:0:22883:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789263894.930126:0:22883:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789263894.930127:0:22883:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789263894.930127:0:22883:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789263894.930128:0:22883:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789263894.930129:0:22883:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789263894.930133:0:22883:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789263894.930134:0:22883:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789263894.930165:0:22883:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789263894.930181:0:22883:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22883:1876178898156160:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789263894.930230:0:22883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263894.930262:0:22899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898156160 00000100:00100000:2.0:1789263894.930264:0:22883:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd98a3b8300 going to sleep for 11 seconds 00000100:00100000:3.0:1789263894.930275:0:22899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898156160 00000100:00100000:3.0:1789263894.930316:0:22899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789263894.930326:0:22899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9ab805850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+5:22883:x1876178898156160:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789263894.930372:0:22899:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789263894.930375:0:22899:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1789263894.930378:0:22899:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1789263894.930547:0:22919:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1789263894.930788:0:22899:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:1.0:1789263894.931587:0:22920:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1789263894.931592:0:22920:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1789263894.931595:0:22920:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1789263894.931598:0:22920:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1789263894.931743:0:22920:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1789263894.931827:0:22899:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789263894.931845:0:22899:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1789263894.932733:0:22899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9ab805850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+5:22883:x1876178898156160:12345-0@lo:253:mount.lustre.0 Request processed in 2407us (2500us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263894.932741:0:22899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789263894.932757:0:22883:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22883:1876178898156160:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789263894.932766:0:22883:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789263894.932768:0:22883:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789263894.932769:0:22883:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789263894.932770:0:22883:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789263894.932770:0:22883:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789263894.932771:0:22883:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789263894.932772:0:22883:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789263894.932773:0:22883:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789263894.932775:0:22883:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789263894.932776:0:22883:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789263894.932777:0:22883:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789263894.932789:0:22883:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9dd9ac8fd000 from lustre-MDT0000 10000000:01000000:2.0:1789263894.932806:0:22883:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1789263894.932808:0:22883:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1789263894.932811:0:22883:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9dd8838099b8 10000000:01000000:2.0:1789263894.932815:0:22883:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789263894.932822:0:22883:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9dd8838099b8 from 1 10000000:01000000:2.0:1789263894.932825:0:22883:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789263894.932862:0:22883:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22000/0xce1582440fb1f5dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263894.932871:0:22883:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22000/0xce1582440fb1f5dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263894.932878:0:22883:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22000/0xce1582440fb1f5dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263894.932896:0:22883:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22883:1876178898156288:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789263894.932918:0:22883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263894.932941:0:22883:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd98a3b8cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789263894.932977:0:22896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898156288 00000100:00100000:3.0:1789263894.932983:0:22896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898156288 00000100:00100000:3.0:1789263894.933016:0:22896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789263894.933025:0:22896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9ab807050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+5:22883:x1876178898156288:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789263894.933036:0:22896:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263894.933050:0:22896:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd981531e00/0xce1582440fb1f5e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1f5dd expref: -99 pid: 22896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263894.933110:0:22896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd981531e00/0xce1582440fb1f5e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1f5dd expref: 6 pid: 22896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263894.933122:0:22896:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd981531e00/0xce1582440fb1f5e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1f5dd expref: 6 pid: 22896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263894.933131:0:22896:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981531e00, rc 0) 00000100:00100000:3.0:1789263894.933166:0:22896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9ab807050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+6:22883:x1876178898156288:12345-0@lo:101:mount.lustre.0 Request processed in 143us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263894.933173:0:22896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789263894.933192:0:22883:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22883:1876178898156288:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789263894.933204:0:22883:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22000/0xce1582440fb1f5dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f5e4 expref: -99 pid: 22883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263894.933211:0:22883:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22000/0xce1582440fb1f5dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1f5e4 expref: -99 pid: 22883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263894.933254:0:22883:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22883:1876178898156416:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789263894.933278:0:22883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263894.933303:0:22899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898156416 00000100:00100000:2.0:1789263894.933304:0:22883:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd98a3b8cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789263894.933310:0:22899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898156416 00000100:00100000:3.0:1789263894.933339:0:22899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789263894.933348:0:22899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9ab805450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+6:22883:x1876178898156416:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789263894.933406:0:22899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9ab805450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+6:22883:x1876178898156416:12345-0@lo:501:mount.lustre.0 Request processed in 59us (126us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789263894.933411:0:22883:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22883:1876178898156416:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789263894.933418:0:22899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 10000000:01000000:2.0:1789263894.933437:0:22883:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789263894.933455:0:22883:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22000/0xce1582440fb1f5dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f5e4 expref: -99 pid: 22883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263894.933463:0:22883:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22000/0xce1582440fb1f5dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f5e4 expref: -99 pid: 22883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789263894.933470:0:22883:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9dd9ac8fd000 10000000:01000000:2.0:1789263894.933475:0:22883:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789263894.933479:0:22883:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9dd9ac8fd000 10000000:01000000:2.0:1789263894.933482:0:22883:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1789263894.933485:0:22883:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9dd9ac8fd000 from 1 10000000:01000000:2.0:1789263894.933495:0:22883:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1789263894.933508:0:22883:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22800/0xce1582440fb1f5eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263894.933512:0:22883:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22800/0xce1582440fb1f5eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263894.933517:0:22883:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22800/0xce1582440fb1f5eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263894.933524:0:22883:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22883:1876178898156544:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789263894.933541:0:22883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263894.933555:0:22883:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd98a3b8cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789263894.933572:0:22896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898156544 00000100:00100000:3.0:1789263894.933577:0:22896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898156544 00000100:00100000:3.0:1789263894.933600:0:22896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789263894.933609:0:22896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9ab804c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+6:22883:x1876178898156544:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789263894.933616:0:22896:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263894.933624:0:22896:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd981530a00/0xce1582440fb1f5f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1f5eb expref: -99 pid: 22896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263894.933636:0:22896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd981530a00/0xce1582440fb1f5f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1f5eb expref: 7 pid: 22896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263894.933644:0:22896:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd981530a00/0xce1582440fb1f5f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1f5eb expref: 7 pid: 22896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263894.933650:0:22896:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981530a00, rc 0) 00000100:00100000:3.0:1789263894.933680:0:22896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9ab804c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+7:22883:x1876178898156544:12345-0@lo:101:mount.lustre.0 Request processed in 73us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263894.933686:0:22896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789263894.933696:0:22883:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22883:1876178898156544:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789263894.933709:0:22883:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22800/0xce1582440fb1f5eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f5f2 expref: -99 pid: 22883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263894.933718:0:22883:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22800/0xce1582440fb1f5eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1f5f2 expref: -99 pid: 22883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789263894.933727:0:22883:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1789263894.933740:0:22883:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22800/0xce1582440fb1f5eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f5f2 expref: -99 pid: 22883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263894.933747:0:22883:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22800/0xce1582440fb1f5eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f5f2 expref: -99 pid: 22883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789263894.933753:0:22883:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1789263894.933757:0:22883:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789263894.933782:0:22883:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9dd9ac8fd000 10000000:01000000:2.0:1789263894.933785:0:22883:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1789263894.933788:0:22883:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1789263894.933790:0:22883:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789263894.933805:0:22883:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22c00/0xce1582440fb1f5f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263894.933812:0:22883:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22c00/0xce1582440fb1f5f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263894.933819:0:22883:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22c00/0xce1582440fb1f5f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263894.933831:0:22883:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22883:1876178898156672:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789263894.933867:0:22883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263894.933881:0:22883:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd98a3b8cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789263894.933891:0:22899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898156672 00000100:00100000:3.0:1789263894.933896:0:22899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898156672 00000100:00100000:3.0:1789263894.933920:0:22899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789263894.933927:0:22899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9ab804850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+7:22883:x1876178898156672:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789263894.933940:0:22899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263894.933948:0:22899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd981530200/0xce1582440fb1f600 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1f5f9 expref: -99 pid: 22899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263894.933961:0:22899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd981530200/0xce1582440fb1f600 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1f5f9 expref: 8 pid: 22899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263894.933969:0:22899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd981530200/0xce1582440fb1f600 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1f5f9 expref: 8 pid: 22899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263894.933975:0:22899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981530200, rc 0) 00000100:00100000:3.0:1789263894.934003:0:22899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9ab804850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+8:22883:x1876178898156672:12345-0@lo:101:mount.lustre.0 Request processed in 76us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263894.934009:0:22899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789263894.934025:0:22883:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22883:1876178898156672:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789263894.934034:0:22883:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22c00/0xce1582440fb1f5f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f600 expref: -99 pid: 22883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263894.934039:0:22883:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22c00/0xce1582440fb1f5f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1f600 expref: -99 pid: 22883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263894.934063:0:22883:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22883:1876178898156800:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789263894.934114:0:22883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263894.934135:0:22883:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd98a3b8cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789263894.934142:0:22896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898156800 00000100:00100000:3.0:1789263894.934147:0:22896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898156800 00000100:00100000:3.0:1789263894.934170:0:22896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789263894.934177:0:22896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9ab807850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+8:22883:x1876178898156800:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789263894.934265:0:22896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9ab807850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+9:22883:x1876178898156800:12345-0@lo:501:mount.lustre.0 Request processed in 88us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263894.934273:0:22896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789263894.934279:0:22883:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22883:1876178898156800:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789263894.934309:0:22883:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22883:1876178898156928:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789263894.934336:0:22883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263894.934347:0:22883:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd98a3b8cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789263894.934364:0:22899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898156928 00000100:00100000:3.0:1789263894.934369:0:22899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898156928 00000100:00100000:3.0:1789263894.934392:0:22899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789263894.934399:0:22899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9ab804450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+9:22883:x1876178898156928:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789263894.934773:0:22899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9ab804450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+9:22883:x1876178898156928:12345-0@lo:503:mount.lustre.0 Request processed in 374us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263894.934784:0:22899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789263894.934804:0:22883:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22883:1876178898156928:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789263894.935161:0:22921:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaace00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22921:1876178898157056:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789263894.935196:0:22921:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263894.935225:0:22896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898157056 00000100:00100000:0.0:1789263894.935227:0:22921:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd98615ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1789263894.935232:0:22896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898157056 00000100:00100000:3.0:1789263894.935261:0:22896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789263894.935266:0:22896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9ab807c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+9:22921:x1876178898157056:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789263894.935646:0:22896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9ab807c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+9:22921:x1876178898157056:12345-0@lo:502:llog_process_th.0 Request processed in 379us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263894.935653:0:22896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789263894.935687:0:22921:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaace00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22921:1876178898157056:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789263894.935711:0:22921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789263894.935719:0:22921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789263894.935721:0:22921:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1789263894.935725:0:22921:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1789263894.935728:0:22921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789263894.935738:0:22921:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9dd9c09c3370) 00000020:00000080:0.0:1789263894.935758:0:22921:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1789263894.935765:0:22921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1789263894.935856:0:22921:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:0.0:1789263894.935863:0:22921:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xce1582440fb1f60e 00000020:00000080:0.0:1789263894.936044:0:22921:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1789263894.936047:0:22921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789263894.936050:0:22921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789263894.936051:0:22921:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1789263894.936053:0:22921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789263894.936055:0:22921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789263894.936056:0:22921:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1789263894.936058:0:22921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789263894.936067:0:22921:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9dd9c09c0000) 00000020:00000080:0.0:1789263894.936073:0:22921:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1789263894.936105:0:22921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1789263894.936107:0:22921:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1789263894.936110:0:22921:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1789263894.936115:0:22921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789263894.936162:0:22921:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dd9ac8fd000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1789263894.936174:0:22921:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9dd9c09c19b8) 00000020:00000080:0.0:1789263894.936182:0:22921:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1789263894.936228:0:22921:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1789263894.936231:0:22921:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xce1582440fb1f623 00000020:00000080:0.0:1789263894.936300:0:22921:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1789263894.936306:0:22921:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1789263894.936310:0:22921:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xce1582440fb1f62a 00080000:01000000:0.0:1789263894.936314:0:22921:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:0.0:1789263894.936318:0:22921:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xce1582440fb1f631 00010000:00010000:0.0:1789263894.971137:0:22921:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:0.0:1789263894.971460:0:22921:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934675 00000001:00080000:0.0:1789263894.971742:0:22921:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1789263894.972154:0:22921:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9dd9c09c4d28) 00000020:00000080:0.0:1789263894.972169:0:22921:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1789263894.972248:0:22921:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:0.0:1789263894.972257:0:22921:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xce1582440fb1f63f 00000020:00000080:3.0:1789263894.972783:0:22921:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1789263894.974949:0:22921:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xce1582440fb1f646 00000020:00000080:3.0:1789263894.975582:0:22921:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1789263894.975594:0:22921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789263894.975600:0:22921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789263894.975602:0:22921:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1789263894.975605:0:22921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789263894.975608:0:22921:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1789263894.975610:0:22921:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789263894.975611:0:22921:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789263894.975613:0:22921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789263894.975620:0:22921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789263894.975621:0:22921:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789263894.975623:0:22921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789263894.975628:0:22921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789263894.975629:0:22921:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1789263894.975633:0:22921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1789263894.975669:0:22921:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1789263894.975690:0:22921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789263894.975693:0:22921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789263894.975694:0:22921:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1789263894.975696:0:22921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789263894.975699:0:22921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789263894.975705:0:22921:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1789263894.975708:0:22921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789263894.975713:0:22921:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.120@tcp to nid 0x20000c0a8cb78 (192.168.203.120@tcp) 00000020:00000080:3.0:1789263894.975734:0:22921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789263894.975747:0:22921:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9dd88380b370) 00000020:00000080:3.0:1789263894.975758:0:22921:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1789263894.975763:0:22921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789263894.975823:0:22921:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1789263894.975828:0:22921:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789263894.975845:0:22921:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xce1582440fb1f654 00010000:00080000:3.0:1789263894.975873:0:22921:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dd990819800@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.120@tcp at head 00010000:00010000:3.0:1789263894.977388:0:22921:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:3.0:1789263894.977860:0:22921:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789263894.977867:0:22921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1789263894.977888:0:22921:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789263894.977899:0:22921:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xce1582440fb1f65b 00000100:00080000:3.0:1789263894.977906:0:22921:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789263894.977910:0:22921:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9dd990819800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:3.0:1789263894.977936:0:22921:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd883b6df80 x1876178898157184/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789263894.977958:0:22921:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1789263894.978004:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883b6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1876178898157184:0@lo:38:llog_process_th.0 00000020:01000000:3.0:1789263894.978021:0:22921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789263894.978027:0:22921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789263894.978029:0:22921:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1789263894.978032:0:22921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789263894.978035:0:22921:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:3.0:1789263894.978037:0:22921:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789263894.978039:0:22921:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789263894.978041:0:22921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789263894.978045:0:22921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789263894.978046:0:22921:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789263894.978056:0:22921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789263894.978061:0:22921:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1789263894.978066:0:22921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789263894.978067:0:22921:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1789263894.978071:0:22921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789263894.978095:0:22921:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.120@tcp to nid 0x20000c0a8cb78 (192.168.203.120@tcp) 00000100:00100000:0.0:1789263894.978105:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1789263894.978118:0:22921:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789263894.978122:0:22921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789263894.978133:0:22921:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9dd883808000) 00000020:00000080:3.0:1789263894.978147:0:22921:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000100:00100000:1.0:1789263894.978149:0:22908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898157184 00000020:00000080:3.0:1789263894.978154:0:22921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00100000:1.0:1789263894.978158:0:22908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898157184 00000100:00100000:1.0:1789263894.978196:0:22908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789263894.978203:0:22909:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:1.0:1789263894.978203:0:22908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3617:x1876178898157184:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789263894.978216:0:22909:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00010000:00020000:1.0:1789263894.978220:0:22908:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000004:00080000:3.0:1789263894.978224:0:22921:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1789263894.978230:0:22921:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:3.0:1789263894.978240:0:22921:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xce1582440fb1f669 00010000:00080000:3.0:1789263894.978266:0:22921:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dd9838d5000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.120@tcp at head 00010000:00010000:3.0:1789263894.978458:0:22921:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1789263894.979053:0:22921:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789263894.979231:0:22921:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789263894.980581:0:22921:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789263894.980764:0:22921:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:3.0:1789263894.983225:0:22921:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:3.0:1789263894.983451:0:22928:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1789263894.983456:0:22928:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1789263894.983861:0:22921:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789263894.983871:0:22921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789263894.983921:0:22921:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789263894.983940:0:22921:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xce1582440fb1f670 00000100:00080000:0.0:1789263894.983949:0:22921:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789263894.983955:0:22921:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9dd9838d5000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:0.0:1789263894.983995:0:22921:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd9bfaad180 x1876178898157312/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789263894.984019:0:22921:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:3.0:1789263894.984063:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1876178898157312:0@lo:8:llog_process_th.0 00000020:01000000:0.0:1789263894.984121:0:22921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789263894.984127:0:22921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789263894.984129:0:22921:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1789263894.984134:0:22921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000400:00000100:3.0:1789263894.984138:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876178898157312 offset 0 length 520: 4 00000020:01000000:0.0:1789263894.984140:0:22921:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:0.0:1789263894.984144:0:22921:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789263894.984147:0:22921:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789263894.984149:0:22921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789263894.984153:0:22921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789263894.984155:0:22921:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789263894.984159:0:22921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789263894.984174:0:22921:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1789263894.984179:0:22921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789263894.984180:0:22921:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1789263894.984185:0:22921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789263894.984189:0:22921:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.120@tcp to nid 0x20000c0a8cb78 (192.168.203.120@tcp) 00000020:01000000:0.0:1789263894.984210:0:22921:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789263894.984213:0:22921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789263894.984223:0:22921:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9dd9c1bacd28) 00000020:00000080:0.0:1789263894.984235:0:22921:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:0.0:1789263894.984240:0:22921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789263894.984295:0:22921:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1789263894.984300:0:22921:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:0.0:1789263894.984305:0:22921:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xce1582440fb1f67e 00010000:00080000:0.0:1789263894.984330:0:22921:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dd9c088f000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.120@tcp at head 00010000:00010000:0.0:1789263894.984544:0:22921:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1789263894.984602:0:22921:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789263894.984616:0:22921:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789263894.986014:0:22921:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789263894.986195:0:22921:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:0.0:1789263894.986322:0:22921:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:3.0:1789263894.986631:0:22930:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1789263894.986636:0:22930:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1789263894.987184:0:22921:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789263894.987193:0:22921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789263894.987224:0:22921:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789263894.987241:0:22921:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xce1582440fb1f685 00000100:00080000:0.0:1789263894.987248:0:22921:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789263894.987254:0:22921:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9dd9c088f000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:0.0:1789263894.987280:0:22921:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd9bfaaf800 x1876178898157440/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789263894.987297:0:22921:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:1.0:1789263894.987324:0:22908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3617:x1876178898157184:12345-0@lo:38:llog_process_th.0 Request processed in 9119us (9249us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789263894.987334:0:22908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:01000000:0.0:1789263894.987347:0:22921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789263894.987350:0:22921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789263894.987352:0:22921:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1789263894.987355:0:22921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789263894.987358:0:22921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789263894.987360:0:22921:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789263894.987363:0:22921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789263894.987365:0:22921:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789263894.987367:0:22921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789263894.987369:0:22921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789263894.987371:0:22921:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789263894.987373:0:22921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789263894.987375:0:22921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789263894.987376:0:22921:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789263894.987379:0:22921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789263894.987408:0:22921:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaaed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22921:1876178898157568:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789263894.987459:0:22921:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263894.987498:0:22921:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd989b53840 going to sleep for 11 seconds 00000100:00100000:2.0:1789263894.987505:0:22899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898157568 00000100:00100000:2.0:1789263894.987513:0:22899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898157568 00000100:00100000:2.0:1789263894.987553:0:22899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789263894.987563:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1876178898157440:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1789263894.987563:0:22899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9ab806450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+9:22921:x1876178898157568:12345-0@lo:502:llog_process_th.0 00000400:00000100:3.0:1789263894.987606:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876178898157440 offset 0 length 520: 4 00000100:00080000:3.0:1789263894.987646:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd990819800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789263894.987651:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789263894.987655:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883b6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1876178898157184:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789263894.987671:0:22899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9ab806450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+9:22921:x1876178898157568:12345-0@lo:502:llog_process_th.0 Request processed in 110us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263894.987679:0:22899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789263894.987711:0:22921:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaaed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22921:1876178898157568:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789263894.987735:0:22921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789263894.987740:0:22921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789263894.987742:0:22921:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789263894.987745:0:22921:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1789263894.987812:0:22883:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1789263894.987848:0:22883:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789263894.987863:0:22883:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22c00/0xce1582440fb1f5f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f600 expref: -99 pid: 22883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263894.987875:0:22883:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22c00/0xce1582440fb1f5f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f600 expref: -99 pid: 22883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789263894.987883:0:22883:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9dd9ac8fd000 from 1 10000000:01000000:2.0:1789263894.987886:0:22883:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789263894.987909:0:22883:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22400/0xce1582440fb1f68c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263894.987917:0:22883:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22400/0xce1582440fb1f68c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263894.987925:0:22883:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22400/0xce1582440fb1f68c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263894.987944:0:22883:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22883:1876178898157696:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789263894.987971:0:22883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263894.987989:0:22883:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd98a3b86c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789263894.988014:0:22896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898157696 00000100:00100000:3.0:1789263894.988018:0:22896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898157696 00000100:00100000:3.0:1789263894.988046:0:22896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789263894.988056:0:22896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9ab806050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+9:22883:x1876178898157696:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789263894.988065:0:22896:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263894.988104:0:22896:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd981531a00/0xce1582440fb1f693 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1f68c expref: -99 pid: 22896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263894.988125:0:22896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd981531a00/0xce1582440fb1f693 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1f68c expref: 10 pid: 22896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263894.988135:0:22896:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd981531a00/0xce1582440fb1f693 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1f68c expref: 10 pid: 22896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263894.988144:0:22896:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981531a00, rc 0) 00000100:00100000:3.0:1789263894.988174:0:22896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9ab806050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+10:22883:x1876178898157696:12345-0@lo:101:mount.lustre.0 Request processed in 121us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263894.988180:0:22896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789263894.988190:0:22883:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22883:1876178898157696:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789263894.988204:0:22883:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22400/0xce1582440fb1f68c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f693 expref: -99 pid: 22883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263894.988214:0:22883:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22400/0xce1582440fb1f68c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1f693 expref: -99 pid: 22883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263894.988697:0:22883:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22883:1876178898157824:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1789263894.988727:0:22883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263894.988754:0:22883:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd98a3b86c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789263894.988768:0:22898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898157824 00000100:00100000:0.0:1789263894.988777:0:22898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898157824 00000100:00100000:0.0:1789263894.988808:0:22898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789263894.988817:0:22898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9ab805c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec0ec848-5fac-4f6a-ba8a-daed864d309d+10:22883:x1876178898157824:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1789263894.988849:0:22898:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1789263894.988855:0:22898:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1789263894.988934:0:22898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9ab805c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec0ec848-5fac-4f6a-ba8a-daed864d309d+10:22883:x1876178898157824:12345-0@lo:256:mount.lustre.0 Request processed in 117us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263894.988943:0:22883:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22883:1876178898157824:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1789263894.988944:0:22898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 10000000:01000000:2.0:1789263894.989490:0:22883:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789263894.989507:0:22883:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22400/0xce1582440fb1f68c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f693 expref: -99 pid: 22883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263894.989515:0:22883:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22400/0xce1582440fb1f68c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f693 expref: -99 pid: 22883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789263894.989522:0:22883:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dd9ac8fd000 from 1 10000000:01000000:2.0:1789263894.989525:0:22883:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789263894.989544:0:22883:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22200/0xce1582440fb1f69a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263894.989585:0:22883:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22200/0xce1582440fb1f69a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263894.989593:0:22883:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22200/0xce1582440fb1f69a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263894.989606:0:22883:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22883:1876178898157952:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789263894.989633:0:22883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263894.989656:0:22883:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd98a3b86c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789263894.989679:0:22896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898157952 00000100:00100000:3.0:1789263894.989685:0:22896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898157952 00000100:00100000:3.0:1789263894.989716:0:22896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789263894.989726:0:22896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9ab804050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+10:22883:x1876178898157952:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789263894.989735:0:22896:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263894.989745:0:22896:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd981531600/0xce1582440fb1f6a1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1f69a expref: -99 pid: 22896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263894.989771:0:22896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd981531600/0xce1582440fb1f6a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1f69a expref: 11 pid: 22896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263894.989780:0:22896:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd981531600/0xce1582440fb1f6a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1f69a expref: 11 pid: 22896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263894.989787:0:22896:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981531600, rc 0) 00000100:00100000:3.0:1789263894.989820:0:22896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9ab804050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+11:22883:x1876178898157952:12345-0@lo:101:mount.lustre.0 Request processed in 97us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263894.989827:0:22896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789263894.989832:0:22883:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22883:1876178898157952:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789263894.989856:0:22883:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22200/0xce1582440fb1f69a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f6a1 expref: -99 pid: 22883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263894.989866:0:22883:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22200/0xce1582440fb1f69a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1f6a1 expref: -99 pid: 22883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263894.989910:0:22883:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22883:1876178898158080:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789263894.989931:0:22883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263894.989948:0:22883:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd98a3b86c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789263894.989977:0:22898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898158080 00000100:00100000:0.0:1789263894.989982:0:22898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898158080 00000100:00100000:0.0:1789263894.990006:0:22898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789263894.990012:0:22898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9ab805050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec0ec848-5fac-4f6a-ba8a-daed864d309d+11:22883:x1876178898158080:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789263894.990177:0:22898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9ab805050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec0ec848-5fac-4f6a-ba8a-daed864d309d+11:22883:x1876178898158080:12345-0@lo:501:mount.lustre.0 Request processed in 163us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263894.990186:0:22898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789263894.990193:0:22883:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22883:1876178898158080:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789263894.990218:0:22883:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22883:1876178898158208:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789263894.990250:0:22883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263894.990269:0:22883:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd98a3b86c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789263894.990294:0:22896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898158208 00000100:00100000:3.0:1789263894.990299:0:22896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898158208 00000100:00100000:3.0:1789263894.990334:0:22896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789263894.990354:0:22896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+11:22883:x1876178898158208:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789263894.990430:0:22896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+11:22883:x1876178898158208:12345-0@lo:503:mount.lustre.0 Request processed in 78us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263894.990438:0:22896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789263894.990448:0:22883:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22883:1876178898158208:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789263894.991093:0:22932:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22932:1876178898158336:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789263894.991138:0:22932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263894.991172:0:22932:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd98a3b8840 going to sleep for 11 seconds 00000100:00100000:0.0:1789263894.991231:0:22898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898158336 00000100:00100000:0.0:1789263894.991237:0:22898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898158336 00000100:00100000:0.0:1789263894.991266:0:22898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789263894.991275:0:22898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec0ec848-5fac-4f6a-ba8a-daed864d309d+11:22932:x1876178898158336:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789263894.991733:0:22898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec0ec848-5fac-4f6a-ba8a-daed864d309d+11:22932:x1876178898158336:12345-0@lo:502:llog_process_th.0 Request processed in 458us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263894.991742:0:22898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789263894.991763:0:22932:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22932:1876178898158336:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789263894.991785:0:22932:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789263894.991792:0:22932:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263894.991793:0:22932:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789263894.991798:0:22932:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dd9ac8fd000 00000020:00000080:2.0:1789263894.991800:0:22932:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789263894.991806:0:22932:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789263894.991808:0:22932:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263894.991810:0:22932:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1789263894.991812:0:22932:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789263894.991814:0:22932:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263894.991815:0:22932:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789263894.991819:0:22932:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dd9ac8fd000 00000020:00000080:2.0:1789263894.991821:0:22932:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789263894.991879:0:22932:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789263894.991883:0:22932:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263894.991884:0:22932:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1789263894.991886:0:22932:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789263894.991888:0:22932:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263894.991889:0:22932:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789263894.991891:0:22932:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9dd9ac8fd000 00000020:00000080:2.0:1789263894.991893:0:22932:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789263894.991904:0:22932:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789263894.991906:0:22932:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263894.991906:0:22932:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789263894.991908:0:22932:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789263894.991909:0:22932:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263894.991910:0:22932:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1789263894.991912:0:22932:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9dd9ac8fd000 00000020:00000080:2.0:1789263894.991913:0:22932:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789263894.991940:0:22932:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22932:1876178898158464:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789263894.991977:0:22932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263894.991997:0:22932:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd98a3b8840 going to sleep for 11 seconds 00000100:00100000:3.0:1789263894.992025:0:22896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898158464 00000100:00100000:3.0:1789263894.992030:0:22896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898158464 00000100:00100000:3.0:1789263894.992067:0:22896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789263894.992098:0:22896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+11:22932:x1876178898158464:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789263894.992190:0:22896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+11:22932:x1876178898158464:12345-0@lo:502:llog_process_th.0 Request processed in 116us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263894.992198:0:22896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789263894.992227:0:22932:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22932:1876178898158464:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789263894.992248:0:22932:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789263894.992252:0:22932:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263894.992254:0:22932:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1789263894.992257:0:22932:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1789263894.992320:0:22883:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1789263894.992346:0:22883:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789263894.992370:0:22883:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22200/0xce1582440fb1f69a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f6a1 expref: -99 pid: 22883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263894.992380:0:22883:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22200/0xce1582440fb1f69a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f6a1 expref: -99 pid: 22883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789263894.992423:0:22883:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789263894.992425:0:22883:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9dd9ac8fd000 10000000:01000000:3.0:1789263894.992428:0:22883:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9dd9ac8fd000 10000000:01000000:3.0:1789263894.992433:0:22883:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789263894.992437:0:22883:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9dd9ac8fd000 from 1 10000000:01000000:3.0:1789263894.992439:0:22883:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789263894.992463:0:22883:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd981530400/0xce1582440fb1f6a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263894.992471:0:22883:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd981530400/0xce1582440fb1f6a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263894.992479:0:22883:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd981530400/0xce1582440fb1f6a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263894.992492:0:22883:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883b6df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22883:1876178898158592:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789263894.992527:0:22883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263894.992553:0:22883:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9b7a9e300 going to sleep for 11 seconds 00000100:00100000:2.0:1789263894.992561:0:22898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898158592 00000100:00100000:2.0:1789263894.992567:0:22898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898158592 00000100:00100000:2.0:1789263894.992593:0:22898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789263894.992601:0:22898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec0ec848-5fac-4f6a-ba8a-daed864d309d+11:22883:x1876178898158592:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789263894.992610:0:22898:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263894.992629:0:22898:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd9bfa23e00/0xce1582440fb1f6af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1f6a8 expref: -99 pid: 22898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263894.992651:0:22898:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd9bfa23e00/0xce1582440fb1f6af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1f6a8 expref: 12 pid: 22898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263894.992661:0:22898:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd9bfa23e00/0xce1582440fb1f6af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1f6a8 expref: 12 pid: 22898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263894.992668:0:22898:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bfa23e00, rc 0) 00000100:00100000:2.0:1789263894.992712:0:22898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec0ec848-5fac-4f6a-ba8a-daed864d309d+12:22883:x1876178898158592:12345-0@lo:101:mount.lustre.0 Request processed in 112us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263894.992719:0:22898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789263894.992791:0:22883:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883b6df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22883:1876178898158592:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789263894.992803:0:22883:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd981530400/0xce1582440fb1f6a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f6af expref: -99 pid: 22883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263894.992812:0:22883:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd981530400/0xce1582440fb1f6a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1f6af expref: -99 pid: 22883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263894.992881:0:22883:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883b6df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22883:1876178898158720:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789263894.992906:0:22883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263894.992920:0:22883:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9b7a9e300 going to sleep for 11 seconds 00000100:00100000:2.0:1789263894.992937:0:22896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898158720 00000100:00100000:2.0:1789263894.992942:0:22896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898158720 00000100:00100000:2.0:1789263894.992966:0:22896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789263894.992978:0:22896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+12:22883:x1876178898158720:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789263894.993096:0:22896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+12:22883:x1876178898158720:12345-0@lo:501:mount.lustre.0 Request processed in 118us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263894.993104:0:22896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789263894.993147:0:22883:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883b6df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22883:1876178898158720:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789263894.993175:0:22883:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883b6df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22883:1876178898158848:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789263894.993214:0:22883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263894.993238:0:22898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898158848 00000100:00100000:3.0:1789263894.993240:0:22883:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9b7a9e300 going to sleep for 11 seconds 00000100:00100000:2.0:1789263894.993243:0:22898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898158848 00000100:00100000:2.0:1789263894.993272:0:22898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789263894.993281:0:22898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec0ec848-5fac-4f6a-ba8a-daed864d309d+12:22883:x1876178898158848:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789263894.993354:0:22898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec0ec848-5fac-4f6a-ba8a-daed864d309d+12:22883:x1876178898158848:12345-0@lo:503:mount.lustre.0 Request processed in 75us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263894.993362:0:22898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789263894.993368:0:22883:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883b6df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22883:1876178898158848:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789263894.993564:0:22934:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883b6df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22934:1876178898158976:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789263894.993600:0:22934:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263894.993617:0:22934:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9b7a9e180 going to sleep for 11 seconds 00000100:00100000:2.0:1789263894.993622:0:22896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898158976 00000100:00100000:2.0:1789263894.993627:0:22896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898158976 00000100:00100000:2.0:1789263894.993655:0:22896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789263894.993663:0:22896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+12:22934:x1876178898158976:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789263894.993736:0:22896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+12:22934:x1876178898158976:12345-0@lo:502:llog_process_th.0 Request processed in 74us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263894.993743:0:22896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789263894.993750:0:22934:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883b6df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22934:1876178898158976:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1789263894.993808:0:22934:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1789263894.993821:0:22934:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9dd88380cd28) 00000020:00000080:3.0:1789263894.993852:0:22934:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:3.0:1789263894.993958:0:22934:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dd9ac8fd000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789263894.993962:0:22934:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dd9ac8fd000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789263894.993965:0:22934:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dd9ac8fd000 4 00010000:00080000:3.0:1789263894.993998:0:22934:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dd989981800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.120@tcp at head 00010000:00010000:3.0:1789263894.995812:0:22934:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:3.0:1789263894.996002:0:22934:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1789263894.996030:0:22934:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789263894.996039:0:22934:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xce1582440fb1f6bd 00000100:00080000:3.0:1789263894.996046:0:22934:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789263894.996057:0:22934:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9dd989981800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:3.0:1789263894.996108:0:22934:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd883b6df80 x1876178898159104/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789263894.996142:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883b6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876178898159104:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789263894.996191:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263894.996232:0:22903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898159104 00000100:00080000:3.0:1789263894.996239:0:22934:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789263894.996239:0:22903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898159104 00000100:00100000:0.0:1789263894.996275:0:22903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789263894.996281:0:22903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883b6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3617:x1876178898159104:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789263894.996284:0:22904:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1789263894.996291:0:22904:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1789263894.996337:0:22903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883b6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3617:x1876178898159104:12345-0@lo:38:llog_process_th.0 Request processed in 53us (144us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789263894.996349:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00100000:0.0:1789263894.996353:0:22903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1789263894.996356:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd989981800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789263894.996361:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789263894.996365:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883b6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876178898159104:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789263894.996450:0:22934:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883b6df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22934:1876178898159232:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789263894.996497:0:22934:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263894.996520:0:22934:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9b7a9e600 going to sleep for 11 seconds 00000100:00100000:2.0:1789263894.996530:0:22898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898159232 00000100:00100000:2.0:1789263894.996535:0:22898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898159232 00000100:00100000:2.0:1789263894.996571:0:22898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789263894.996580:0:22898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec0ec848-5fac-4f6a-ba8a-daed864d309d+12:22934:x1876178898159232:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789263894.996681:0:22898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec0ec848-5fac-4f6a-ba8a-daed864d309d+12:22934:x1876178898159232:12345-0@lo:502:llog_process_th.0 Request processed in 102us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263894.996694:0:22934:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883b6df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22934:1876178898159232:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789263894.996701:0:22898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789263894.996745:0:22934:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883b6df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22934:1876178898159360:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789263894.996784:0:22934:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263894.996807:0:22934:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9b7a9e600 going to sleep for 11 seconds 00000100:00100000:2.0:1789263894.996808:0:22896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898159360 00000100:00100000:2.0:1789263894.996813:0:22896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898159360 00000100:00100000:2.0:1789263894.996853:0:22896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789263894.996869:0:22896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+12:22934:x1876178898159360:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789263894.996943:0:22896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+12:22934:x1876178898159360:12345-0@lo:502:llog_process_th.0 Request processed in 83us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263894.996950:0:22896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789263894.996963:0:22934:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883b6df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22934:1876178898159360:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789263894.996990:0:22934:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1789263894.997051:0:22883:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1789263894.997072:0:22883:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789263894.997105:0:22883:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd981530400/0xce1582440fb1f6a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f6af expref: -99 pid: 22883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263894.997115:0:22883:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd981530400/0xce1582440fb1f6a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f6af expref: -99 pid: 22883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789263894.997161:0:22883:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789263894.997163:0:22883:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789263894.997164:0:22883:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789263894.997165:0:22883:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789263894.997166:0:22883:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789263894.997168:0:22883:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789263894.997169:0:22883:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789263894.997170:0:22883:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789263894.997172:0:22883:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789263894.997173:0:22883:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789263894.997176:0:22883:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1789263894.997179:0:22883:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789263894.997180:0:22883:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789263894.997181:0:22883:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789263894.997182:0:22883:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789263894.997188:0:22883:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789263894.997190:0:22883:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789263894.997191:0:22883:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789263894.997192:0:22883:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789263894.997193:0:22883:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789263894.997194:0:22883:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789263894.997207:0:22883:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789263894.997215:0:22883:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22883:1876178898159488:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789263894.997245:0:22883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263894.997269:0:22883:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd98a6a26c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789263894.997395:0:22899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898159488 00000100:00100000:3.0:1789263894.997400:0:22899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898159488 00000100:00100000:3.0:1789263894.997438:0:22899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789263894.997449:0:22899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+12:22883:x1876178898159488:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789263894.997468:0:22899:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789263894.997491:0:22899:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789263894.999140:0:22899:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789263894.999156:0:22899:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1789263894.999159:0:22919:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789263894.999163:0:22919:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789263894.999182:0:22919:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dd987f50c00/0xce1582440fb1f6c4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263894.999198:0:22919:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd981531a00/0xce1582440fb1f693 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1f68c expref: 12 pid: 22896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263894.999208:0:22919:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dd987f50c00/0xce1582440fb1f6c4 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263894.999242:0:22919:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd981531a00/0xce1582440fb1f693 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce1582440fb1f68c expref: 12 pid: 22896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263894.999258:0:22919:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dd981531a00/0xce1582440fb1f693 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce1582440fb1f68c expref: 12 pid: 22896 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263894.999272:0:22919:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaaf100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22919:1876178898159616:0@lo:104: 00000100:00100000:0.0:1789263894.999322:0:22919:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263894.999356:0:22919:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9c0be3600 going to sleep for 11 seconds 00000100:00100000:2.0:1789263894.999359:0:22899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+12:22883:x1876178898159488:12345-0@lo:253:mount.lustre.0 Request processed in 1913us (2111us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263894.999368:0:22899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789263894.999417:0:22887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898159616 00000100:00100000:2.0:1789263894.999423:0:22887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898159616 00000100:00100000:2.0:1789263894.999454:0:22887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789263894.999462:0:22887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+3:22919:x1876178898159616:12345-0@lo:104: 00010000:00010000:2.0:1789263894.999474:0:22887:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22400/0xce1582440fb1f68c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1f693 expref: -99 pid: 22883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263894.999521:0:22887:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789263894.999526:0:22887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+3:22919:x1876178898159616:12345-0@lo:104: Request processed in 66us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263894.999528:0:22919:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaaf100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22919:1876178898159616:0@lo:104: 00000100:00100000:2.0:1789263894.999532:0:22887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1789263894.999543:0:22919:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dd987f50c00/0xce1582440fb1f6c4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263894.999559:0:22883:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22883:1876178898159488:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789263894.999570:0:22883:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789263894.999573:0:22883:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789263894.999574:0:22883:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789263894.999576:0:22883:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789263894.999583:0:22883:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789263894.999584:0:22883:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789263894.999586:0:22883:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789263894.999588:0:22883:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789263894.999589:0:22883:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789263894.999591:0:22883:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789263894.999593:0:22883:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789263894.999603:0:22883:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1789263895.003120:0:22893:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789263895.003130:0:22893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22400/0xce1582440fb1f68c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1f693 expref: -99 pid: 22883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263895.003141:0:22893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bfa22400 already unused, calling callback (ffffffffc12b1c20) 10000000:00010000:0.0:1789263895.003152:0:22893:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22400/0xce1582440fb1f68c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xce1582440fb1f693 expref: -99 pid: 22883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263895.003163:0:22893:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22400/0xce1582440fb1f68c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xce1582440fb1f693 expref: -99 pid: 22883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789263895.003172:0:22893:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22400/0xce1582440fb1f68c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xce1582440fb1f693 expref: -99 pid: 22883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789263895.003178:0:22893:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789263895.003224:0:22893:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22400/0xce1582440fb1f68c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1f693 expref: -99 pid: 22883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263895.003231:0:22893:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789263895.003255:0:22893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22400/0xce1582440fb1f68c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1f693 expref: -99 pid: 22883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263895.003262:0:22893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22400/0xce1582440fb1f68c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1f693 expref: -99 pid: 22883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263895.003281:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263895.003284:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263895.003286:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789263895.003321:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec0ec848-5fac-4f6a-ba8a-daed864d309d:3618:1876178898159744:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789263895.003380:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263895.003491:0:22889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898159744 00000100:00100000:3.0:1789263895.003498:0:22889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898159744 00010000:00010000:3.0:1789263895.003527:0:22889:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd981531a00/0xce1582440fb1f693 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1f68c expref: 12 pid: 22896 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263895.003559:0:22889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789263895.003569:0:22889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaafb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+12:3618:x1876178898159744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789263895.003581:0:22889:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789263895.003587:0:22889:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd981531a00/0xce1582440fb1f693 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1f68c expref: 12 pid: 22896 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263895.003599:0:22889:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd981531a00/0xce1582440fb1f693 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce1582440fb1f68c expref: 12 pid: 22896 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263895.003613:0:22889:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd981531a00/0xce1582440fb1f693 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce1582440fb1f68c expref: 12 pid: 22896 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263895.003630:0:22889:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dd987f50c00/0xce1582440fb1f6c4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263895.003638:0:22889:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd987f50c00/0xce1582440fb1f6c4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789263895.003653:0:22889:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004489663s 00010000:00010000:3.0:1789263895.003658:0:22889:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd987f50c00/0xce1582440fb1f6c4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263895.003666:0:22889:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd987f50c00/0xce1582440fb1f6c4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263895.003674:0:22889:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dd987f50c00/0xce1582440fb1f6c4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263895.003687:0:22889:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dd987f50c00/0xce1582440fb1f6c4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263895.003694:0:22889:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd987f50c00 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:3.0:1789263895.003699:0:22889:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dd987f50c00/0xce1582440fb1f6c4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263895.003707:0:22889:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dd987f50c00/0xce1582440fb1f6c4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263895.003813:0:22919:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dd987f50c00/0xce1582440fb1f6c4 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263895.003822:0:22919:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dd987f50c00/0xce1582440fb1f6c4 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263895.003873:0:22889:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dd987f50c00/0xce1582440fb1f6c4 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263895.003882:0:22889:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd987f50c00/0xce1582440fb1f6c4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263895.003899:0:22889:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789263895.003943:0:22889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaafb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+11:3618:x1876178898159744:12345-0@lo:103:ldlm_bl.0 Request processed in 376us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263895.003951:0:22889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789263895.003968:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec0ec848-5fac-4f6a-ba8a-daed864d309d:3618:1876178898159744:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1789263895.009652:0:22883:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967518 00000040:01000000:2.0:1789263895.009916:0:22883:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1789263895.009929:0:22945:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967518 00000020:00080000:1.0:1789263895.009933:0:22945:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967518 00000040:01000000:1.0:1789263895.010113:0:22946:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789263895.010114:0:22883:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:1.0:1789263895.010364:0:22946:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:3.0:1789263895.010401:0:22947:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9dd883b6df80 x1876178898159872/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263895.010414:0:22947:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9b7a9e600 going to sleep for 0 seconds 00000040:01000000:2.0:1789263895.010634:0:22883:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1789263895.010672:0:22883:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1789263895.015805:0:22883:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1789263895.015822:0:22883:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1789263895.015913:0:22883:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789263895.026778:0:22946:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000040:00080000:3.0:1789263895.026809:0:22883:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000004:00080000:1.0:1789263895.026879:0:22946:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:3.0:1789263895.027347:0:22883:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1789263895.027376:0:22883:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1789263895.027863:0:22883:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:3.0:1789263895.028274:0:22883:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:3.0:1789263895.029578:0:22883:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:3.0:1789263895.030525:0:22883:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1789263895.030548:0:22883:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb38e41c67988 00100000:10000000:3.0:1789263895.030554:0:22883:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1789263895.030907:0:22883:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789263895.030920:0:22883:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.120@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789263895.030940:0:22883:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=45 00000080:00000004:2.0:1789263895.030952:0:22883:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1789263895.031825:0:22883:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789263895.031996:0:22883:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789263895.918176:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789263896.045289:0:22947:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9b7a9e600 going to sleep for 0 seconds 00000040:00080000:2.0:1789263896.045579:0:22941:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789263896.045585:0:22941:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789263896.046471:0:22941:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 4 count 4 00000040:00080000:2.0:1789263896.046480:0:22941:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000001:02000400:3.0:1789263896.479948:0:23190:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg320-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:3.0:1789263896.749189:0:22901:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789263896.749195:0:22901:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9dd9ac8fd000 from 11 10000000:01000000:3.0:1789263896.749200:0:22901:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789263896.749248:0:22901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd981531a00/0xce1582440fb1f6cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263896.749260:0:22901:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd981531a00/0xce1582440fb1f6cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263896.749271:0:22901:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd981531a00/0xce1582440fb1f6cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263896.749293:0:22901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883b6ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22901:1876178898160000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789263896.749354:0:22901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263896.749428:0:22901:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd98556f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789263896.749457:0:22896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898160000 00000100:00100000:2.0:1789263896.749464:0:22896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898160000 00000100:00100000:2.0:1789263896.749520:0:22896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789263896.749528:0:22896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+11:22901:x1876178898160000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789263896.749539:0:22896:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263896.749550:0:22896:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd9bfa22600/0xce1582440fb1f6d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1f6cb expref: -99 pid: 22896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263896.749584:0:22896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd9bfa22600/0xce1582440fb1f6d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1f6cb expref: 12 pid: 22896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263896.749594:0:22896:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd9bfa22600/0xce1582440fb1f6d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1f6cb expref: 12 pid: 22896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263896.749603:0:22896:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bfa22600, rc 0) 00000100:00100000:2.0:1789263896.749647:0:22896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+12:22901:x1876178898160000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263896.749658:0:22896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789263896.749700:0:22901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883b6ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22901:1876178898160000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789263896.749712:0:22901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd981531a00/0xce1582440fb1f6cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f6d2 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263896.749719:0:22901:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd981531a00/0xce1582440fb1f6cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1f6d2 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263896.749755:0:22901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883b6ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22901:1876178898160128:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789263896.749776:0:22901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263896.749794:0:22901:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd98556f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789263896.749839:0:22899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898160128 00000100:00100000:2.0:1789263896.749844:0:22899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898160128 00000100:00100000:2.0:1789263896.749863:0:22899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789263896.749868:0:22899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+12:22901:x1876178898160128:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789263896.749879:0:22899:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789263896.749895:0:22899:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789263896.749898:0:22899:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:2.0:1789263896.749977:0:22899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+12:22901:x1876178898160128:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 107us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263896.749983:0:22899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789263896.749990:0:22901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883b6ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22901:1876178898160128:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789263896.750022:0:22901:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789263896.750026:0:22901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd981531a00/0xce1582440fb1f6cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f6d2 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263896.750031:0:22901:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd981531a00/0xce1582440fb1f6cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f6d2 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000004:2.0:1789263896.830285:0:23242:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789263896.830453:0:23242:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789263896.941288:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789263897.069177:0:22947:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9b7a9e600 going to sleep for 0 seconds 00000040:00080000:2.0:1789263897.069258:0:22941:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789263897.069265:0:22941:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789263897.069288:0:22941:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 4 count 4 00000040:00080000:2.0:1789263897.069298:0:22941:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000020:00000004:0.0:1789263897.144285:0:23293:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789263897.144403:0:23293:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789263897.965190:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789263898.093177:0:22947:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9b7a9e600 going to sleep for 0 seconds 00010000:00010000:2.0:1789263898.989199:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789263899.117243:0:22947:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9b7a9e600 going to sleep for 0 seconds 00000020:01000004:3.0:1789263899.576567:0:23637:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789263899.576570:0:23637:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1789263899.576571:0:23637:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1789263899.576643:0:23637:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9dd883f8c000 00000020:01000004:3.0:1789263899.576654:0:23637:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:3.0:1789263899.576663:0:23637:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789263899.576674:0:23637:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9dd98731cd28) 00000020:00000080:3.0:1789263899.576686:0:23637:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789263899.616838:0:23637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1789263899.617561:0:23637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1789263899.622870:0:23637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:2.0:1789263899.623097:0:23637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1789263899.623540:0:23637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1789263899.623725:0:23637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:2.0:1789263899.623939:0:23637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1789263899.624127:0:23637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1789263899.624343:0:23637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1789263899.624512:0:23637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:2.0:1789263899.624651:0:23637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1789263899.628009:0:23637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1789263899.628312:0:23637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1789263899.628774:0:23637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1789263899.629425:0:23637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:2.0:1789263899.629686:0:23637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1789263899.629910:0:23637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1789263899.630374:0:23637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1789263899.630644:0:23637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:2.0:1789263899.630843:0:23637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1789263899.631022:0:23637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:2.0:1789263899.631261:0:23637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1789263899.631480:0:23637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1789263899.631658:0:23637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:2.0:1789263899.632541:0:23637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1789263899.632791:0:23637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1789263899.632979:0:23637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1789263899.633395:0:23637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:2.0:1789263899.633646:0:23637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:2.0:1789263899.633870:0:23637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1789263899.634120:0:23637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1789263899.634275:0:23637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1789263899.634572:0:23637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1789263899.634885:0:23637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1789263899.635391:0:23637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1789263899.635584:0:23637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:2.0:1789263899.635797:0:23637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:2.0:1789263899.636102:0:23637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1789263899.636415:0:23637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1789263899.636672:0:23637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:2.0:1789263899.636894:0:23637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1789263899.637169:0:23637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1789263899.637427:0:23637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1789263899.637580:0:23637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1789263899.637832:0:23637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1789263899.638000:0:23637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00080000:01000000:2.0:1789263899.638671:0:23637:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789263899.638900:0:23637:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1789263899.638911:0:23637:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789263899.638922:0:23637:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xce1582440fb1f6e0 00000020:01000004:2.0:1789263899.638929:0:23637:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1789263899.638950:0:23637:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.120@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789263899.638953:0:23637:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.120@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789263899.638966:0:23637:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1789263899.639003:0:23637:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1789263899.639008:0:23637:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.120@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1789263899.642134:0:23637:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.120@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789263899.642167:0:23637:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.120@tcp, index=0001, flags=0x20001 00000020:01000004:2.0:1789263899.642172:0:23637:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789263899.642173:0:23637:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789263899.642174:0:23637:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789263899.642175:0:23637:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789263899.642177:0:23637:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789263899.642178:0:23637:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789263899.642179:0:23637:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789263899.642181:0:23637:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789263899.642183:0:23637:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789263899.642186:0:23637:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:2.0:1789263899.642188:0:23637:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789263899.642189:0:23637:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789263899.642191:0:23637:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789263899.642192:0:23637:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789263899.642193:0:23637:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789263899.642194:0:23637:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789263899.642195:0:23637:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789263899.642196:0:23637:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789263899.642197:0:23637:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789263899.642222:0:23637:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1789263899.642240:0:23637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:23637:1876178898160256:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789263899.642305:0:23637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263899.642354:0:23637:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd99060d180 going to sleep for 11 seconds 00000100:00100000:0.0:1789263899.642370:0:22896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898160256 00000100:00100000:0.0:1789263899.642379:0:22896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898160256 00000100:00100000:0.0:1789263899.642435:0:22896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789263899.642445:0:22896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+12:23637:x1876178898160256:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789263899.642475:0:22896:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789263899.642479:0:22896:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:0.0:1789263899.642486:0:22896:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1789263899.642693:0:22896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+12:23637:x1876178898160256:12345-0@lo:253:mount.lustre.0 Request processed in 249us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263899.642701:0:22896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789263899.642734:0:23637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:23637:1876178898160256:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789263899.642747:0:23637:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1789263899.642750:0:23637:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789263899.642751:0:23637:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789263899.642752:0:23637:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789263899.642753:0:23637:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789263899.642755:0:23637:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789263899.642762:0:23637:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789263899.642763:0:23637:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789263899.642765:0:23637:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789263899.642765:0:23637:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789263899.642781:0:23637:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9dd883f8c000 from lustre-MDT0001 10000000:01000000:2.0:1789263899.642819:0:23637:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1789263899.642823:0:23637:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1789263899.642829:0:23637:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9dd8838099b8 local copy 00010000:00010000:2.0:1789263899.642839:0:23637:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22000/0xce1582440fb1f5dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f5e4 expref: -99 pid: 22883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263899.642916:0:23637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:23637:1876178898160384:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789263899.642945:0:23637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263899.642967:0:23637:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd98de43d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789263899.643022:0:22899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898160384 00000100:00100000:3.0:1789263899.643026:0:22899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898160384 00000100:00100000:3.0:1789263899.643051:0:22899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789263899.643055:0:22899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+12:23637:x1876178898160384:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789263899.643147:0:22899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+12:23637:x1876178898160384:12345-0@lo:501:mount.lustre.0 Request processed in 90us (201us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789263899.643156:0:22899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789263899.643170:0:23637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:23637:1876178898160384:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789263899.643189:0:23637:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.120@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789263899.643211:0:23637:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.120@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789263899.643217:0:23637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22000/0xce1582440fb1f5dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f5e4 expref: -99 pid: 22883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263899.643226:0:23637:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22000/0xce1582440fb1f5dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f5e4 expref: -99 pid: 22883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789263899.643245:0:23637:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9dd883f8c000 10000000:01000000:2.0:1789263899.643249:0:23637:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789263899.643253:0:23637:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9dd8838099b8 10000000:01000000:2.0:1789263899.643256:0:23637:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1789263899.643259:0:23637:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9dd8838099b8 from 1 10000000:01000000:2.0:1789263899.643262:0:23637:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789263899.643291:0:23637:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23c00/0xce1582440fb1f6e7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263899.643303:0:23637:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23c00/0xce1582440fb1f6e7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263899.643314:0:23637:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23c00/0xce1582440fb1f6e7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263899.643326:0:23637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:23637:1876178898160512:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789263899.643352:0:23637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263899.643375:0:23637:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd98de43d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789263899.643393:0:22896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898160512 00000100:00100000:0.0:1789263899.643399:0:22896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898160512 00000100:00100000:0.0:1789263899.643425:0:22896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789263899.643431:0:22896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+12:23637:x1876178898160512:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789263899.643441:0:22896:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263899.643454:0:22896:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd987f51600/0xce1582440fb1f6ee lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1f6e7 expref: -99 pid: 22896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263899.643475:0:22896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd987f51600/0xce1582440fb1f6ee lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1f6e7 expref: 13 pid: 22896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263899.643485:0:22896:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd987f51600/0xce1582440fb1f6ee lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1f6e7 expref: 13 pid: 22896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263899.643505:0:22896:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd987f51600, rc 0) 00000100:00100000:0.0:1789263899.643539:0:22896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+13:23637:x1876178898160512:12345-0@lo:101:mount.lustre.0 Request processed in 108us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263899.643546:0:22896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789263899.643570:0:23637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:23637:1876178898160512:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789263899.643584:0:23637:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23c00/0xce1582440fb1f6e7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f6ee expref: -99 pid: 23637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263899.643594:0:23637:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23c00/0xce1582440fb1f6e7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1f6ee expref: -99 pid: 23637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789263899.643607:0:23637:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789263899.643623:0:23637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23c00/0xce1582440fb1f6e7 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f6ee expref: -99 pid: 23637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263899.643631:0:23637:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23c00/0xce1582440fb1f6e7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f6ee expref: -99 pid: 23637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789263899.643639:0:23637:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9dd883f8c000 10000000:01000000:2.0:1789263899.643643:0:23637:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1789263899.643646:0:23637:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9dd883f8c000 from 1 10000000:01000000:2.0:1789263899.643649:0:23637:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1789263899.643671:0:23637:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23800/0xce1582440fb1f6f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263899.643678:0:23637:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23800/0xce1582440fb1f6f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263899.643685:0:23637:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23800/0xce1582440fb1f6f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263899.643697:0:23637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:23637:1876178898160640:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789263899.643722:0:23637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263899.643741:0:23637:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd98de43d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789263899.643783:0:22899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898160640 00000100:00100000:3.0:1789263899.643788:0:22899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898160640 00000100:00100000:3.0:1789263899.643833:0:22899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789263899.643841:0:22899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+13:23637:x1876178898160640:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789263899.643856:0:22899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263899.643865:0:22899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd981530c00/0xce1582440fb1f6fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1f6f5 expref: -99 pid: 22899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263899.643879:0:22899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd981530c00/0xce1582440fb1f6fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1f6f5 expref: 14 pid: 22899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263899.643888:0:22899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd981530c00/0xce1582440fb1f6fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1f6f5 expref: 14 pid: 22899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263899.643894:0:22899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981530c00, rc 0) 00000100:00100000:3.0:1789263899.643924:0:22899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+14:23637:x1876178898160640:12345-0@lo:101:mount.lustre.0 Request processed in 84us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263899.643931:0:22899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789263899.643943:0:23637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:23637:1876178898160640:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789263899.643956:0:23637:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23800/0xce1582440fb1f6f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f6fc expref: -99 pid: 23637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263899.643965:0:23637:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23800/0xce1582440fb1f6f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1f6fc expref: -99 pid: 23637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789263899.643975:0:23637:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1789263899.643989:0:23637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23800/0xce1582440fb1f6f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f6fc expref: -99 pid: 23637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263899.643996:0:23637:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23800/0xce1582440fb1f6f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f6fc expref: -99 pid: 23637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789263899.644002:0:23637:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1789263899.644006:0:23637:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789263899.644009:0:23637:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9dd883f8c000 10000000:01000000:2.0:1789263899.644017:0:23637:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1789263899.644020:0:23637:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1789263899.644022:0:23637:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1789263899.644035:0:23637:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22e00/0xce1582440fb1f703 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263899.644042:0:23637:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22e00/0xce1582440fb1f703 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263899.644050:0:23637:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22e00/0xce1582440fb1f703 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263899.644063:0:23637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:23637:1876178898160768:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789263899.644112:0:23637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263899.644134:0:23637:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd98de43d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789263899.644156:0:22896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898160768 00000100:00100000:0.0:1789263899.644162:0:22896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898160768 00000100:00100000:0.0:1789263899.644190:0:22896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789263899.644196:0:22896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+14:23637:x1876178898160768:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789263899.644204:0:22896:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263899.644213:0:22896:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd987f51c00/0xce1582440fb1f70a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1f703 expref: -99 pid: 22896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263899.644235:0:22896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd987f51c00/0xce1582440fb1f70a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1f703 expref: 15 pid: 22896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263899.644243:0:22896:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd987f51c00/0xce1582440fb1f70a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1f703 expref: 15 pid: 22896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263899.644250:0:22896:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd987f51c00, rc 0) 00000100:00100000:0.0:1789263899.644282:0:22896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+15:23637:x1876178898160768:12345-0@lo:101:mount.lustre.0 Request processed in 85us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263899.644289:0:22896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789263899.644300:0:23637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:23637:1876178898160768:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789263899.644313:0:23637:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22e00/0xce1582440fb1f703 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f70a expref: -99 pid: 23637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263899.644321:0:23637:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22e00/0xce1582440fb1f703 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1f70a expref: -99 pid: 23637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789263899.645131:0:23637:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:2.0:1789263899.645645:0:23637:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789263899.648664:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1789263899.648713:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:2.0:1789263899.648730:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:2.0:1789263899.648743:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:2.0:1789263899.648757:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:2.0:1789263899.648772:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:2.0:1789263899.648796:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:2.0:1789263899.648825:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:2.0:1789263899.648838:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:2.0:1789263899.648849:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:2.0:1789263899.648861:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:2.0:1789263899.648888:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:2.0:1789263899.648906:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:2.0:1789263899.648920:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:2.0:1789263899.648934:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:2.0:1789263899.648948:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:2.0:1789263899.648975:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:2.0:1789263899.648990:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:2.0:1789263899.649003:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:2.0:1789263899.649015:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:2.0:1789263899.649028:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:2.0:1789263899.649041:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:2.0:1789263899.649055:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:2.0:1789263899.649071:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:2.0:1789263899.649129:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:2.0:1789263899.649145:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:2.0:1789263899.649159:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:2.0:1789263899.649193:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:2.0:1789263899.649209:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:2.0:1789263899.649222:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:2.0:1789263899.649235:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:2.0:1789263899.649246:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:2.0:1789263899.649258:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:2.0:1789263899.649270:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:2.0:1789263899.649283:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:2.0:1789263899.649295:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:2.0:1789263899.649308:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:2.0:1789263899.649323:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:2.0:1789263899.649337:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:2.0:1789263899.649359:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:2.0:1789263899.649373:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:2.0:1789263899.649385:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:2.0:1789263899.649397:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:2.0:1789263899.649426:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:2.0:1789263899.649452:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:2.0:1789263899.649458:0:23637:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:2.0:1789263899.649561:0:23637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:23637:1876178898160896:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789263899.649622:0:23637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263899.649670:0:23637:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd98de439c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789263899.649714:0:22899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898160896 00000100:00100000:3.0:1789263899.649723:0:22899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898160896 00000100:00100000:3.0:1789263899.649775:0:22899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789263899.649786:0:22899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+15:23637:x1876178898160896:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789263899.649941:0:22899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+15:23637:x1876178898160896:12345-0@lo:501:mount.lustre.0 Request processed in 157us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263899.649949:0:22899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789263899.649976:0:23637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:23637:1876178898160896:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789263899.650008:0:23637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:23637:1876178898161024:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789263899.650046:0:23637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263899.650068:0:23637:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd98de439c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789263899.650136:0:22896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898161024 00000100:00100000:0.0:1789263899.650141:0:22896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898161024 00000100:00100000:0.0:1789263899.650176:0:22896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789263899.650184:0:22896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+15:23637:x1876178898161024:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789263899.651020:0:22896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+15:23637:x1876178898161024:12345-0@lo:503:mount.lustre.0 Request processed in 835us (972us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263899.651035:0:22896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789263899.651041:0:23637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:23637:1876178898161024:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789263899.651452:0:23637:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789263899.651503:0:23637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:23637:1876178898161152:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789263899.651532:0:23637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263899.651562:0:23637:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9812eda80 going to sleep for 11 seconds 00000100:00100000:3.0:1789263899.651628:0:22899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898161152 00000100:00100000:3.0:1789263899.651633:0:22899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898161152 00000100:00100000:3.0:1789263899.651670:0:22899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789263899.651677:0:22899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+15:23637:x1876178898161152:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789263899.652287:0:22899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+15:23637:x1876178898161152:12345-0@lo:502:mount.lustre.0 Request processed in 610us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263899.652304:0:22899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789263899.652315:0:23637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:23637:1876178898161152:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789263899.652485:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1789263899.652510:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:2.0:1789263899.652523:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:2.0:1789263899.652536:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:2.0:1789263899.652549:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:2.0:1789263899.652560:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:2.0:1789263899.652571:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:2.0:1789263899.652593:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:2.0:1789263899.652606:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:2.0:1789263899.652619:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:2.0:1789263899.652632:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:2.0:1789263899.652646:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:2.0:1789263899.652674:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:2.0:1789263899.652689:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:2.0:1789263899.652703:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:2.0:1789263899.652716:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:2.0:1789263899.652729:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:2.0:1789263899.652742:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:2.0:1789263899.652754:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:2.0:1789263899.652766:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:2.0:1789263899.652779:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:2.0:1789263899.652794:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:2.0:1789263899.652818:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:2.0:1789263899.652834:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:2.0:1789263899.652847:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:2.0:1789263899.652858:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:2.0:1789263899.652870:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:2.0:1789263899.652883:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:2.0:1789263899.652908:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:2.0:1789263899.652976:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:2.0:1789263899.652990:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:2.0:1789263899.652996:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:2.0:1789263899.653003:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:2.0:1789263899.653009:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:2.0:1789263899.653016:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:2.0:1789263899.653022:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:2.0:1789263899.653028:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:2.0:1789263899.653035:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:2.0:1789263899.653041:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:2.0:1789263899.653048:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:2.0:1789263899.653062:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:2.0:1789263899.653069:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:2.0:1789263899.653118:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:2.0:1789263899.653135:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:2.0:1789263899.653168:0:23637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:23637:1876178898161280:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789263899.653198:0:23637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263899.653215:0:23637:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9812eda80 going to sleep for 11 seconds 00000100:00100000:0.0:1789263899.653272:0:22896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898161280 00000100:00100000:0.0:1789263899.653277:0:22896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898161280 00000100:00100000:0.0:1789263899.653308:0:22896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789263899.653313:0:22896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa60850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+15:23637:x1876178898161280:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789263899.653426:0:22896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa60850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+15:23637:x1876178898161280:12345-0@lo:502:mount.lustre.0 Request processed in 112us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263899.653434:0:22896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789263899.653493:0:23637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:23637:1876178898161280:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789263899.653530:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:2.0:1789263899.653538:0:23637:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:2.0:1789263899.654264:0:23641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789263899.654274:0:23641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263899.654277:0:23641:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1789263899.654282:0:23641:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1789263899.654285:0:23641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789263899.654297:0:23641:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9dd9b79819b8) 00000020:00000080:2.0:1789263899.654314:0:23641:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:2.0:1789263899.654320:0:23641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1789263899.654386:0:23641:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789263899.654393:0:23641:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xce1582440fb1f718 00000020:00000080:2.0:1789263899.654586:0:23641:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1789263899.654591:0:23641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789263899.654595:0:23641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263899.654596:0:23641:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1789263899.654599:0:23641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789263899.654603:0:23641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263899.654604:0:23641:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1789263899.654607:0:23641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789263899.654615:0:23641:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9dd9bf8f19b8) 00000020:00000080:2.0:1789263899.654625:0:23641:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:2.0:1789263899.654629:0:23641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1789263899.654636:0:23641:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1789263899.654638:0:23641:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1789263899.654644:0:23641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789263899.654697:0:23641:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dd883f8c000 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1789263899.654709:0:23641:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9dd9bf8f3370) 00000020:00000080:2.0:1789263899.654718:0:23641:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:2.0:1789263899.654773:0:23641:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1789263899.654779:0:23641:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xce1582440fb1f72d 00000020:00000080:2.0:1789263899.654876:0:23641:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1789263899.654883:0:23641:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1789263899.654887:0:23641:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xce1582440fb1f734 00080000:01000000:2.0:1789263899.654893:0:23641:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:2.0:1789263899.654896:0:23641:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xce1582440fb1f73b 00010000:00010000:2.0:1789263899.691224:0:23641:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1789263899.691574:0:23641:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:2.0:1789263899.691836:0:23641:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789263899.692558:0:23641:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1789263899.692569:0:23641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789263899.692575:0:23641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263899.692578:0:23641:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1789263899.692581:0:23641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789263899.692586:0:23641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263899.692588:0:23641:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1789263899.692591:0:23641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789263899.692596:0:23641:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.120@tcp to nid 0x20000c0a8cb78 (192.168.203.120@tcp) 00000020:00000080:2.0:1789263899.692624:0:23641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789263899.692637:0:23641:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9dd9bf8f0000) 00000020:00000080:2.0:1789263899.692655:0:23641:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:2.0:1789263899.692659:0:23641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789263899.692711:0:23641:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1789263899.692715:0:23641:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:2.0:1789263899.692721:0:23641:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xce1582440fb1f749 00010000:00080000:2.0:1789263899.692752:0:23641:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dd9bf99a800@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.120@tcp at head 00010000:00010000:2.0:1789263899.694438:0:23641:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:2.0:1789263899.695145:0:23641:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789263899.695156:0:23641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1789263899.695187:0:23641:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789263899.695210:0:23641:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xce1582440fb1f750 00000100:00080000:2.0:1789263899.695219:0:23641:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789263899.695224:0:23641:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9dd9bf99a800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:2.0:1789263899.695251:0:23641:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd99f9a6680 x1876178898161408/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789263899.695271:0:23641:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789263899.695297:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1876178898161408:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1789263899.695326:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789263899.695331:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000020:01000000:2.0:1789263899.695333:0:23641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00080000:0.0:1789263899.695334:0:38:0:(import.c:65:import_set_state_nolock()) ffff9dd990819800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000020:00000080:2.0:1789263899.695338:0:23641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263899.695341:0:23641:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000100:00080000:0.0:1789263899.695342:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 337 00000020:01000000:2.0:1789263899.695346:0:23641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000100:00080000:0.0:1789263899.695349:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000020:01000000:2.0:1789263899.695350:0:23641:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1789263899.695354:0:23641:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789263899.695357:0:23641:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000100:00080000:0.0:1789263899.695358:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9dd990819800 using connection 192.168.203.120@tcp/0@lo 00000020:01000000:2.0:1789263899.695361:0:23641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789263899.695366:0:23641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263899.695368:0:23641:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789263899.695371:0:23641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789263899.695377:0:23641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263899.695379:0:23641:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000100:00100000:0.0:1789263899.695380:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd9bfaaf100 x1876178898161536/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000080:2.0:1789263899.695387:0:23641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00080000:0.0:1789263899.695396:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789263899.695400:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789263899.695402:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789263899.695405:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789263899.695408:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789263899.695411:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789263899.695413:0:38:0:(import.c:65:import_set_state_nolock()) ffff9dd989981800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000004:01000000:2.0:1789263899.695423:0:23641:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00080000:0.0:1789263899.695424:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9dd989981800 using connection 192.168.203.120@tcp/0@lo 00000020:01000000:2.0:1789263899.695441:0:23641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789263899.695446:0:23641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263899.695448:0:23641:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1789263899.695452:0:23641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000100:00100000:0.0:1789263899.695454:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd9bfaaca80 x1876178898161664/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:01000000:2.0:1789263899.695455:0:23641:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:2.0:1789263899.695457:0:23641:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000100:00100000:3.0:1789263899.695461:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1789263899.695466:0:23641:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789263899.695470:0:23641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789263899.695475:0:23641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263899.695477:0:23641:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789263899.695480:0:23641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789263899.695483:0:23641:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1789263899.695487:0:23641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263899.695488:0:23641:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1789263899.695491:0:23641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789263899.695494:0:23641:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.120@tcp to nid 0x20000c0a8cb78 (192.168.203.120@tcp) 00000020:01000000:2.0:1789263899.695513:0:23641:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000100:00100000:3.0:1789263899.695514:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1876178898161536:0@lo:38:kworker.0 00000020:00000080:2.0:1789263899.695516:0:23641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000100:00100000:0.0:1789263899.695521:0:22909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898161408 00000020:00000080:2.0:1789263899.695527:0:23641:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9dd9bf8f4d28) 00000100:00100000:0.0:1789263899.695527:0:22909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898161408 00000020:00000080:2.0:1789263899.695543:0:23641:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000100:00100000:3.0:1789263899.695544:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:2.0:1789263899.695549:0:23641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00100000:0.0:1789263899.695559:0:22909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898161536 00000100:00100000:0.0:1789263899.695562:0:22909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898161536 00000100:00100000:3.0:1789263899.695566:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876178898161664:0@lo:38:kworker.0 00000100:00100000:0.0:1789263899.695576:0:22909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789263899.695581:0:22909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883b6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3617:x1876178898161408:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789263899.695608:0:22909:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 341 last 0 00000004:00080000:2.0:1789263899.695617:0:23641:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1789263899.695627:0:23641:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1789263899.695639:0:23641:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xce1582440fb1f765 00000020:00000080:0.0:1789263899.695646:0:22909:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xce1582440fb1f75e 00000004:00100000:0.0:1789263899.695661:0:22909:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1789263899.695667:0:22909:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00010000:00080000:2.0:1789263899.695674:0:23641:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dd98850d800@lustre-OST0000-osc-MDT0001: add connection 192.168.203.120@tcp at head 00000100:00100000:1.0:1789263899.695683:0:22927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789263899.695691:0:22927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883b6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3617:x1876178898161536:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1789263899.695742:0:22927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883b6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3617:x1876178898161536:12345-0@lo:38:kworker.0 Request processed in 49us (196us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789263899.695751:0:22927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1789263899.695950:0:23641:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000040:01000000:2.0:1789263899.696785:0:23641:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1789263899.696822:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263899.696879:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789263899.696887:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd990819800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789263899.696890:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789263899.696895:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1876178898161536:0@lo:38:kworker.0 00000100:00100000:3.0:1789263899.696958:0:22905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898161664 00000100:00100000:3.0:1789263899.696965:0:22905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898161664 00000100:00100000:3.0:1789263899.696999:0:22905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789263899.697003:0:22905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883b6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3617:x1876178898161664:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1789263899.697019:0:22905:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 341 last 0 00000040:01000000:2.0:1789263899.697046:0:23641:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000020:00000080:3.0:1789263899.697052:0:22905:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xce1582440fb1f76c 00000004:00100000:3.0:1789263899.697061:0:22905:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789263899.697181:0:22905:0:(import.c:65:import_set_state_nolock()) ffff9dd882b2f800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789263899.697226:0:22905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883b6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1876178898161664:12345-0@lo:38:kworker.0 Request processed in 222us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263899.697231:0:22905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789263899.697260:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9dd9bfaaca80 x1876178898161664/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789263909 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789263899.697284:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1789263899.697291:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1789263899.697295:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789263899.697298:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd989981800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789263899.697303:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876178898161664:0@lo:38:kworker.0 00000100:00080000:0.0:1789263899.698202:0:22909:0:(import.c:65:import_set_state_nolock()) ffff9dd884b2b000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789263899.698268:0:22909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883b6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3617:x1876178898161408:12345-0@lo:38:llog_process_th.0 Request processed in 2684us (2808us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263899.698280:0:22909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789263899.698305:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789263899.698313:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1789263899.698318:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1789263899.698322:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789263899.698324:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd9bf99a800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789263899.698340:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1876178898161408:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789263899.698399:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883b6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898161792:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789263899.698438:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263899.698484:0:22908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898161792 00000100:00100000:2.0:1789263899.698490:0:22908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898161792 00000100:00100000:2.0:1789263899.698531:0:22908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789263899.698542:0:22908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3619:x1876178898161792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789263899.698568:0:22908:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446297600 avail 1300058112 00000040:00080000:1.0:1789263899.698582:0:23641:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789263899.698633:0:22908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3619:x1876178898161792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263899.698639:0:22908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789263899.698664:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883b6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898161792:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1789263899.698787:0:23641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:1.0:1789263899.698930:0:23641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1789263899.699156:0:23646:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1789263899.699161:0:23646:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1789263899.699484:0:23641:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789263899.699494:0:23641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789263899.699536:0:23641:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789263899.699554:0:23641:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xce1582440fb1f773 00000100:00080000:3.0:1789263899.699560:0:23641:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789263899.699565:0:23641:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9dd98850d800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:3.0:1789263899.699585:0:23641:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd883b6ce00 x1876178898161920/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789263899.699606:0:23641:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:2.0:1789263899.699635:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883b6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1876178898161920:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1789263899.699648:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789263899.699654:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789263899.699657:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789263899.699660:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:3.0:1789263899.699661:0:23641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789263899.699667:0:23641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000400:00000100:2.0:1789263899.699669:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876178898161920 offset 0 length 520: 4 00000020:00000080:3.0:1789263899.699671:0:23641:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1789263899.699678:0:23641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789263899.699681:0:23641:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:3.0:1789263899.699684:0:23641:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789263899.699686:0:23641:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789263899.699688:0:23641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789263899.699690:0:23641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789263899.699692:0:23641:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789263899.699696:0:23641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789263899.699700:0:23641:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1789263899.699710:0:23641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789263899.699712:0:23641:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1789263899.699715:0:23641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789263899.699719:0:23641:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.120@tcp to nid 0x20000c0a8cb78 (192.168.203.120@tcp) 00000020:01000000:3.0:1789263899.699740:0:23641:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1789263899.699743:0:23641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789263899.699754:0:23641:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9dd9873199b8) 00000020:00000080:3.0:1789263899.699763:0:23641:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:3.0:1789263899.699766:0:23641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789263899.699819:0:23641:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1789263899.699824:0:23641:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789263899.699828:0:23641:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xce1582440fb1f781 00010000:00080000:3.0:1789263899.699848:0:23641:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dd9862e5800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.120@tcp at head 00010000:00010000:3.0:1789263899.700018:0:23641:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1789263899.700071:0:23641:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789263899.700109:0:23641:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1789263899.701507:0:23641:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789263899.701752:0:23641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:3.0:1789263899.701893:0:23641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:1.0:1789263899.702196:0:23648:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1789263899.702200:0:23648:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1789263899.702558:0:23641:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789263899.702567:0:23641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789263899.702597:0:23641:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789263899.702614:0:23641:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xce1582440fb1f788 00000100:00080000:3.0:1789263899.702622:0:23641:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789263899.702627:0:23641:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9dd9862e5800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:3.0:1789263899.702654:0:23641:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd883b6e680 x1876178898162048/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789263899.702685:0:23641:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:2.0:1789263899.702715:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883b6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1876178898162048:0@lo:8:llog_process_th.0 00000020:01000000:3.0:1789263899.702745:0:23641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789263899.702750:0:23641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789263899.702760:0:23641:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1789263899.702764:0:23641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789263899.702769:0:23641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789263899.702771:0:23641:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789263899.702775:0:23641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000400:00000100:2.0:1789263899.702776:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876178898162048 offset 0 length 520: 4 00000020:00000080:3.0:1789263899.702778:0:23641:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789263899.702784:0:23641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789263899.702787:0:23641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789263899.702788:0:23641:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789263899.702791:0:23641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789263899.702794:0:23641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789263899.702796:0:23641:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789263899.702811:0:23641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1789263899.702832:0:23641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789263899.702835:0:23641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789263899.702837:0:23641:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789263899.702840:0:23641:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000020:01000000:2.0:1789263899.702906:0:23637:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:2.0:1789263899.702944:0:23637:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1789263899.702964:0:23637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22e00/0xce1582440fb1f703 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f70a expref: -99 pid: 23637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263899.702972:0:23637:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22e00/0xce1582440fb1f703 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f70a expref: -99 pid: 23637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789263899.702974:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789263899.702982:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 10000000:01000000:2.0:1789263899.702984:0:23637:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9dd883f8c000 from 1 00000100:00080000:0.0:1789263899.702985:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 10000000:01000000:2.0:1789263899.702988:0:23637:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00000100:00080000:0.0:1789263899.702996:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1789263899.703009:0:23637:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23200/0xce1582440fb1f78f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263899.703015:0:23637:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23200/0xce1582440fb1f78f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263899.703032:0:23637:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23200/0xce1582440fb1f78f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263899.703044:0:23637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:23637:1876178898162176:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789263899.703118:0:23637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263899.703142:0:22899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898162176 00000100:00100000:2.0:1789263899.703146:0:23637:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9c0b533c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789263899.703148:0:22899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898162176 00000100:00100000:3.0:1789263899.703183:0:22899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789263899.703189:0:22899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+15:23637:x1876178898162176:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789263899.703200:0:22899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263899.703209:0:22899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd981531000/0xce1582440fb1f796 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1f78f expref: -99 pid: 22899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263899.703226:0:22899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd981531000/0xce1582440fb1f796 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1f78f expref: 16 pid: 22899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263899.703233:0:22899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd981531000/0xce1582440fb1f796 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1f78f expref: 16 pid: 22899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263899.703247:0:22899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981531000, rc 0) 00000100:00100000:3.0:1789263899.703301:0:22899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+16:23637:x1876178898162176:12345-0@lo:101:mount.lustre.0 Request processed in 112us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263899.703307:0:22899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789263899.703432:0:23637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:23637:1876178898162176:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789263899.703444:0:23637:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23200/0xce1582440fb1f78f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f796 expref: -99 pid: 23637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263899.703453:0:23637:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23200/0xce1582440fb1f78f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1f796 expref: -99 pid: 23637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263899.704326:0:23637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:23637:1876178898162304:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1789263899.704357:0:23637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263899.704381:0:23637:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9c0b533c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789263899.704415:0:22896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898162304 00000100:00100000:0.0:1789263899.704420:0:22896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898162304 00000100:00100000:0.0:1789263899.704454:0:22896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789263899.704463:0:22896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+16:23637:x1876178898162304:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1789263899.704489:0:22896:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1789263899.704504:0:22896:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789263899.704507:0:22896:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:0.0:1789263899.704590:0:22896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+16:23637:x1876178898162304:12345-0@lo:256:mount.lustre.0 Request processed in 129us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263899.704598:0:22896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789263899.704636:0:23637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:23637:1876178898162304:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1789263899.705192:0:23637:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789263899.705207:0:23637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23200/0xce1582440fb1f78f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f796 expref: -99 pid: 23637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263899.705217:0:23637:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23200/0xce1582440fb1f78f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f796 expref: -99 pid: 23637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789263899.705224:0:23637:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dd883f8c000 from 1 10000000:01000000:2.0:1789263899.705227:0:23637:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789263899.705254:0:23637:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22400/0xce1582440fb1f79d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263899.705261:0:23637:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22400/0xce1582440fb1f79d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263899.705267:0:23637:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22400/0xce1582440fb1f79d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263899.705276:0:23637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:23637:1876178898162432:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789263899.705300:0:23637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263899.705323:0:22899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898162432 00000100:00100000:2.0:1789263899.705327:0:23637:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9c0b533c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789263899.705328:0:22899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898162432 00000100:00100000:3.0:1789263899.705368:0:22899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789263899.705376:0:22899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+16:23637:x1876178898162432:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789263899.705384:0:22899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263899.705399:0:22899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd981530800/0xce1582440fb1f7a4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1f79d expref: -99 pid: 22899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263899.705415:0:22899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd981530800/0xce1582440fb1f7a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1f79d expref: 17 pid: 22899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263899.705424:0:22899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd981530800/0xce1582440fb1f7a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1f79d expref: 17 pid: 22899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263899.705431:0:22899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981530800, rc 0) 00000100:00100000:3.0:1789263899.705467:0:22899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+17:23637:x1876178898162432:12345-0@lo:101:mount.lustre.0 Request processed in 92us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263899.705474:0:22899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789263899.705513:0:23637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:23637:1876178898162432:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789263899.705526:0:23637:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22400/0xce1582440fb1f79d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f7a4 expref: -99 pid: 23637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263899.705536:0:23637:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22400/0xce1582440fb1f79d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1f7a4 expref: -99 pid: 23637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789263899.706232:0:23637:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:2.0:1789263899.706431:0:23637:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789263899.706564:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1789263899.706588:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:2.0:1789263899.706601:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:2.0:1789263899.706612:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:2.0:1789263899.706622:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:2.0:1789263899.706633:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:2.0:1789263899.706643:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:2.0:1789263899.706654:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:2.0:1789263899.706664:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1789263899.706675:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:2.0:1789263899.706696:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:2.0:1789263899.706708:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:2.0:1789263899.706711:0:23637:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:2.0:1789263899.706750:0:23637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:23637:1876178898162560:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789263899.706776:0:23637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263899.706797:0:23637:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9c0b53600 going to sleep for 11 seconds 00000100:00100000:0.0:1789263899.706819:0:22896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898162560 00000100:00100000:0.0:1789263899.706824:0:22896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898162560 00000100:00100000:0.0:1789263899.706855:0:22896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789263899.706860:0:22896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+17:23637:x1876178898162560:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789263899.706943:0:22896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+17:23637:x1876178898162560:12345-0@lo:501:mount.lustre.0 Request processed in 82us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263899.706950:0:22896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789263899.706978:0:23637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:23637:1876178898162560:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789263899.707004:0:23637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:23637:1876178898162688:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789263899.707040:0:23637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263899.707059:0:23637:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9c0b53600 going to sleep for 11 seconds 00000100:00100000:3.0:1789263899.707143:0:22899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898162688 00000100:00100000:3.0:1789263899.707148:0:22899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898162688 00000100:00100000:3.0:1789263899.707181:0:22899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789263899.707188:0:22899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+17:23637:x1876178898162688:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789263899.707250:0:22899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+17:23637:x1876178898162688:12345-0@lo:503:mount.lustre.0 Request processed in 62us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263899.707255:0:22899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789263899.707279:0:23637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:23637:1876178898162688:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789263899.707529:0:23637:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789263899.707558:0:23637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:23637:1876178898162816:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789263899.707583:0:23637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263899.707600:0:23637:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9c0b533c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789263899.707617:0:22896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898162816 00000100:00100000:0.0:1789263899.707622:0:22896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898162816 00000100:00100000:0.0:1789263899.707649:0:22896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789263899.707656:0:22896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98738ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+17:23637:x1876178898162816:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789263899.707744:0:22896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98738ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+17:23637:x1876178898162816:12345-0@lo:502:mount.lustre.0 Request processed in 87us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263899.707752:0:22896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789263899.707758:0:23637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:23637:1876178898162816:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789263899.707897:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1789263899.707920:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:2.0:1789263899.707945:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:2.0:1789263899.707958:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:2.0:1789263899.707971:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:2.0:1789263899.707984:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:2.0:1789263899.707998:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:2.0:1789263899.708011:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:2.0:1789263899.708022:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1789263899.708032:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:2.0:1789263899.708045:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:2.0:1789263899.708064:0:23637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:23637:1876178898162944:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789263899.708116:0:23637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263899.708136:0:23637:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9c0b533c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789263899.708204:0:22899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898162944 00000100:00100000:3.0:1789263899.708208:0:22899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898162944 00000100:00100000:3.0:1789263899.708229:0:22899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789263899.708233:0:22899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98738e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+17:23637:x1876178898162944:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789263899.708302:0:22899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98738e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+17:23637:x1876178898162944:12345-0@lo:502:mount.lustre.0 Request processed in 65us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263899.708310:0:23637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:23637:1876178898162944:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789263899.708311:0:22899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000040:00080000:2.0:1789263899.708346:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:2.0:1789263899.708351:0:23637:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1789263899.708665:0:23650:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789263899.708679:0:23650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789263899.708681:0:23650:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789263899.708688:0:23650:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dd883f8c000 00000020:00000080:0.0:1789263899.708691:0:23650:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789263899.708698:0:23650:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789263899.708701:0:23650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789263899.708702:0:23650:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789263899.708705:0:23650:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789263899.708707:0:23650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789263899.708708:0:23650:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789263899.708711:0:23650:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dd883f8c000 00000020:00000080:0.0:1789263899.708713:0:23650:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789263899.708753:0:23650:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789263899.708755:0:23650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789263899.708756:0:23650:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789263899.708758:0:23650:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789263899.708760:0:23650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789263899.708760:0:23650:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789263899.708764:0:23650:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9dd883f8c000 00000020:00000080:0.0:1789263899.708767:0:23650:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789263899.708783:0:23650:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789263899.708785:0:23650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789263899.708787:0:23650:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789263899.708789:0:23650:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789263899.708791:0:23650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789263899.708793:0:23650:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789263899.708796:0:23650:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9dd883f8c000 00000020:00000080:0.0:1789263899.708798:0:23650:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789263899.708832:0:23650:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789263899.708834:0:23650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789263899.708835:0:23650:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789263899.708837:0:23650:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:2.0:1789263899.708893:0:23637:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1789263899.708919:0:23637:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789263899.708936:0:23637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22400/0xce1582440fb1f79d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f7a4 expref: -99 pid: 23637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263899.708947:0:23637:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22400/0xce1582440fb1f79d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f7a4 expref: -99 pid: 23637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789263899.708987:0:23637:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789263899.708990:0:23637:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9dd883f8c000 10000000:01000000:2.0:1789263899.708992:0:23637:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9dd883f8c000 10000000:01000000:2.0:1789263899.708996:0:23637:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789263899.709000:0:23637:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9dd883f8c000 from 1 10000000:01000000:2.0:1789263899.709003:0:23637:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789263899.709022:0:23637:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23000/0xce1582440fb1f7ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263899.709029:0:23637:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23000/0xce1582440fb1f7ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263899.709038:0:23637:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23000/0xce1582440fb1f7ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263899.709049:0:23637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:23637:1876178898163072:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789263899.709108:0:23637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263899.709130:0:23637:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9c0b53600 going to sleep for 11 seconds 00000100:00100000:0.0:1789263899.710858:0:22896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898163072 00000100:00100000:0.0:1789263899.710867:0:22896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898163072 00000100:00100000:0.0:1789263899.710933:0:22896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789263899.710944:0:22896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98738cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+17:23637:x1876178898163072:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789263899.710959:0:22896:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263899.710975:0:22896:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd987f51200/0xce1582440fb1f7b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1f7ab expref: -99 pid: 22896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263899.711000:0:22896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd987f51200/0xce1582440fb1f7b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1f7ab expref: 18 pid: 22896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263899.711011:0:22896:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd987f51200/0xce1582440fb1f7b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1f7ab expref: 18 pid: 22896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263899.711020:0:22896:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd987f51200, rc 0) 00000100:00100000:0.0:1789263899.711299:0:22896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98738cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+18:23637:x1876178898163072:12345-0@lo:101:mount.lustre.0 Request processed in 357us (2189us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263899.711307:0:22896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789263899.711361:0:23637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:23637:1876178898163072:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789263899.711378:0:23637:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23000/0xce1582440fb1f7ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f7b2 expref: -99 pid: 23637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263899.711401:0:23637:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23000/0xce1582440fb1f7ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1f7b2 expref: -99 pid: 23637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789263899.713750:0:23637:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:1.0:1789263899.714047:0:23637:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789263899.714262:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:1.0:1789263899.714298:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:1.0:1789263899.714333:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:1.0:1789263899.714355:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:1.0:1789263899.714369:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:1.0:1789263899.714381:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:1.0:1789263899.714395:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:1.0:1789263899.714410:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:1.0:1789263899.714434:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:1.0:1789263899.714458:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:1.0:1789263899.714483:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:1.0:1789263899.714508:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:1.0:1789263899.714537:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:1.0:1789263899.714564:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:1.0:1789263899.714598:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:1.0:1789263899.714614:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:1.0:1789263899.714627:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:1.0:1789263899.714644:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:1.0:1789263899.714664:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:1.0:1789263899.714681:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:1.0:1789263899.714696:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:1.0:1789263899.714712:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:1.0:1789263899.714730:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:1.0:1789263899.714752:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:1.0:1789263899.714772:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:1.0:1789263899.714790:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:1.0:1789263899.714819:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:1.0:1789263899.714837:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:1.0:1789263899.714852:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:1.0:1789263899.714865:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:1.0:1789263899.714895:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:1.0:1789263899.714912:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:1.0:1789263899.714930:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:1.0:1789263899.714945:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:1.0:1789263899.714961:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:1.0:1789263899.714992:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:1.0:1789263899.715012:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:1.0:1789263899.715029:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:1.0:1789263899.715045:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:1.0:1789263899.715060:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:1.0:1789263899.715100:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:1.0:1789263899.715122:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:1.0:1789263899.715139:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:1.0:1789263899.715156:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:1.0:1789263899.715175:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:1.0:1789263899.715193:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:1.0:1789263899.715222:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:1.0:1789263899.715242:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:1.0:1789263899.715373:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:1.0:1789263899.715389:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:1.0:1789263899.715404:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:1.0:1789263899.715408:0:23637:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:1.0:1789263899.715474:0:23637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882436680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:23637:1876178898163200:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789263899.715526:0:23637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263899.715560:0:22899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898163200 00000100:00100000:3.0:1789263899.715568:0:22899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898163200 00000100:00100000:1.0:1789263899.715571:0:23637:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9890a7780 going to sleep for 11 seconds 00000100:00100000:3.0:1789263899.715615:0:22899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789263899.715626:0:22899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98738e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+18:23637:x1876178898163200:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789263899.715749:0:22899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98738e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+18:23637:x1876178898163200:12345-0@lo:501:mount.lustre.0 Request processed in 125us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263899.715757:0:22899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789263899.715781:0:23637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882436680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:23637:1876178898163200:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789263899.715826:0:23637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882436680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:23637:1876178898163328:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789263899.715865:0:23637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263899.715883:0:23637:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9890a7780 going to sleep for 11 seconds 00000100:00100000:0.0:1789263899.715902:0:22896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898163328 00000100:00100000:0.0:1789263899.715908:0:22896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898163328 00000100:00100000:0.0:1789263899.715949:0:22896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789263899.715959:0:22896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98738fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+18:23637:x1876178898163328:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789263899.716037:0:22896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98738fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+18:23637:x1876178898163328:12345-0@lo:503:mount.lustre.0 Request processed in 79us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263899.716049:0:23637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882436680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:23637:1876178898163328:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789263899.716058:0:22896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000040:00080000:1.0:1789263899.716526:0:23637:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789263899.716570:0:23637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882436680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:23637:1876178898163456:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789263899.716599:0:23637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263899.716625:0:22899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898163456 00000100:00100000:3.0:1789263899.716631:0:22899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898163456 00000100:00100000:1.0:1789263899.716631:0:23637:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9890a7a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789263899.716667:0:22899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789263899.716676:0:22899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98738c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+18:23637:x1876178898163456:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789263899.716768:0:22899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98738c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+18:23637:x1876178898163456:12345-0@lo:502:mount.lustre.0 Request processed in 92us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263899.716775:0:22899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789263899.716779:0:23637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882436680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:23637:1876178898163456:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789263899.716943:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:1.0:1789263899.716969:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:1.0:1789263899.716987:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:1.0:1789263899.717065:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:1.0:1789263899.717119:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:1.0:1789263899.717140:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:1.0:1789263899.717156:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:1.0:1789263899.717173:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:1.0:1789263899.717202:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:1.0:1789263899.717221:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:1.0:1789263899.717245:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:1.0:1789263899.717263:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:1.0:1789263899.717279:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:1.0:1789263899.717296:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:1.0:1789263899.717311:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:1.0:1789263899.717325:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:1.0:1789263899.717341:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:1.0:1789263899.717359:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:1.0:1789263899.717378:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:1.0:1789263899.717394:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:1.0:1789263899.717408:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:1.0:1789263899.717421:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:1.0:1789263899.717433:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:1.0:1789263899.717450:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:1.0:1789263899.717485:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:1.0:1789263899.717502:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:1.0:1789263899.717517:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:1.0:1789263899.717530:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:1.0:1789263899.717539:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:1.0:1789263899.717546:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:1.0:1789263899.717561:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:1.0:1789263899.717573:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:1.0:1789263899.717582:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:1.0:1789263899.717591:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:1.0:1789263899.717601:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:1.0:1789263899.717618:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:1.0:1789263899.717632:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:1.0:1789263899.717648:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:1.0:1789263899.717669:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:1.0:1789263899.717743:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:1.0:1789263899.717778:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:1.0:1789263899.717800:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:1.0:1789263899.717832:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:1.0:1789263899.717849:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:1.0:1789263899.717864:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:1.0:1789263899.717874:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:1.0:1789263899.717883:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:1.0:1789263899.717898:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:1.0:1789263899.717945:0:23637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882436680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:23637:1876178898163584:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789263899.717988:0:23637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263899.718031:0:23637:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9890a7a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789263899.718039:0:22896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898163584 00000100:00100000:0.0:1789263899.718047:0:22896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898163584 00000100:00100000:0.0:1789263899.718105:0:22896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789263899.718114:0:22896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98738e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+18:23637:x1876178898163584:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789263899.718210:0:22896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98738e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+18:23637:x1876178898163584:12345-0@lo:502:mount.lustre.0 Request processed in 98us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263899.718221:0:23637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882436680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:23637:1876178898163584:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789263899.718228:0:22896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000040:00080000:1.0:1789263899.718336:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:1.0:1789263899.718351:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:1.0:1789263899.718366:0:23637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882436680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:23637:1876178898163712:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789263899.718391:0:23637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263899.718414:0:22899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898163712 00000100:00100000:1.0:1789263899.718417:0:23637:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9890a7a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789263899.718420:0:22899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898163712 00000100:00100000:3.0:1789263899.718455:0:22899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789263899.718463:0:22899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98738c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+18:23637:x1876178898163712:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789263899.718543:0:22899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98738c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+18:23637:x1876178898163712:12345-0@lo:502:mount.lustre.0 Request processed in 79us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263899.718548:0:23637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882436680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:23637:1876178898163712:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789263899.718562:0:22899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000040:00080000:1.0:1789263899.718576:0:23637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:1.0:1789263899.718588:0:23637:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1789263899.719130:0:23655:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1789263899.719145:0:23655:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9dd99f9c0000) 00000020:00000080:1.0:1789263899.719167:0:23655:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1789263899.719263:0:23655:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dd883f8c000 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1789263899.719267:0:23655:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dd883f8c000 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1789263899.719270:0:23655:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dd883f8c000 3 00010000:00080000:1.0:1789263899.719305:0:23655:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dd9abd1f000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.120@tcp at head 00010000:00010000:1.0:1789263899.720937:0:23655:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:1.0:1789263899.721135:0:23655:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1789263899.721168:0:23655:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789263899.721178:0:23655:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xce1582440fb1f7c0 00000100:00080000:1.0:1789263899.721187:0:23655:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789263899.721192:0:23655:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9dd9abd1f000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:1.0:1789263899.721223:0:23655:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd882436680 x1876178898163840/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789263899.721246:0:23655:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789263899.721273:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789263899.721279:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1789263899.721282:0:38:0:(import.c:65:import_set_state_nolock()) ffff9dd990819800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789263899.721289:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9dd990819800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:0.0:1789263899.721307:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd9bfaac380 x1876178898163968/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789263899.721318:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789263899.721322:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789263899.721325:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789263899.721329:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789263899.721345:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882436680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3617:1876178898163840:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1789263899.721371:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789263899.721375:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789263899.721377:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789263899.721380:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789263899.721389:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898164224:0@lo:400:kworker.0 00000100:00100000:3.0:1789263899.721409:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263899.721419:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1876178898164096:0@lo:400:kworker.0 00000100:00100000:3.0:1789263899.721459:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1876178898163968:0@lo:38:kworker.0 00000100:00100000:1.0:1789263899.721468:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263899.721469:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263899.721501:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263899.721526:0:22909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898164224 00000100:00100000:0.0:1789263899.721532:0:22909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898164224 00000100:00100000:0.0:1789263899.721569:0:22909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898163968 00000100:00100000:0.0:1789263899.721573:0:22909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898163968 00000100:00100000:0.0:1789263899.721591:0:22909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789263899.721602:0:22909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882435f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3621:x1876178898164224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263899.721610:0:22904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898163840 00000100:00100000:3.0:1789263899.721616:0:22904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898163840 00000100:00100000:3.0:1789263899.721643:0:22904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898164096 00000100:00100000:3.0:1789263899.721647:0:22904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898164096 00000100:00100000:0.0:1789263899.721664:0:22909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882435f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3621:x1876178898164224:12345-0@lo:400:kworker.0 Request processed in 63us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263899.721675:0:22905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789263899.721676:0:22909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789263899.721689:0:22905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1876178898164096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263899.721699:0:22909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789263899.721705:0:22909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883b6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3617:x1876178898163968:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1789263899.721734:0:22905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1876178898164096:12345-0@lo:400:kworker.0 Request processed in 48us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263899.721742:0:22905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789263899.721760:0:22909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883b6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3617:x1876178898163968:12345-0@lo:38:kworker.0 Request processed in 52us (258us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789263899.721761:0:22905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789263899.721769:0:22905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883b6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3617:x1876178898163840:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789263899.721775:0:22909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1789263899.721789:0:22905:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 342 last 0 00010000:00080000:0.0:1789263899.721831:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9dd9bfaae300 x1876178898164096/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263915 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263899.721843:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1876178898164096:0@lo:400:kworker.0 00000020:00000080:1.0:1789263899.721850:0:22905:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xce1582440fb1f7c7 00000004:00100000:1.0:1789263899.721867:0:22905:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:0.0:1789263899.721877:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898164224:0@lo:400:kworker.0 00000100:00080000:1.0:1789263899.721895:0:22905:0:(import.c:65:import_set_state_nolock()) ffff9dd985545800 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1789263899.721897:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd990819800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789263899.721902:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789263899.721905:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1876178898163968:0@lo:38:kworker.0 00000100:00100000:1.0:1789263899.721945:0:22905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883b6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1876178898163840:12345-0@lo:38:llog_process_th.0 Request processed in 175us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263899.721952:0:22905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789263899.721963:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9dd882436680 x1876178898163840/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789263909 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263899.721972:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789263899.721977:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1789263899.721983:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1789263899.721988:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789263899.721990:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd9abd1f000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789263899.721995:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882436680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3617:1876178898163840:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1789263899.722185:0:23655:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:1.0:1789263899.722221:0:23637:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1789263899.722248:0:23637:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789263899.722267:0:23637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23000/0xce1582440fb1f7ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f7b2 expref: -99 pid: 23637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263899.722282:0:23637:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23000/0xce1582440fb1f7ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f7b2 expref: -99 pid: 23637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789263899.722330:0:23637:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789263899.722332:0:23637:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789263899.722333:0:23637:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789263899.722334:0:23637:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789263899.722335:0:23637:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789263899.722336:0:23637:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789263899.722338:0:23637:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789263899.722339:0:23637:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789263899.722341:0:23637:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789263899.722343:0:23637:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:1.0:1789263899.722345:0:23637:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789263899.722346:0:23637:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789263899.722347:0:23637:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789263899.722348:0:23637:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789263899.722349:0:23637:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789263899.722350:0:23637:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789263899.722351:0:23637:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789263899.722352:0:23637:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789263899.722353:0:23637:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789263899.722370:0:23637:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1789263899.722378:0:23637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882435880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:23637:1876178898164352:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789263899.722413:0:23637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263899.722437:0:22896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898164352 00000100:00100000:1.0:1789263899.722438:0:23637:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9890a7000 going to sleep for 11 seconds 00000100:00100000:0.0:1789263899.722447:0:22896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898164352 00000100:00100000:0.0:1789263899.722473:0:22896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789263899.722480:0:22896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98738c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+18:23637:x1876178898164352:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789263899.722497:0:22896:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1789263899.722511:0:22896:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:3.0:1789263899.723929:0:22884:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1789263899.723999:0:22896:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789263899.724012:0:22896:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1789263899.724036:0:22919:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789263899.724041:0:22919:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789263899.724061:0:22919:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dd8841a3800/0xce1582440fb1f7ce lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263899.724099:0:22919:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd9bfa22600/0xce1582440fb1f6d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1f6cb expref: 18 pid: 22896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263899.724109:0:22919:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd981531000/0xce1582440fb1f796 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1f78f expref: 18 pid: 22899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263899.724116:0:22919:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dd8841a3800/0xce1582440fb1f7ce lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263899.724146:0:22919:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd981531000/0xce1582440fb1f796 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce1582440fb1f78f expref: 18 pid: 22899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263899.724161:0:22919:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dd981531000/0xce1582440fb1f796 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce1582440fb1f78f expref: 18 pid: 22899 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263899.724174:0:22919:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882434000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22919:1876178898164480:0@lo:104: 00000100:00100000:1.0:1789263899.724211:0:22919:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263899.724256:0:22887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898164480 00000100:00100000:3.0:1789263899.724262:0:22887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898164480 00010000:00010000:1.0:1789263899.724265:0:22919:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd9bfa22600/0xce1582440fb1f6d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce1582440fb1f6cb expref: 18 pid: 22896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263899.724275:0:22919:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dd9bfa22600/0xce1582440fb1f6d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce1582440fb1f6cb expref: 18 pid: 22896 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263899.724287:0:22896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98738c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+18:23637:x1876178898164352:12345-0@lo:253:mount.lustre.0 Request processed in 1806us (1871us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263899.724303:0:22887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789263899.724307:0:22919:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882436a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22919:1876178898164608:0@lo:104: 00000100:00100000:0.0:1789263899.724307:0:22896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789263899.724317:0:22887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882437b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+3:22919:x1876178898164480:12345-0@lo:104: 00010000:00010000:3.0:1789263899.724331:0:22887:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23200/0xce1582440fb1f78f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1f796 expref: -99 pid: 23637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263899.724339:0:22919:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263899.724353:0:22919:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9890a7300 going to sleep for 11 seconds 00000100:00100000:0.0:1789263899.724374:0:23637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882435880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:23637:1876178898164352:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789263899.724388:0:23637:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1789263899.724391:0:23637:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789263899.724393:0:23637:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789263899.724394:0:23637:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00010000:00010000:3.0:1789263899.724395:0:22887:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000020:01000004:0.0:1789263899.724396:0:23637:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789263899.724398:0:23637:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789263899.724400:0:23637:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789263899.724402:0:23637:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00010000:00010000:1.0:1789263899.724403:0:22892:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000020:01000004:0.0:1789263899.724405:0:23637:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789263899.724409:0:23637:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00010000:1.0:1789263899.724414:0:22892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23200/0xce1582440fb1f78f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1f796 expref: -99 pid: 23637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263899.724415:0:22887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882437b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+3:22919:x1876178898164480:12345-0@lo:104: Request processed in 99us (200us total) trans 0 rc 0/0 00000020:02000000:0.0:1789263899.724427:0:23637:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1789263899.724430:0:22892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bfa23200 already unused, calling callback (ffffffffc12b1c20) 00000100:00100000:3.0:1789263899.724431:0:22887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789263899.724451:0:22887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898164608 10000000:00010000:1.0:1789263899.724456:0:22892:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23200/0xce1582440fb1f78f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xce1582440fb1f796 expref: -99 pid: 23637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263899.724457:0:22887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898164608 00010000:00010000:1.0:1789263899.724468:0:22892:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23200/0xce1582440fb1f78f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xce1582440fb1f796 expref: -99 pid: 23637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789263899.724476:0:22892:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23200/0xce1582440fb1f78f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xce1582440fb1f796 expref: -99 pid: 23637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263899.724479:0:22887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 10000000:01000000:1.0:1789263899.724486:0:22892:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:3.0:1789263899.724492:0:22887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882434a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+3:22919:x1876178898164608:12345-0@lo:104: 00010000:00010000:3.0:1789263899.724502:0:22887:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff9dd981531a00/0xce1582440fb1f6cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1f6d2 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263899.724516:0:22892:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23200/0xce1582440fb1f78f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1f796 expref: -99 pid: 23637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263899.724525:0:22892:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789263899.724544:0:22892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23200/0xce1582440fb1f78f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1f796 expref: -99 pid: 23637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263899.724551:0:22892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23200/0xce1582440fb1f78f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1f796 expref: -99 pid: 23637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263899.724562:0:22887:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1789263899.724564:0:22892:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1789263899.724570:0:22887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882434a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+3:22919:x1876178898164608:12345-0@lo:104: Request processed in 81us (232us total) trans 0 rc 0/0 00010000:00010000:1.0:1789263899.724575:0:22892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd981531a00/0xce1582440fb1f6cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1f6d2 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263899.724582:0:22887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1789263899.724589:0:22892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981531a00 already unused, calling callback (ffffffffc12b1c20) 10000000:00010000:1.0:1789263899.724592:0:22892:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd981531a00/0xce1582440fb1f6cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xce1582440fb1f6d2 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263899.724598:0:22892:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd981531a00/0xce1582440fb1f6cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xce1582440fb1f6d2 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789263899.724604:0:22892:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd981531a00/0xce1582440fb1f6cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xce1582440fb1f6d2 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263899.724605:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882435880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec0ec848-5fac-4f6a-ba8a-daed864d309d:3618:1876178898164736:0@lo:103:ldlm_bl.0 10000000:01000000:1.0:1789263899.724616:0:22892:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789263899.724635:0:22892:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff9dd981531a00/0xce1582440fb1f6cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1f6d2 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263899.724641:0:22892:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789263899.724645:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789263899.724653:0:22892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd981531a00/0xce1582440fb1f6cb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1f6d2 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263899.724660:0:22892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd981531a00/0xce1582440fb1f6cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1f6d2 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263899.724675:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263899.724678:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263899.724682:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789263899.724692:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789263899.724699:0:22891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898164736 00000100:00100000:3.0:1789263899.724700:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882436680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec0ec848-5fac-4f6a-ba8a-daed864d309d:3618:1876178898164864:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789263899.724707:0:22891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898164736 00010000:00010000:2.0:1789263899.724732:0:22891:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd981531000/0xce1582440fb1f796 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1f78f expref: 18 pid: 22899 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263899.724754:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263899.724766:0:22891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898164864 00000100:00100000:2.0:1789263899.724771:0:22891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898164864 00010000:00010000:2.0:1789263899.724787:0:22891:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd9bfa22600/0xce1582440fb1f6d2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1f6cb expref: 19 pid: 22896 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263899.724789:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789263899.724797:0:22890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789263899.724817:0:22889:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1789263899.724821:0:22890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883b6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec0ec848-5fac-4f6a-ba8a-daed864d309d+19:3618:x1876178898164736:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789263899.724822:0:22891:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789263899.724828:0:22889:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1789263899.724837:0:22890:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789263899.724838:0:22891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789263899.724848:0:22891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883b6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+19:3618:x1876178898164864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789263899.724851:0:22890:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd981531000/0xce1582440fb1f796 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1f78f expref: 19 pid: 22899 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263899.724861:0:22891:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789263899.724868:0:22891:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd9bfa22600/0xce1582440fb1f6d2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1f6cb expref: 19 pid: 22896 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263899.724880:0:22890:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd981531000/0xce1582440fb1f796 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce1582440fb1f78f expref: 19 pid: 22899 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263899.724894:0:22891:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd9bfa22600/0xce1582440fb1f6d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce1582440fb1f6cb expref: 19 pid: 22896 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263899.724916:0:22890:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dd8841a3800/0xce1582440fb1f7ce lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263899.724925:0:22890:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd8841a3800/0xce1582440fb1f7ce lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263899.724934:0:22891:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789263899.724938:0:22919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd981531000/0xce1582440fb1f796 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce1582440fb1f78f expref: 19 pid: 22899 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263899.724951:0:22919:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882434000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22919:1876178898164480:0@lo:104: 20000000:01000000:1.0:1789263899.724960:0:22890:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004489663s 00010000:00010000:1.0:1789263899.724967:0:22890:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd8841a3800/0xce1582440fb1f7ce lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263899.724968:0:22919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd9bfa22600/0xce1582440fb1f6d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce1582440fb1f6cb expref: 18 pid: 22896 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263899.724977:0:22891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883b6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+18:3618:x1876178898164864:12345-0@lo:103:ldlm_bl.0 Request processed in 129us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263899.724992:0:22919:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882436a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22919:1876178898164608:0@lo:104: 00000100:00100000:2.0:1789263899.724993:0:22891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1789263899.725004:0:22890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd8841a3800/0xce1582440fb1f7ce lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263899.725010:0:22890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dd8841a3800/0xce1582440fb1f7ce lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263899.725015:0:22890:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dd8841a3800/0xce1582440fb1f7ce lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263899.725018:0:22919:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dd8841a3800/0xce1582440fb1f7ce lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263899.725019:0:22890:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd8841a3800 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263899.725024:0:22890:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dd8841a3800/0xce1582440fb1f7ce lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263899.725034:0:22890:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dd8841a3800/0xce1582440fb1f7ce lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263899.725035:0:22919:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGS lock: ffff9dd8841a3800/0xce1582440fb1f7ce lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263899.725044:0:22919:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dd8841a3800/0xce1582440fb1f7ce lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263899.725046:0:22890:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dd8841a3800/0xce1582440fb1f7ce lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263899.725063:0:22890:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789263899.725064:0:22919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd8841a3800/0xce1582440fb1f7ce lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263899.725115:0:22890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883b6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec0ec848-5fac-4f6a-ba8a-daed864d309d+16:3618:x1876178898164736:12345-0@lo:103:ldlm_bl.0 Request processed in 298us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263899.725122:0:22890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789263899.725147:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882436680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec0ec848-5fac-4f6a-ba8a-daed864d309d:3618:1876178898164864:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789263899.725161:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882435880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec0ec848-5fac-4f6a-ba8a-daed864d309d:3618:1876178898164736:0@lo:103:ldlm_bl.0 00000040:01000000:0.0:1789263899.726772:0:23637:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:1.0:1789263899.726857:0:23661:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1789263899.726861:0:23661:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:1.0:1789263899.726986:0:23662:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789263899.727007:0:23637:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:1.0:1789263899.727350:0:23662:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789263899.727387:0:23663:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883b6d880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23663:1876178898164992:0@lo:1000:lod0001_rec0000.0 00000040:01000000:0.0:1789263899.727417:0:23637:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000100:00100000:3.0:1789263899.727444:0:23663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1789263899.727453:0:23637:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789263899.727469:0:23663:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9c09e79c0 going to sleep for 11 seconds 00000004:00000080:0.0:1789263899.729970:0:23637:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000100:00100000:3.0:1789263899.730167:0:22909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898164992 00000100:00100000:3.0:1789263899.730176:0:22909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898164992 00000100:00100000:3.0:1789263899.730223:0:22909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789263899.730233:0:22909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883b6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23663:x1876178898164992:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1789263899.730348:0:22909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883b6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23663:x1876178898164992:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 116us (2903us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263899.730357:0:22909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000040:01000000:3.0:1789263899.730393:0:23637:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1789263899.730474:0:23637:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789263899.730602:0:23663:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883b6d880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23663:1876178898164992:0@lo:1000:lod0001_rec0000.0 00000040:01000000:2.0:1789263899.730638:0:23663:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1789263899.730674:0:23663:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a7b80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23663:1876178898165120:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1789263899.730716:0:23663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263899.730740:0:22927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898165120 00000100:00100000:2.0:1789263899.730743:0:22927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898165120 00000100:00100000:2.0:1789263899.730764:0:22927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789263899.730769:0:22927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23663:x1876178898165120:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1789263899.730860:0:22927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23663:x1876178898165120:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 90us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263899.730866:0:22927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789263899.730888:0:23663:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9bb50c480 going to sleep for 11 seconds 00000100:00100000:2.0:1789263899.730899:0:23663:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a7b80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23663:1876178898165120:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1789263899.730955:0:23663:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a7b80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23663:1876178898165248:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1789263899.730981:0:23663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263899.731012:0:22914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898165248 00000100:00100000:2.0:1789263899.731016:0:22914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898165248 00000100:00100000:2.0:1789263899.731037:0:22914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789263899.731043:0:22914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23663:x1876178898165248:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1789263899.731072:0:22914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23663:x1876178898165248:12345-0@lo:900:lod0001_rec0000.0 Request processed in 29us (90us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263899.731098:0:22914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789263899.731304:0:23663:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9bb50cf00 going to sleep for 11 seconds 00010000:00080000:2.0:1789263899.731316:0:23663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9dd99f9a7b80 x1876178898165248/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789263915 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789263899.731323:0:23663:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a7b80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23663:1876178898165248:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1789263899.731348:0:23663:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a7b80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23663:1876178898165376:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1789263899.731371:0:23663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263899.731389:0:23663:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9bb50c480 going to sleep for 11 seconds 00000100:00100000:0.0:1789263899.731405:0:22927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898165376 00000100:00100000:0.0:1789263899.731409:0:22927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898165376 00000100:00100000:0.0:1789263899.731434:0:22927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789263899.731441:0:22927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23663:x1876178898165376:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789263899.731492:0:22927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23663:x1876178898165376:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 51us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263899.731504:0:22927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789263899.731512:0:23663:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a7b80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23663:1876178898165376:0@lo:1000:lod0001_rec0000.0 00000040:00080000:2.0:1789263899.731543:0:23663:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789263899.745114:0:23662:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789263899.745193:0:23662:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:00080000:3.0:1789263899.745923:0:23637:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1789263899.749203:0:23637:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1789263899.749290:0:23637:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1789263899.749459:0:23637:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789263899.749899:0:23663:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789263899.749944:0:23663:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1789263899.749948:0:23663:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00080000:10000000:3.0:1789263899.749959:0:23637:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000001:00000004:3.0:1789263899.751364:0:23637:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:3.0:1789263899.755496:0:23637:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1789263899.755525:0:23637:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb38e4187f988 00100000:10000000:3.0:1789263899.755531:0:23637:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1789263899.756030:0:23637:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789263899.756057:0:23637:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.120@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789263899.756072:0:23637:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1789263899.756122:0:23637:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1789263899.756968:0:23637:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789263899.757225:0:23637:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789263900.013219:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789263900.141151:0:22947:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9b7a9e600 going to sleep for 0 seconds 00000040:00080000:2.0:1789263900.781604:0:23664:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789263901.037202:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789263901.166527:0:22947:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9b7a9e600 going to sleep for 0 seconds 00000001:02000400:2.0:1789263901.233899:0:23906:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg320-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:0.0:1789263901.485178:0:22901:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789263901.485185:0:22901:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9dd883f8c000 from 12 10000000:01000000:0.0:1789263901.485189:0:22901:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789263901.485232:0:22901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd987f50600/0xce1582440fb1f7d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263901.485242:0:22901:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd987f50600/0xce1582440fb1f7d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263901.485255:0:22901:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd987f50600/0xce1582440fb1f7d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263901.485280:0:22901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22901:1876178898165504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789263901.485345:0:22901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263901.485392:0:22901:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd986221cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789263901.485625:0:22899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898165504 00000100:00100000:1.0:1789263901.485634:0:22899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898165504 00000100:00100000:1.0:1789263901.485687:0:22899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789263901.485695:0:22899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98738f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+16:22901:x1876178898165504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789263901.485706:0:22899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263901.485718:0:22899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd8841a2400/0xce1582440fb1f7dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1f7d5 expref: -99 pid: 22899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263901.485736:0:22899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd8841a2400/0xce1582440fb1f7dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1f7d5 expref: 17 pid: 22899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263901.485760:0:22899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd8841a2400/0xce1582440fb1f7dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1f7d5 expref: 17 pid: 22899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263901.485770:0:22899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd8841a2400, rc 0) 00000100:00100000:1.0:1789263901.485862:0:22899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98738f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+17:22901:x1876178898165504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 168us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263901.485868:0:22899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789263901.486577:0:22901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22901:1876178898165504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789263901.486594:0:22901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd987f50600/0xce1582440fb1f7d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f7dc expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263901.486604:0:22901:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd987f50600/0xce1582440fb1f7d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1f7dc expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263901.486659:0:22901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22901:1876178898165632:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789263901.486708:0:22901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263901.486744:0:22901:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd986221cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789263901.486990:0:22896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898165632 00000100:00100000:1.0:1789263901.486996:0:22896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898165632 00000100:00100000:1.0:1789263901.487046:0:22896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789263901.487056:0:22896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98738d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+17:22901:x1876178898165632:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789263901.487073:0:22896:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789263901.487118:0:22896:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789263901.487122:0:22896:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:1.0:1789263901.487217:0:22896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98738d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+17:22901:x1876178898165632:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 163us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263901.487224:0:22896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789263901.487235:0:22901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22901:1876178898165632:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789263901.487288:0:22901:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789263901.487295:0:22901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd987f50600/0xce1582440fb1f7d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f7dc expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263901.487304:0:22901:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd987f50600/0xce1582440fb1f7d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f7dc expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789263901.487313:0:22901:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789263901.487315:0:22901:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9dd9ac8fd000 from 12 10000000:01000000:0.0:1789263901.487318:0:22901:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789263901.487337:0:22901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd987f50400/0xce1582440fb1f7e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263901.487344:0:22901:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd987f50400/0xce1582440fb1f7e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263901.487352:0:22901:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd987f50400/0xce1582440fb1f7e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263901.487365:0:22901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22901:1876178898165760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789263901.487393:0:22901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263901.487420:0:22901:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd986221cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789263901.487447:0:22898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898165760 00000100:00100000:1.0:1789263901.487644:0:22898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898165760 00000100:00100000:1.0:1789263901.487681:0:22898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789263901.487689:0:22898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98738f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec0ec848-5fac-4f6a-ba8a-daed864d309d+17:22901:x1876178898165760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789263901.487698:0:22898:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263901.487709:0:22898:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd8841a2200/0xce1582440fb1f7ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1f7e3 expref: -99 pid: 22898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263901.487727:0:22898:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd8841a2200/0xce1582440fb1f7ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1f7e3 expref: 18 pid: 22898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263901.487749:0:22898:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd8841a2200/0xce1582440fb1f7ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1f7e3 expref: 18 pid: 22898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263901.487757:0:22898:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd8841a2200, rc 0) 00000100:00100000:2.0:1789263901.488131:0:22901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22901:1876178898165760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789263901.488140:0:22898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98738f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec0ec848-5fac-4f6a-ba8a-daed864d309d+18:22901:x1876178898165760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 448us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263901.488148:0:22898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00010000:2.0:1789263901.488149:0:22901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd987f50400/0xce1582440fb1f7e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f7ea expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263901.488165:0:22901:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd987f50400/0xce1582440fb1f7e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1f7ea expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263901.488209:0:22901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22901:1876178898165888:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789263901.488238:0:22901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263901.488263:0:22901:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9bf9823c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789263901.488275:0:22896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898165888 00000100:00100000:1.0:1789263901.488279:0:22896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898165888 00000100:00100000:1.0:1789263901.488310:0:22896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789263901.488318:0:22896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98738f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+18:22901:x1876178898165888:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789263901.488331:0:22896:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789263901.488344:0:22896:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789263901.488347:0:22896:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:1.0:1789263901.488425:0:22896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98738f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+18:22901:x1876178898165888:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 107us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263901.488433:0:22896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789263901.488436:0:22901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22901:1876178898165888:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789263901.488478:0:22901:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789263901.488485:0:22901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd987f50400/0xce1582440fb1f7e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f7ea expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263901.488493:0:22901:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd987f50400/0xce1582440fb1f7e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f7ea expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000004:1.0:1789263901.601699:0:23958:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789263901.601910:0:23958:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:2.0:1789263901.805879:0:23664:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:3.0:1789263901.940960:0:24008:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789263901.941153:0:24008:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789263902.062184:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789263902.189132:0:22947:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9b7a9e600 going to sleep for 0 seconds 00000020:00000080:1.0:1789263902.308228:0:24056:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe95a0c5f0 20000000:00000080:1.0:1789263902.308243:0:24056:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9dd9c10d6800 uarg=0000000000000000 20000000:01000000:1.0:1789263902.308275:0:24056:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1789263902.308281:0:24056:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1789263902.308285:0:24056:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1789263902.308611:0:24057:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:1.0:1789263902.308698:0:24056:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789263902.313290:0:24056:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789263902.313324:0:24056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dd8841a3c00/0xce1582440fb1f7f1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263902.313342:0:24056:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd981531600/0xce1582440fb1f6a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1f69a expref: 17 pid: 22896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263902.313350:0:24056:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd981530800/0xce1582440fb1f7a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1f79d expref: 17 pid: 22899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263902.313357:0:24056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dd8841a3c00/0xce1582440fb1f7f1 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 24056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263902.313396:0:24056:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd981530800/0xce1582440fb1f7a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce1582440fb1f79d expref: 17 pid: 22899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263902.313409:0:24056:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dd981530800/0xce1582440fb1f7a4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce1582440fb1f79d expref: 17 pid: 22899 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263902.313424:0:24056:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882436300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24056:1876178898166016:0@lo:104: 00000100:00100000:1.0:1789263902.313497:0:24056:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263902.313541:0:22887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898166016 00000100:00100000:3.0:1789263902.313548:0:22887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898166016 00010000:00010000:1.0:1789263902.313557:0:24056:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd981531600/0xce1582440fb1f6a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce1582440fb1f69a expref: 17 pid: 22896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263902.313567:0:24056:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dd981531600/0xce1582440fb1f6a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce1582440fb1f69a expref: 17 pid: 22896 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263902.313577:0:24056:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882435500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24056:1876178898166144:0@lo:104: 00000100:00100000:3.0:1789263902.313592:0:22887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789263902.313602:0:22887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882436d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+3:24056:x1876178898166016:12345-0@lo:104: 00000100:00100000:1.0:1789263902.313609:0:24056:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789263902.313615:0:22887:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22400/0xce1582440fb1f79d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1f7a4 expref: -99 pid: 23637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263902.313631:0:24056:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd987359240 going to sleep for 11 seconds 00000100:00100000:0.0:1789263902.313633:0:22888:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:0.0:1789263902.313642:0:22888:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:3.0:1789263902.313679:0:22887:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789263902.313686:0:22887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882436d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+3:24056:x1876178898166016:12345-0@lo:104: Request processed in 86us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263902.313694:0:22887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1789263902.313705:0:22893:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789263902.313713:0:22893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22400/0xce1582440fb1f79d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1f7a4 expref: -99 pid: 23637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263902.313714:0:22887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898166144 00000100:00100000:3.0:1789263902.313720:0:22887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898166144 00010000:00010000:0.0:1789263902.313722:0:22893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bfa22400 already unused, calling callback (ffffffffc12b1c20) 10000000:00010000:0.0:1789263902.313727:0:22893:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22400/0xce1582440fb1f79d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xce1582440fb1f7a4 expref: -99 pid: 23637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263902.313739:0:22893:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22400/0xce1582440fb1f79d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xce1582440fb1f7a4 expref: -99 pid: 23637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263902.313743:0:22887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789263902.313743:0:24056:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882436300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24056:1876178898166016:0@lo:104: 10000000:00010000:0.0:1789263902.313751:0:22893:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22400/0xce1582440fb1f79d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xce1582440fb1f7a4 expref: -99 pid: 23637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263902.313755:0:22887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882437480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+3:24056:x1876178898166144:12345-0@lo:104: 10000000:01000000:0.0:1789263902.313761:0:22893:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789263902.313765:0:22887:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22200/0xce1582440fb1f69a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1f6a1 expref: -99 pid: 22883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263902.313801:0:22893:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22400/0xce1582440fb1f79d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1f7a4 expref: -99 pid: 23637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263902.313806:0:22893:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789263902.313821:0:22887:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789263902.313828:0:22887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882437480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+3:24056:x1876178898166144:12345-0@lo:104: Request processed in 75us (222us total) trans 0 rc 0/0 00010000:00010000:0.0:1789263902.313828:0:22893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22400/0xce1582440fb1f79d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1f7a4 expref: -99 pid: 23637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263902.313839:0:22893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22400/0xce1582440fb1f79d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1f7a4 expref: -99 pid: 23637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263902.313845:0:24056:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882435500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24056:1876178898166144:0@lo:104: 00000100:00100000:3.0:1789263902.313847:0:22887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1789263902.313854:0:22893:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789263902.313858:0:22893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22200/0xce1582440fb1f69a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1f6a1 expref: -99 pid: 22883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263902.313862:0:22893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bfa22200 already unused, calling callback (ffffffffc12b1c20) 10000000:00010000:0.0:1789263902.313865:0:22893:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22200/0xce1582440fb1f69a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xce1582440fb1f6a1 expref: -99 pid: 22883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263902.313873:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263902.313873:0:22893:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22200/0xce1582440fb1f69a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xce1582440fb1f6a1 expref: -99 pid: 22883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263902.313877:0:24056:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dd8841a3c00/0xce1582440fb1f7f1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 24056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789263902.313886:0:22893:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22200/0xce1582440fb1f69a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xce1582440fb1f6a1 expref: -99 pid: 22883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263902.313899:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec0ec848-5fac-4f6a-ba8a-daed864d309d:3620:1876178898166272:0@lo:103:ldlm_bl.0 10000000:01000000:0.0:1789263902.313900:0:22893:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789263902.313928:0:22893:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22200/0xce1582440fb1f69a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1f6a1 expref: -99 pid: 22883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263902.313934:0:22893:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789263902.313941:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789263902.313948:0:22893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22200/0xce1582440fb1f69a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1f6a1 expref: -99 pid: 22883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263902.313953:0:22893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22200/0xce1582440fb1f69a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1f6a1 expref: -99 pid: 22883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263902.313966:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263902.313969:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263902.313972:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789263902.313974:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec0ec848-5fac-4f6a-ba8a-daed864d309d:3621:1876178898166400:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789263902.313978:0:22891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898166272 00000100:00100000:3.0:1789263902.313982:0:22891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898166272 00000100:00100000:2.0:1789263902.314009:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789263902.314034:0:22891:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd981530800/0xce1582440fb1f7a4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1f79d expref: 18 pid: 22899 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263902.314037:0:22890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898166400 00000100:00100000:1.0:1789263902.314044:0:22890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898166400 00010000:00010000:1.0:1789263902.314065:0:22890:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd981531600/0xce1582440fb1f6a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1f69a expref: 19 pid: 22896 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263902.314101:0:22891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789263902.314111:0:22891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882437800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+19:3620:x1876178898166272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789263902.314123:0:22891:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789263902.314129:0:22891:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd981530800/0xce1582440fb1f7a4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1f79d expref: 19 pid: 22899 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263902.314138:0:22890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1789263902.314143:0:22891:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd981530800/0xce1582440fb1f7a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce1582440fb1f79d expref: 19 pid: 22899 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263902.314150:0:22890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec0ec848-5fac-4f6a-ba8a-daed864d309d+19:3621:x1876178898166400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789263902.314162:0:22890:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789263902.314163:0:22891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd981530800/0xce1582440fb1f7a4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce1582440fb1f79d expref: 19 pid: 22899 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263902.314169:0:22890:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd981531600/0xce1582440fb1f6a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1f69a expref: 19 pid: 22896 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263902.314184:0:22891:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789263902.314188:0:22890:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd981531600/0xce1582440fb1f6a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce1582440fb1f69a expref: 18 pid: 22896 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263902.314202:0:22890:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd981531600/0xce1582440fb1f6a1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce1582440fb1f69a expref: 18 pid: 22896 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263902.314215:0:22890:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dd8841a3c00/0xce1582440fb1f7f1 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 24056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263902.314222:0:22891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882437800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+17:3620:x1876178898166272:12345-0@lo:103:ldlm_bl.0 Request processed in 112us (284us total) trans 0 rc 0/0 00010000:00010000:1.0:1789263902.314231:0:22890:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd8841a3c00/0xce1582440fb1f7f1 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 24056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263902.314232:0:22891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1789263902.314248:0:22890:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd8841a3c00/0xce1582440fb1f7f1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 24056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263902.314256:0:22890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd8841a3c00/0xce1582440fb1f7f1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 24056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263902.314262:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec0ec848-5fac-4f6a-ba8a-daed864d309d:3620:1876178898166272:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789263902.314265:0:22890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dd8841a3c00/0xce1582440fb1f7f1 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 24056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263902.314284:0:22890:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dd8841a3c00/0xce1582440fb1f7f1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 24056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263902.314290:0:22890:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd8841a3c00 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263902.314294:0:22890:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dd8841a3c00/0xce1582440fb1f7f1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 24056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263902.314302:0:22890:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dd8841a3c00/0xce1582440fb1f7f1 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 24056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263902.314320:0:22890:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dd8841a3c00/0xce1582440fb1f7f1 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263902.314330:0:22890:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789263902.314335:0:24056:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dd8841a3c00/0xce1582440fb1f7f1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263902.314343:0:24056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dd8841a3c00/0xce1582440fb1f7f1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263902.314348:0:24056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd8841a3c00/0xce1582440fb1f7f1 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263902.314370:0:22890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec0ec848-5fac-4f6a-ba8a-daed864d309d+16:3621:x1876178898166400:12345-0@lo:103:ldlm_bl.0 Request processed in 224us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263902.314378:0:22890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789263902.314405:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec0ec848-5fac-4f6a-ba8a-daed864d309d:3621:1876178898166400:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789263903.085385:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789263903.213171:0:22947:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9b7a9e600 going to sleep for 0 seconds 10000000:01000000:0.0:1789263904.046124:0:22901:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789263904.046131:0:22901:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dd883f8c000 from 13 10000000:01000000:0.0:1789263904.046137:0:22901:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789263904.046177:0:22901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd987f50e00/0xce1582440fb1f7f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263904.046189:0:22901:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd987f50e00/0xce1582440fb1f7f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263904.046200:0:22901:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd987f50e00/0xce1582440fb1f7f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263904.046226:0:22901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22901:1876178898166528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789263904.046305:0:22901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263904.046354:0:22901:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd986221a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789263904.046380:0:22898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898166528 00000100:00100000:0.0:1789263904.046387:0:22898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898166528 00000100:00100000:0.0:1789263904.046440:0:22898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789263904.046451:0:22898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98738d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec0ec848-5fac-4f6a-ba8a-daed864d309d+16:22901:x1876178898166528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789263904.046461:0:22898:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263904.046476:0:22898:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd987f50c00/0xce1582440fb1f7ff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1f7f8 expref: -99 pid: 22898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263904.046498:0:22898:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd987f50c00/0xce1582440fb1f7ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1f7f8 expref: 17 pid: 22898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263904.046510:0:22898:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd987f50c00/0xce1582440fb1f7ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1f7f8 expref: 17 pid: 22898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263904.046519:0:22898:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd987f50c00, rc 0) 00000100:00100000:0.0:1789263904.046568:0:22898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98738d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec0ec848-5fac-4f6a-ba8a-daed864d309d+17:22901:x1876178898166528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263904.046575:0:22898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789263904.046622:0:22901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22901:1876178898166528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789263904.046636:0:22901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd987f50e00/0xce1582440fb1f7f8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f7ff expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263904.046646:0:22901:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd987f50e00/0xce1582440fb1f7f8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1f7ff expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263904.046708:0:22901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22901:1876178898166656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789263904.046742:0:22901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263904.046763:0:22901:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd986221a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789263904.046837:0:22899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898166656 00000100:00100000:1.0:1789263904.046843:0:22899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898166656 00000100:00100000:0.0:1789263904.046881:0:22896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789263904.046890:0:22896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98738dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+17:22901:x1876178898166656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789263904.046996:0:22896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98738dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+17:22901:x1876178898166656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 108us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263904.047003:0:22896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789263904.047032:0:22901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22901:1876178898166656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789263904.047061:0:22901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882435180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22901:1876178898166784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789263904.047135:0:22901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263904.047153:0:22898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898166784 00000100:00100000:0.0:1789263904.047157:0:22898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898166784 00000100:00100000:1.0:1789263904.047162:0:22901:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd98556f600 going to sleep for 11 seconds 00000100:00100000:0.0:1789263904.047186:0:22898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789263904.047192:0:22898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec0ec848-5fac-4f6a-ba8a-daed864d309d+17:22901:x1876178898166784:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789263904.047275:0:22898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec0ec848-5fac-4f6a-ba8a-daed864d309d+17:22901:x1876178898166784:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 81us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263904.047283:0:22898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789263904.047298:0:22901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882435180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22901:1876178898166784:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789263904.047990:0:24316:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1789263904.048062:0:22901:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1789263904.048305:0:22901:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789263904.048311:0:22901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd987f50e00/0xce1582440fb1f7f8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f7ff expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263904.048320:0:22901:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd987f50e00/0xce1582440fb1f7f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f7ff expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789263904.048330:0:22901:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789263904.048332:0:22901:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dd9ac8fd000 from 13 10000000:01000000:0.0:1789263904.048334:0:22901:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789263904.048354:0:22901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd987f50a00/0xce1582440fb1f806 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263904.048373:0:22901:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd987f50a00/0xce1582440fb1f806 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263904.048379:0:22901:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd987f50a00/0xce1582440fb1f806 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263904.048391:0:22901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22901:1876178898166912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789263904.048416:0:22901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263904.048438:0:22901:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd986221c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789263904.048459:0:22896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898166912 00000100:00100000:1.0:1789263904.048464:0:22896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898166912 00000100:00100000:1.0:1789263904.048500:0:22896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789263904.048507:0:22896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+17:22901:x1876178898166912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789263904.048515:0:22896:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263904.048524:0:22896:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd8841a3400/0xce1582440fb1f80d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1f806 expref: -99 pid: 22896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263904.048540:0:22896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd8841a3400/0xce1582440fb1f80d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1f806 expref: 18 pid: 22896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263904.048547:0:22896:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd8841a3400/0xce1582440fb1f80d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1f806 expref: 18 pid: 22896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263904.048552:0:22896:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd8841a3400, rc 0) 00000100:00100000:1.0:1789263904.048589:0:22896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+18:22901:x1876178898166912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 81us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263904.048593:0:22896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789263904.048615:0:22901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22901:1876178898166912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789263904.048625:0:22901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd987f50a00/0xce1582440fb1f806 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f80d expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263904.048630:0:22901:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd987f50a00/0xce1582440fb1f806 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1f80d expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263904.048667:0:22901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22901:1876178898167040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789263904.048695:0:22901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263904.048714:0:22901:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd986221c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789263904.048720:0:22899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898167040 00000100:00100000:1.0:1789263904.048725:0:22899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898167040 00000100:00100000:1.0:1789263904.048751:0:22899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789263904.048759:0:22899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+18:22901:x1876178898167040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789263904.048843:0:22899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+18:22901:x1876178898167040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 85us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263904.048849:0:22899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789263904.048861:0:22901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22901:1876178898167040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789263904.048884:0:22901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22901:1876178898167168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789263904.048936:0:22901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263904.048955:0:22901:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd986221c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789263904.048958:0:22896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898167168 00000100:00100000:1.0:1789263904.048962:0:22896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898167168 00000100:00100000:1.0:1789263904.048989:0:22896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789263904.048997:0:22896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882aad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+18:22901:x1876178898167168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789263904.049068:0:22896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882aad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+18:22901:x1876178898167168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 72us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263904.049102:0:22901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22901:1876178898167168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789263904.049462:0:22896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000040:00080000:3.0:1789263904.049924:0:24317:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1789263904.050012:0:22901:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1789263904.050035:0:22901:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789263904.050042:0:22901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd987f50a00/0xce1582440fb1f806 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f80d expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263904.050051:0:22901:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd987f50a00/0xce1582440fb1f806 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f80d expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263904.109218:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789263904.237175:0:22947:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9b7a9e600 going to sleep for 0 seconds 00000020:01000004:2.0:1789263904.606928:0:24405:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789263904.606932:0:24405:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1789263904.606933:0:24405:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1789263904.607037:0:24405:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9dd9abd9e000 00000020:01000004:2.0:1789263904.607052:0:24405:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1789263904.607064:0:24405:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789263904.607107:0:24405:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9dd883898000) 00000020:00000080:2.0:1789263904.607131:0:24405:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789263904.629554:0:24405:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1789263904.630211:0:24405:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1789263904.630329:0:24405:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1789263904.630557:0:24405:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1789263904.630671:0:24405:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1789263904.630822:0:24405:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1789263904.630946:0:24405:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:2.0:1789263904.632247:0:24405:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789263904.632391:0:24405:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1789263904.632400:0:24405:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789263904.632408:0:24405:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xce1582440fb1f81b 00000020:01000004:2.0:1789263904.632412:0:24405:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1789263904.632428:0:24405:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.120@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789263904.632430:0:24405:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.120@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789263904.632434:0:24405:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1789263904.632437:0:24405:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1789263904.632445:0:24405:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9dd88389cd28) 00000020:00000080:2.0:1789263904.632451:0:24405:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:2.0:1789263904.633453:0:24405:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789263904.633584:0:24405:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1789263904.633590:0:24405:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1789263904.633952:0:24405:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1789263904.633959:0:24405:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1789263904.634188:0:24405:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1789263904.634194:0:24405:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1789263904.635335:0:24405:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789263904.635495:0:24405:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1789263904.635499:0:24405:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1789263904.635824:0:24405:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1789263904.635830:0:24405:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1789263904.645141:0:24405:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789263904.645323:0:24405:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789263904.645327:0:24405:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1789263904.646129:0:24405:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789263904.646138:0:24405:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1789263904.646787:0:24405:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789263904.646793:0:24405:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1789263904.648366:0:24405:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789263904.648493:0:24405:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1789263904.648496:0:24405:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1789263904.648833:0:24405:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1789263904.648840:0:24405:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1789263904.669611:0:24405:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789263904.669826:0:24405:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1789263904.669832:0:24405:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1789263904.670663:0:24405:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1789263904.670671:0:24405:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1789263904.670935:0:24405:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1789263904.670960:0:24405:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1789263904.670964:0:24405:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.120@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1789263904.675562:0:24405:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.120@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789263904.675593:0:24405:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.120@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1789263904.675596:0:24405:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789263904.675598:0:24405:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789263904.675601:0:24405:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789263904.675602:0:24405:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789263904.675602:0:24405:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789263904.675603:0:24405:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789263904.675604:0:24405:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789263904.675605:0:24405:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789263904.675606:0:24405:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789263904.675608:0:24405:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1789263904.675610:0:24405:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789263904.675611:0:24405:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789263904.675611:0:24405:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789263904.675612:0:24405:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789263904.675612:0:24405:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789263904.675613:0:24405:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789263904.675614:0:24405:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789263904.675614:0:24405:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789263904.675615:0:24405:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789263904.675633:0:24405:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789263904.675647:0:24405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:24405:1876178898167296:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789263904.675702:0:24405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263904.675744:0:24405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd986339240 going to sleep for 11 seconds 00000100:00100000:1.0:1789263904.675745:0:22899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898167296 00000100:00100000:1.0:1789263904.675753:0:22899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898167296 00000100:00100000:1.0:1789263904.675814:0:22899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789263904.675825:0:22899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882aad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+18:24405:x1876178898167296:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789263904.675868:0:22899:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1789263904.675876:0:22899:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1789263904.675880:0:22899:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1789263904.676147:0:22899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882aad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+18:24405:x1876178898167296:12345-0@lo:253:mount.lustre.0 Request processed in 324us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263904.676155:0:22899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789263904.676158:0:24405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:24405:1876178898167296:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789263904.676166:0:24405:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789263904.676168:0:24405:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789263904.676169:0:24405:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789263904.676170:0:24405:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789263904.676171:0:24405:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789263904.676172:0:24405:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789263904.676173:0:24405:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789263904.676174:0:24405:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789263904.676175:0:24405:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789263904.676176:0:24405:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789263904.676191:0:24405:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9dd9abd9e000 from lustre-OST0000 10000000:01000000:0.0:1789263904.676216:0:24405:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1789263904.676219:0:24405:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789263904.676224:0:24405:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9dd8838099b8 local copy 00010000:00010000:0.0:1789263904.676232:0:24405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22000/0xce1582440fb1f5dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f5e4 expref: -99 pid: 22883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263904.676290:0:24405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:24405:1876178898167424:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789263904.676320:0:24405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263904.676343:0:24405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9863396c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789263904.676359:0:22896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898167424 00000100:00100000:1.0:1789263904.676365:0:22896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898167424 00000100:00100000:1.0:1789263904.676386:0:22896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789263904.676390:0:22896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882aae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+18:24405:x1876178898167424:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789263904.676459:0:22896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882aae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+18:24405:x1876178898167424:12345-0@lo:501:mount.lustre.0 Request processed in 68us (138us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789263904.676465:0:22896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789263904.676487:0:24405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:24405:1876178898167424:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789263904.676497:0:24405:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.120@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789263904.676512:0:24405:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.120@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789263904.676518:0:24405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22000/0xce1582440fb1f5dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f5e4 expref: -99 pid: 22883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263904.676526:0:24405:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22000/0xce1582440fb1f5dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f5e4 expref: -99 pid: 22883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789263904.676547:0:24405:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9dd9abd9e000 10000000:01000000:0.0:1789263904.676552:0:24405:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789263904.676557:0:24405:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789263904.676559:0:24405:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789263904.676563:0:24405:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1789263904.676566:0:24405:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789263904.676585:0:24405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd987f51e00/0xce1582440fb1f829 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263904.676594:0:24405:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd987f51e00/0xce1582440fb1f829 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263904.676602:0:24405:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd987f51e00/0xce1582440fb1f829 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263904.676624:0:24405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:24405:1876178898167552:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789263904.676649:0:24405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263904.676666:0:24405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9863396c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789263904.676677:0:22899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898167552 00000100:00100000:1.0:1789263904.676681:0:22899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898167552 00000100:00100000:1.0:1789263904.676704:0:22899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789263904.676712:0:22899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882aae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+18:24405:x1876178898167552:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789263904.676729:0:22899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263904.676740:0:22899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd8841a3600/0xce1582440fb1f830 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1f829 expref: -99 pid: 22899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263904.676758:0:22899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd8841a3600/0xce1582440fb1f830 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1f829 expref: 19 pid: 22899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263904.676765:0:22899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd8841a3600/0xce1582440fb1f830 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1f829 expref: 19 pid: 22899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263904.676781:0:22899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd8841a3600, rc 0) 00000100:00100000:1.0:1789263904.676804:0:22899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882aae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+19:24405:x1876178898167552:12345-0@lo:101:mount.lustre.0 Request processed in 94us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263904.676808:0:22899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789263904.676827:0:24405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:24405:1876178898167552:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789263904.676840:0:24405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd987f51e00/0xce1582440fb1f829 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f830 expref: -99 pid: 24405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263904.676849:0:24405:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd987f51e00/0xce1582440fb1f829 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1f830 expref: -99 pid: 24405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789263904.677368:0:24405:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:0.0:1789263904.677712:0:24405:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789263904.678911:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1789263904.678940:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:0.0:1789263904.678956:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:0.0:1789263904.678970:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:0.0:1789263904.678981:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:0.0:1789263904.678992:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:0.0:1789263904.679002:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:0.0:1789263904.679012:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:0.0:1789263904.679024:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:0.0:1789263904.679032:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:0.0:1789263904.679038:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:0.0:1789263904.679045:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:0.0:1789263904.679068:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:0.0:1789263904.679071:0:24405:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:0.0:1789263904.679154:0:24405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:24405:1876178898167680:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789263904.679190:0:24405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263904.679222:0:22896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898167680 00000100:00100000:1.0:1789263904.679227:0:22896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898167680 00000100:00100000:0.0:1789263904.679228:0:24405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd98878fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1789263904.679259:0:22896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789263904.679267:0:22896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882aac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+19:24405:x1876178898167680:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789263904.679357:0:22896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882aac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+19:24405:x1876178898167680:12345-0@lo:501:mount.lustre.0 Request processed in 92us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263904.679364:0:22896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789263904.679378:0:24405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:24405:1876178898167680:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789263904.679405:0:24405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:24405:1876178898167808:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789263904.679438:0:24405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263904.679451:0:24405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd98878fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1789263904.679462:0:22899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898167808 00000100:00100000:1.0:1789263904.679465:0:22899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898167808 00000100:00100000:1.0:1789263904.679483:0:22899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789263904.679488:0:22899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882aafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+19:24405:x1876178898167808:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789263904.679861:0:22899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882aafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+19:24405:x1876178898167808:12345-0@lo:503:mount.lustre.0 Request processed in 373us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263904.679877:0:22899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789263904.679889:0:24405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:24405:1876178898167808:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789263904.680135:0:24405:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789263904.680170:0:24405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:24405:1876178898167936:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789263904.680202:0:24405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263904.680228:0:24405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd98878fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1789263904.680249:0:22896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898167936 00000100:00100000:1.0:1789263904.680253:0:22896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898167936 00000100:00100000:1.0:1789263904.680276:0:22896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789263904.680282:0:22896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9ab807450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+19:24405:x1876178898167936:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789263904.680473:0:22896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9ab807450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+19:24405:x1876178898167936:12345-0@lo:502:mount.lustre.0 Request processed in 190us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263904.680481:0:22896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789263904.680497:0:24405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:24405:1876178898167936:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789263904.680609:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:0.0:1789263904.680629:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:0.0:1789263904.680641:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:0.0:1789263904.680651:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:0.0:1789263904.680663:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:0.0:1789263904.680674:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:0.0:1789263904.680685:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:0.0:1789263904.680696:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:0.0:1789263904.680703:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:0.0:1789263904.680710:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:0.0:1789263904.680717:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:0.0:1789263904.680723:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:0.0:1789263904.680736:0:24405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:24405:1876178898168064:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789263904.680759:0:24405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263904.680784:0:24405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd98878fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1789263904.680799:0:22899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898168064 00000100:00100000:1.0:1789263904.680803:0:22899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898168064 00000100:00100000:1.0:1789263904.680825:0:22899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789263904.680838:0:22899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9ab805850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+19:24405:x1876178898168064:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789263904.680898:0:22899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9ab805850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+19:24405:x1876178898168064:12345-0@lo:502:mount.lustre.0 Request processed in 61us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263904.680905:0:22899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789263904.680908:0:24405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:24405:1876178898168064:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789263904.680945:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:0.0:1789263904.680952:0:24405:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:2.0:1789263904.681389:0:24422:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789263904.681396:0:24422:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1789263904.681402:0:24422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263904.681405:0:24422:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1789263904.681411:0:24422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789263904.681424:0:24422:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9dd88389b370) 00000020:00000080:2.0:1789263904.681445:0:24422:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789263904.681451:0:24422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789263904.681524:0:24422:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dd9abd9e000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1789263904.681532:0:24422:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789263904.681539:0:24422:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xce1582440fb1f83e 00010000:00010000:2.0:1789263904.684684:0:24422:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:2.0:1789263904.685007:0:24422:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934600 00080000:10000000:2.0:1789263904.686021:0:24422:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:1.0:1789263904.686876:0:24422:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1789263904.686885:0:24422:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789263904.686892:0:24422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789263904.686894:0:24422:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1789263904.686898:0:24422:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789263904.686900:0:24422:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:1.0:1789263904.686902:0:24422:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789263904.686905:0:24422:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789263904.686906:0:24422:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789263904.686908:0:24422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789263904.686910:0:24422:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789263904.686912:0:24422:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789263904.686914:0:24422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789263904.686915:0:24422:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789263904.686922:0:24422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789263904.686923:0:24422:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789263904.686925:0:24422:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789263904.686928:0:24422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789263904.686929:0:24422:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789263904.686932:0:24422:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789263904.686934:0:24422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789263904.686935:0:24422:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789263904.686937:0:24422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1789263904.686955:0:24422:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789263904.686957:0:24422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789263904.686958:0:24422:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789263904.686961:0:24422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:0.0:1789263904.687045:0:24405:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1789263904.687098:0:24405:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789263904.687118:0:24405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd987f51e00/0xce1582440fb1f829 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f830 expref: -99 pid: 24405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263904.687129:0:24405:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd987f51e00/0xce1582440fb1f829 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f830 expref: -99 pid: 24405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789263904.687136:0:24405:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dd9abd9e000 from 1 10000000:01000000:0.0:1789263904.687139:0:24405:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789263904.687170:0:24405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd987f51400/0xce1582440fb1f845 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263904.687177:0:24405:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd987f51400/0xce1582440fb1f845 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263904.687188:0:24405:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd987f51400/0xce1582440fb1f845 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263904.687208:0:24405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:24405:1876178898168192:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789263904.687263:0:24405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263904.687302:0:24405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd98878fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1789263904.687323:0:22896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898168192 00000100:00100000:1.0:1789263904.687330:0:22896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898168192 00000100:00100000:1.0:1789263904.687375:0:22896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789263904.687386:0:22896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9ab807050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+19:24405:x1876178898168192:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789263904.687399:0:22896:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263904.687416:0:22896:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd8841a2800/0xce1582440fb1f84c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1f845 expref: -99 pid: 22896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263904.687445:0:22896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd8841a2800/0xce1582440fb1f84c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1f845 expref: 20 pid: 22896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263904.687456:0:22896:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd8841a2800/0xce1582440fb1f84c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1f845 expref: 20 pid: 22896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263904.687465:0:22896:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd8841a2800, rc 0) 00000100:00100000:1.0:1789263904.687509:0:22896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9ab807050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+20:24405:x1876178898168192:12345-0@lo:101:mount.lustre.0 Request processed in 125us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263904.687517:0:22896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789263904.687534:0:24405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:24405:1876178898168192:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789263904.687549:0:24405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd987f51400/0xce1582440fb1f845 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f84c expref: -99 pid: 24405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263904.687558:0:24405:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd987f51400/0xce1582440fb1f845 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1f84c expref: -99 pid: 24405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789263904.688276:0:24405:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:3.0:1789263904.688437:0:24405:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789263904.688619:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1789263904.688651:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:3.0:1789263904.688670:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:3.0:1789263904.688705:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:3.0:1789263904.688719:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:3.0:1789263904.688735:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:3.0:1789263904.688749:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:3.0:1789263904.688764:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:3.0:1789263904.688798:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:3.0:1789263904.688815:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:3.0:1789263904.688825:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:3.0:1789263904.688840:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:3.0:1789263904.688845:0:24405:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:3.0:1789263904.688894:0:24405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883b6d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:24405:1876178898168320:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789263904.688923:0:24405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263904.688947:0:24405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9862b6a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789263904.688960:0:22899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898168320 00000100:00100000:1.0:1789263904.688966:0:22899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898168320 00000100:00100000:1.0:1789263904.689000:0:22899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789263904.689008:0:22899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9ab805450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+20:24405:x1876178898168320:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789263904.689105:0:22899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9ab805450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+20:24405:x1876178898168320:12345-0@lo:501:mount.lustre.0 Request processed in 98us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263904.689114:0:22899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789263904.689142:0:24405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883b6d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:24405:1876178898168320:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789263904.689165:0:24405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883b6d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:24405:1876178898168448:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789263904.689202:0:24405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263904.689231:0:24405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9862b6a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789263904.689238:0:22896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898168448 00000100:00100000:1.0:1789263904.689244:0:22896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898168448 00000100:00100000:1.0:1789263904.689275:0:22896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789263904.689281:0:22896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9ab804c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+20:24405:x1876178898168448:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789263904.689358:0:22896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9ab804c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+20:24405:x1876178898168448:12345-0@lo:503:mount.lustre.0 Request processed in 76us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263904.689363:0:22896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789263904.689383:0:24405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883b6d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:24405:1876178898168448:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789263904.689626:0:24405:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789263904.689665:0:24405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883b6d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:24405:1876178898168576:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789263904.689699:0:24405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263904.689722:0:24405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9862b6a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789263904.689744:0:22899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898168576 00000100:00100000:1.0:1789263904.689749:0:22899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898168576 00000100:00100000:1.0:1789263904.689789:0:22899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789263904.689797:0:22899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9ab804850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+20:24405:x1876178898168576:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789263904.689865:0:22899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9ab804850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+20:24405:x1876178898168576:12345-0@lo:502:mount.lustre.0 Request processed in 69us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263904.689873:0:22899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789263904.689892:0:24405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883b6d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:24405:1876178898168576:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789263904.689992:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1789263904.690014:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:3.0:1789263904.690026:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:3.0:1789263904.690039:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:3.0:1789263904.690096:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:3.0:1789263904.690113:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:3.0:1789263904.690127:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:3.0:1789263904.690135:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:3.0:1789263904.690142:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:3.0:1789263904.690149:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:3.0:1789263904.690157:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:3.0:1789263904.690171:0:24405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883b6d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:24405:1876178898168704:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789263904.690200:0:24405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263904.690219:0:24405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9862b6a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789263904.690224:0:22896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898168704 00000100:00100000:1.0:1789263904.690229:0:22896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898168704 00000100:00100000:1.0:1789263904.690255:0:22896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789263904.690261:0:22896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9ab807850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+20:24405:x1876178898168704:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789263904.690324:0:22896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9ab807850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+20:24405:x1876178898168704:12345-0@lo:502:mount.lustre.0 Request processed in 63us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263904.690337:0:22896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789263904.690342:0:24405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883b6d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:24405:1876178898168704:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789263904.690384:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:3.0:1789263904.690391:0:24405:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1789263904.690748:0:24426:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789263904.690754:0:24426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789263904.690756:0:24426:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789263904.690761:0:24426:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dd9abd9e000 00000020:00000080:3.0:1789263904.690764:0:24426:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789263904.690781:0:24426:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789263904.690785:0:24426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789263904.690787:0:24426:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789263904.690790:0:24426:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789263904.690794:0:24426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789263904.690795:0:24426:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789263904.690799:0:24426:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dd9abd9e000 00000020:00000080:3.0:1789263904.690803:0:24426:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789263904.690847:0:24426:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789263904.690850:0:24426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789263904.690852:0:24426:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789263904.690854:0:24426:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789263904.690856:0:24426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789263904.690857:0:24426:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789263904.690864:0:24426:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9dd9abd9e000 00000020:00000080:3.0:1789263904.690866:0:24426:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789263904.690880:0:24426:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789263904.690882:0:24426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789263904.690883:0:24426:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789263904.690886:0:24426:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789263904.690888:0:24426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789263904.690889:0:24426:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789263904.690892:0:24426:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9dd9abd9e000 00000020:00000080:3.0:1789263904.690894:0:24426:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789263904.690914:0:24426:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789263904.690917:0:24426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789263904.690918:0:24426:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789263904.690920:0:24426:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:1.0:1789263904.690963:0:24405:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1789263904.690984:0:24405:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789263904.690997:0:24405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd987f51400/0xce1582440fb1f845 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f84c expref: -99 pid: 24405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263904.691007:0:24405:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd987f51400/0xce1582440fb1f845 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f84c expref: -99 pid: 24405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789263904.691063:0:24405:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789263904.691070:0:24405:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9dd9abd9e000 10000000:01000000:1.0:1789263904.691074:0:24405:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9dd9abd9e000 10000000:01000000:1.0:1789263904.691131:0:24405:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789263904.691136:0:24405:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9dd9abd9e000 from 1 10000000:01000000:1.0:1789263904.691138:0:24405:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789263904.691160:0:24405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd8841a3800/0xce1582440fb1f853 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263904.691168:0:24405:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd8841a3800/0xce1582440fb1f853 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263904.691176:0:24405:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd8841a3800/0xce1582440fb1f853 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263904.691189:0:24405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882435180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:24405:1876178898168832:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789263904.691220:0:24405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263904.691247:0:24405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd88429f000 going to sleep for 11 seconds 00000100:00100000:0.0:1789263904.691247:0:22899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898168832 00000100:00100000:0.0:1789263904.691254:0:22899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898168832 00000100:00100000:0.0:1789263904.691287:0:22899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789263904.691296:0:22899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9ab804450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+20:24405:x1876178898168832:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789263904.691304:0:22899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263904.691314:0:22899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd987f50200/0xce1582440fb1f85a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1f853 expref: -99 pid: 22899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263904.691333:0:22899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd987f50200/0xce1582440fb1f85a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1f853 expref: 21 pid: 22899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263904.691342:0:22899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd987f50200/0xce1582440fb1f85a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1f853 expref: 21 pid: 22899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263904.691350:0:22899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd987f50200, rc 0) 00000100:00100000:0.0:1789263904.691384:0:22899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9ab804450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+21:24405:x1876178898168832:12345-0@lo:101:mount.lustre.0 Request processed in 90us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263904.691391:0:22899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789263904.691410:0:24405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882435180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:24405:1876178898168832:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789263904.691423:0:24405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd8841a3800/0xce1582440fb1f853 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f85a expref: -99 pid: 24405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263904.691440:0:24405:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd8841a3800/0xce1582440fb1f853 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1f85a expref: -99 pid: 24405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789263904.692295:0:24405:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:3.0:1789263904.692443:0:24405:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789263904.692601:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1789263904.692639:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:3.0:1789263904.692664:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:3.0:1789263904.692684:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:3.0:1789263904.692702:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:3.0:1789263904.692721:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:3.0:1789263904.692753:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:3.0:1789263904.692784:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:3.0:1789263904.692807:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1789263904.692835:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:3.0:1789263904.692862:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:3.0:1789263904.692899:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:3.0:1789263904.692921:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:3.0:1789263904.692941:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:3.0:1789263904.692963:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:3.0:1789263904.692981:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:3.0:1789263904.692997:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:3.0:1789263904.693018:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:3.0:1789263904.693031:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:3.0:1789263904.693043:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:3.0:1789263904.693062:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:3.0:1789263904.693112:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:3.0:1789263904.693140:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:3.0:1789263904.693166:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:3.0:1789263904.693188:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:3.0:1789263904.693214:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:3.0:1789263904.693239:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:3.0:1789263904.693280:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:3.0:1789263904.693309:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:3.0:1789263904.693335:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:3.0:1789263904.693360:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:3.0:1789263904.693383:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:3.0:1789263904.693404:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:3.0:1789263904.693429:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:3.0:1789263904.693452:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:3.0:1789263904.693473:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:3.0:1789263904.693493:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:3.0:1789263904.693517:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:3.0:1789263904.693537:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:3.0:1789263904.693559:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:3.0:1789263904.693578:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:3.0:1789263904.693600:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:3.0:1789263904.693612:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:3.0:1789263904.693644:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:3.0:1789263904.693670:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:3.0:1789263904.693693:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:3.0:1789263904.693717:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:3.0:1789263904.693737:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:3.0:1789263904.693915:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:3.0:1789263904.693945:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:3.0:1789263904.693979:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:3.0:1789263904.693985:0:24405:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:3.0:1789263904.694051:0:24405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883b6d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:24405:1876178898168960:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789263904.694122:0:24405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263904.694183:0:22896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898168960 00000100:00100000:3.0:1789263904.694188:0:22896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898168960 00000100:00100000:3.0:1789263904.694221:0:22896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789263904.694228:0:22896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9ab807c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+21:24405:x1876178898168960:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789263904.694251:0:24405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9862b63c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789263904.694308:0:22896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9ab807c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+21:24405:x1876178898168960:12345-0@lo:501:mount.lustre.0 Request processed in 81us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263904.694315:0:22896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789263904.694327:0:24405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883b6d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:24405:1876178898168960:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789263904.694362:0:24405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:24405:1876178898169088:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789263904.694406:0:24405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263904.694429:0:24405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9bf982600 going to sleep for 11 seconds 00000100:00100000:0.0:1789263904.694429:0:22899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898169088 00000100:00100000:0.0:1789263904.694433:0:22899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898169088 00000100:00100000:0.0:1789263904.694462:0:22899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789263904.694469:0:22899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9ab806450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+21:24405:x1876178898169088:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789263904.694548:0:22899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9ab806450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+21:24405:x1876178898169088:12345-0@lo:503:mount.lustre.0 Request processed in 79us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263904.694555:0:22899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789263904.694556:0:24405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:24405:1876178898169088:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789263904.694853:0:24405:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789263904.694916:0:24405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:24405:1876178898169216:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789263904.694950:0:24405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263904.694972:0:24405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9bf982600 going to sleep for 11 seconds 00000100:00100000:1.0:1789263904.694997:0:22896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898169216 00000100:00100000:1.0:1789263904.695003:0:22896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898169216 00000100:00100000:1.0:1789263904.695028:0:22896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789263904.695034:0:22896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9ab806050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+21:24405:x1876178898169216:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789263904.695147:0:22896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9ab806050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+21:24405:x1876178898169216:12345-0@lo:502:mount.lustre.0 Request processed in 112us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263904.695154:0:22896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789263904.695157:0:24405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:24405:1876178898169216:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789263904.695296:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1789263904.695321:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:2.0:1789263904.695338:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:2.0:1789263904.695354:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:2.0:1789263904.695370:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:2.0:1789263904.695385:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:2.0:1789263904.695401:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:2.0:1789263904.695416:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:2.0:1789263904.695430:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1789263904.695445:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:2.0:1789263904.695461:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:2.0:1789263904.695474:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:2.0:1789263904.695486:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:2.0:1789263904.695513:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:2.0:1789263904.695533:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:2.0:1789263904.695555:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:2.0:1789263904.695571:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:2.0:1789263904.695588:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:2.0:1789263904.695605:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:2.0:1789263904.695623:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:2.0:1789263904.695640:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:2.0:1789263904.695655:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:2.0:1789263904.695669:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:2.0:1789263904.695685:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:2.0:1789263904.695702:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:2.0:1789263904.695720:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:2.0:1789263904.695734:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:2.0:1789263904.695748:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:2.0:1789263904.695763:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:2.0:1789263904.695806:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:2.0:1789263904.695827:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:2.0:1789263904.695845:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:2.0:1789263904.695863:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:2.0:1789263904.695880:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:2.0:1789263904.695897:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:2.0:1789263904.695915:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:2.0:1789263904.695934:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:2.0:1789263904.695952:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:2.0:1789263904.695970:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:2.0:1789263904.695988:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:2.0:1789263904.696006:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:2.0:1789263904.696023:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:2.0:1789263904.696040:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:2.0:1789263904.696057:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:2.0:1789263904.696123:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:2.0:1789263904.696153:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:2.0:1789263904.696171:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:2.0:1789263904.696189:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:2.0:1789263904.696231:0:24405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:24405:1876178898169344:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789263904.696266:0:24405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263904.696298:0:24405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9bf982600 going to sleep for 11 seconds 00000100:00100000:1.0:1789263904.696305:0:22899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898169344 00000100:00100000:1.0:1789263904.696310:0:22899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898169344 00000100:00100000:1.0:1789263904.696339:0:22899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789263904.696348:0:22899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9ab805c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+21:24405:x1876178898169344:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789263904.696451:0:24405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:24405:1876178898169344:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789263904.696457:0:22899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9ab805c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+21:24405:x1876178898169344:12345-0@lo:502:mount.lustre.0 Request processed in 108us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263904.696466:0:22899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000040:00080000:2.0:1789263904.696586:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:2.0:1789263904.696609:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:2.0:1789263904.696629:0:24405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:24405:1876178898169472:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789263904.696662:0:24405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263904.696681:0:24405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9bf982600 going to sleep for 11 seconds 00000100:00100000:0.0:1789263904.696694:0:22896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898169472 00000100:00100000:0.0:1789263904.696698:0:22896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898169472 00000100:00100000:0.0:1789263904.696729:0:22896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789263904.696737:0:22896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9ab804050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+21:24405:x1876178898169472:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789263904.696815:0:22896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9ab804050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+21:24405:x1876178898169472:12345-0@lo:502:mount.lustre.0 Request processed in 79us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263904.696822:0:22896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789263904.696825:0:24405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:24405:1876178898169472:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789263904.696861:0:24405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:2.0:1789263904.696868:0:24405:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1789263904.697280:0:24431:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1789263904.697293:0:24431:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9dd9c1bab370) 00000020:00000080:0.0:1789263904.697312:0:24431:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:0.0:1789263904.697374:0:24431:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dd9abd9e000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789263904.697377:0:24431:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dd9abd9e000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789263904.697379:0:24431:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dd9abd9e000 3 00010000:00080000:0.0:1789263904.697406:0:24431:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dd9abedd800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.120@tcp at head 00010000:00010000:0.0:1789263904.698929:0:24431:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:0.0:1789263904.699131:0:24431:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1789263904.699168:0:24431:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789263904.699180:0:24431:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xce1582440fb1f868 00000100:00080000:0.0:1789263904.699187:0:24431:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789263904.699192:0:24431:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9dd9abedd800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:0.0:1789263904.699221:0:24431:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd9bfaac000 x1876178898169600/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789263904.699257:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3617:1876178898169600:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789263904.699335:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263904.699388:0:22938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898169600 00000100:00100000:0.0:1789263904.699394:0:22938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898169600 00000100:00100000:0.0:1789263904.699421:0:22938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789263904.699426:0:22938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3617:x1876178898169600:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789263904.699444:0:22938:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 346 last 0 00000020:00000080:0.0:1789263904.699489:0:22938:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xce1582440fb1f86f 00000004:00100000:0.0:1789263904.699503:0:22938:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789263904.699529:0:22938:0:(import.c:65:import_set_state_nolock()) ffff9dd9abc71000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789263904.699575:0:22938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1876178898169600:12345-0@lo:38:llog_process_th.0 Request processed in 147us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263904.699582:0:22938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789263904.699615:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dd9bfaac000 x1876178898169600/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789263914 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263904.699624:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789263904.699631:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:0.0:1789263904.699638:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789263904.699641:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789263904.699644:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd9abedd800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789263904.699650:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3617:1876178898169600:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1789263904.699671:0:24431:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789263904.699692:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789263904.699696:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1789263904.699699:0:38:0:(import.c:65:import_set_state_nolock()) ffff9dd990819800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789263904.699704:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9dd990819800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:0.0:1789263904.699718:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd9bfaac000 x1876178898169728/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789263904.699733:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789263904.699736:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789263904.699740:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789263904.699747:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789263904.699792:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789263904.699795:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789263904.699797:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789263904.699801:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789263904.699804:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876178898169856:0@lo:400:kworker.0 00000100:00100000:0.0:1789263904.699837:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1876178898170112:0@lo:400:kworker.0 00000100:00100000:3.0:1789263904.699845:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263904.699867:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789263904.699873:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898169984:0@lo:400:kworker.0 00000100:00100000:0.0:1789263904.699880:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263904.699921:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1876178898169728:0@lo:38:kworker.0 00000100:00100000:3.0:1789263904.699923:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263904.699954:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263904.699961:0:22904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898169856 00000100:00100000:3.0:1789263904.699965:0:22904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898169856 00000100:00100000:3.0:1789263904.699993:0:22904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898170112 00000100:00100000:3.0:1789263904.699995:0:22904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898170112 00000100:00100000:0.0:1789263904.700000:0:22909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898169984 00000100:00100000:0.0:1789263904.700006:0:22909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898169984 00000100:00100000:3.0:1789263904.700013:0:22904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789263904.700022:0:22904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883b6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876178898169856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263904.700035:0:22909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898169728 00000100:00100000:0.0:1789263904.700039:0:22909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898169728 00000100:00100000:0.0:1789263904.700052:0:22909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789263904.700060:0:22909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883b6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1876178898169984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263904.700070:0:22904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883b6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876178898169856:12345-0@lo:400:kworker.0 Request processed in 50us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263904.700101:0:22904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789263904.700119:0:22909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883b6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1876178898169984:12345-0@lo:400:kworker.0 Request processed in 58us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263904.700123:0:22904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789263904.700132:0:22909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789263904.700136:0:22904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1876178898170112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263904.700148:0:22909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789263904.700155:0:22909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3617:x1876178898169728:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1789263904.700171:0:22909:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 346 last 0 00000100:00100000:3.0:1789263904.700190:0:22904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1876178898170112:12345-0@lo:400:kworker.0 Request processed in 57us (313us total) trans 0 rc 0/0 00000020:00000080:0.0:1789263904.700194:0:22909:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xce1582440fb1f876 00000100:00100000:3.0:1789263904.700197:0:22904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000004:00100000:0.0:1789263904.700205:0:22909:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1789263904.700212:0:22909:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00010000:00080000:3.0:1789263904.700229:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dd9bfaadc00 x1876178898170112/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263920 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263904.700237:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1876178898170112:0@lo:400:kworker.0 00000100:00100000:3.0:1789263904.700255:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898169984:0@lo:400:kworker.0 00010000:00080000:3.0:1789263904.700264:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dd9bfaaed80 x1876178898169856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263920 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263904.700270:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876178898169856:0@lo:400:kworker.0 00000020:01000004:0.0:1789263904.700453:0:24431:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1789263904.700465:0:24431:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9dd9c1ba99b8) 00000020:00000080:0.0:1789263904.700481:0:24431:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:0.0:1789263904.700556:0:24431:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dd9abd9e000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789263904.700560:0:24431:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dd9abd9e000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789263904.700562:0:24431:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dd9abd9e000 3 00010000:00080000:0.0:1789263904.700597:0:24431:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dd88399c000@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.120@tcp at head 00010000:00010000:0.0:1789263904.702363:0:24431:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:0.0:1789263904.702820:0:24431:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1789263904.702933:0:24431:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789263904.702961:0:24431:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xce1582440fb1f884 00000100:00080000:0.0:1789263904.702969:0:24431:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789263904.702974:0:24431:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9dd88399c000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:0.0:1789263904.703022:0:24431:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd9bfaaf480 x1876178898170240/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789263904.703125:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3617:1876178898170240:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789263904.703178:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263904.703241:0:22904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898170240 00000100:00100000:0.0:1789263904.703247:0:22904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898170240 00000100:00100000:0.0:1789263904.703281:0:22904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789263904.703286:0:22904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3617:x1876178898170240:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789263904.703303:0:22904:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 346 last 0 00000020:00000080:0.0:1789263904.703350:0:22904:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xce1582440fb1f88b 00000004:00100000:0.0:1789263904.703361:0:22904:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789263904.703553:0:22904:0:(import.c:65:import_set_state_nolock()) ffff9dd88399c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789263904.703599:0:22904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1876178898170240:12345-0@lo:38:llog_process_th.0 Request processed in 311us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263904.703617:0:22904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789263904.703688:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dd9bfaaf480 x1876178898170240/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789263914 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263904.703699:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789263904.703705:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:0.0:1789263904.703711:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789263904.703715:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1789263904.703717:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd88399c000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789263904.703722:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3617:1876178898170240:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1789263904.703784:0:24431:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1789263904.703823:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789263904.703828:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789263904.703831:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789263904.703834:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789263904.703838:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789263904.703840:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789263904.703843:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789263904.703846:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789263904.704009:0:22909:0:(import.c:65:import_set_state_nolock()) ffff9dd883ae4000 : changing import state from RECOVER to FULL 00000040:00080000:0.0:1789263904.704020:0:24431:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000100:00100000:2.0:1789263904.704060:0:22909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3617:x1876178898169728:12345-0@lo:38:kworker.0 Request processed in 3902us (4104us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263904.704115:0:22909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000020:01000000:2.0:1789263904.704144:0:24405:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 00000100:00080000:0.0:1789263904.704182:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 10000000:01000000:2.0:1789263904.704183:0:24405:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-client' succeeded (0). 00000100:00080000:0.0:1789263904.704188:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1789263904.704193:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1789263904.704195:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd990819800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00010000:00010000:2.0:1789263904.704197:0:24405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd8841a3800/0xce1582440fb1f853 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f85a expref: -99 pid: 24405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263904.704206:0:24405:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd8841a3800/0xce1582440fb1f853 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f85a expref: -99 pid: 24405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789263904.704209:0:3617:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000008ba76ae8): req@ffff9dd883b6df80 x1876178898159872/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263904.704225:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1876178898169728:0@lo:38:kworker.0 00000020:01000004:2.0:1789263904.704256:0:24405:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789263904.704259:0:24405:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789263904.704261:0:24405:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789263904.704263:0:24405:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789263904.704265:0:24405:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789263904.704267:0:24405:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789263904.704270:0:24405:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789263904.704272:0:24405:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789263904.704273:0:24405:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789263904.704277:0:24405:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000100:00100000:1.0:1789263904.704277:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000020:01000004:2.0:1789263904.704284:0:24405:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000100:00100000:0.0:1789263904.704284:0:22947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:2.0:1789263904.704287:0:24405:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000100:00100000:1.0:1789263904.704288:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882435180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898170368:0@lo:41:osp-pre-1-0.0 00000020:01000004:2.0:1789263904.704292:0:24405:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789263904.704295:0:24405:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789263904.704297:0:24405:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789263904.704299:0:24405:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789263904.704300:0:24405:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789263904.704302:0:24405:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789263904.704303:0:24405:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1789263904.704309:0:22947:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9b7a9e600 going to sleep for 11 seconds 10000000:01000000:2.0:1789263904.704319:0:24405:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789263904.704324:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263904.704333:0:24405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:24405:1876178898170496:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789263904.704335:0:22908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898159872 00000100:00100000:0.0:1789263904.704340:0:22908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898159872 00000100:00100000:1.0:1789263904.704356:0:22927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898170368 00000100:00100000:1.0:1789263904.704360:0:22927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898170368 00000100:00100000:0.0:1789263904.704368:0:22908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789263904.704376:0:22908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:22947:x1876178898159872:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1789263904.704384:0:24405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263904.704385:0:22927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789263904.704395:0:22927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882434e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:3620:x1876178898170368:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789263904.704413:0:22927:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789263904.704418:0:24405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9bf982780 going to sleep for 11 seconds 00000100:00100000:0.0:1789263904.704435:0:22908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:22947:x1876178898159872:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 60us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263904.704447:0:22908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789263904.704463:0:22927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882434e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3620:x1876178898170368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 67us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263904.704479:0:22927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789263904.704490:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882435180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898170368:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789263904.704500:0:22947:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883b6df80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22947:1876178898159872:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789263904.704505:0:22899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898170496 00000100:00100000:1.0:1789263904.704509:0:22899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898170496 00000040:01000000:0.0:1789263904.704534:0:22947:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1789263904.704539:0:22899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789263904.704545:0:22899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9ab805050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+21:24405:x1876178898170496:12345-0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789263904.704558:0:22947:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaaf480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22947:1876178898170624:0@lo:1000:lod0000_rec0001.0 20000000:01000000:1.0:1789263904.704562:0:22899:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789263904.704574:0:22899:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1789263904.704583:0:22947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263904.704595:0:22947:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd986339240 going to sleep for 11 seconds 00000100:00100000:0.0:1789263904.704604:0:22908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898170624 00000100:00100000:0.0:1789263904.704608:0:22908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898170624 00000100:00100000:0.0:1789263904.704638:0:22908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789263904.704645:0:22908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22947:x1876178898170624:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1789263904.704746:0:22908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22947:x1876178898170624:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 102us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263904.704753:0:22908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789263904.704763:0:22947:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaaf480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22947:1876178898170624:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789263904.704826:0:22947:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882437100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22947:1876178898170752:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789263904.704849:0:22947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263904.704863:0:22947:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd88429f000 going to sleep for 11 seconds 00000100:00100000:2.0:1789263904.704882:0:22909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898170752 00000100:00100000:2.0:1789263904.704886:0:22909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898170752 00000100:00100000:2.0:1789263904.704908:0:22909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789263904.704912:0:22909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882434380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22947:x1876178898170752:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1789263904.704955:0:22909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882434380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22947:x1876178898170752:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 42us (104us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263904.704960:0:22909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789263904.704970:0:22947:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882437100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22947:1876178898170752:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1789263904.705004:0:22947:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1789263904.706399:0:22899:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789263904.706412:0:22899:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1789263904.706419:0:22919:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789263904.706423:0:22919:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789263904.706438:0:22919:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dd987f50800/0xce1582440fb1f892 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263904.706452:0:22919:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd8841a2400/0xce1582440fb1f7dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1f7d5 expref: 21 pid: 22899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263904.706459:0:22919:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd8841a2200/0xce1582440fb1f7ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1f7e3 expref: 21 pid: 22898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263904.706467:0:22919:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dd987f50800/0xce1582440fb1f892 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263904.706494:0:22919:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd8841a2200/0xce1582440fb1f7ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce1582440fb1f7e3 expref: 21 pid: 22898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263904.706514:0:22919:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dd8841a2200/0xce1582440fb1f7ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce1582440fb1f7e3 expref: 21 pid: 22898 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263904.706527:0:22919:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaaf480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22919:1876178898170880:0@lo:104: 00000100:00100000:0.0:1789263904.706552:0:22919:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789263904.706586:0:22919:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd8841a2400/0xce1582440fb1f7dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce1582440fb1f7d5 expref: 21 pid: 22899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263904.706593:0:22919:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dd8841a2400/0xce1582440fb1f7dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce1582440fb1f7d5 expref: 21 pid: 22899 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263904.706599:0:22919:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaadf80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22919:1876178898171008:0@lo:104: 00000100:00100000:2.0:1789263904.706601:0:22888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898170880 00000100:00100000:2.0:1789263904.706608:0:22888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898170880 00000040:00080000:1.0:1789263904.706608:0:22947:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000100:00100000:0.0:1789263904.706630:0:22919:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1789263904.706658:0:22947:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 9, retries 0 00000100:00100000:2.0:1789263904.706659:0:22888:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789263904.706664:0:22919:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9b7a9e6c0 going to sleep for 11 seconds 00000004:00080000:1.0:1789263904.706665:0:22947:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000100:00100000:3.0:1789263904.706668:0:22887:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (1/3 left), rc = 0 00000100:00100000:2.0:1789263904.706676:0:22888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898171008 00000100:00100000:2.0:1789263904.706681:0:22888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898171008 00000100:00100000:3.0:1789263904.706682:0:22887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789263904.706697:0:22887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaaed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+4:22919:x1876178898170880:12345-0@lo:104: 00010000:00010000:3.0:1789263904.706709:0:22887:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff9dd987f50400/0xce1582440fb1f7e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1f7ea expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263904.706709:0:22888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789263904.706721:0:22888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd987ef4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec0ec848-5fac-4f6a-ba8a-daed864d309d+4:22919:x1876178898171008:12345-0@lo:104: 00010000:00010000:2.0:1789263904.706732:0:22888:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff9dd987f50600/0xce1582440fb1f7d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1f7dc expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263904.706796:0:22919:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaaf480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22919:1876178898170880:0@lo:104: 00010000:00010000:3.0:1789263904.706797:0:22887:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:2.0:1789263904.706803:0:22888:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789263904.706809:0:22887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaaed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+4:22919:x1876178898170880:12345-0@lo:104: Request processed in 115us (252us total) trans 0 rc 0/0 00010000:00010000:1.0:1789263904.706809:0:22892:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:2.0:1789263904.706810:0:22888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd987ef4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec0ec848-5fac-4f6a-ba8a-daed864d309d+4:22919:x1876178898171008:12345-0@lo:104: Request processed in 91us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263904.706814:0:22919:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaadf80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22919:1876178898171008:0@lo:104: 00010000:00010000:1.0:1789263904.706817:0:22892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd987f50400/0xce1582440fb1f7e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1f7ea expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263904.706829:0:22888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1789263904.706830:0:22892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd987f50400 already unused, calling callback (ffffffffc12b1c20) 10000000:00010000:1.0:1789263904.706834:0:22892:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd987f50400/0xce1582440fb1f7e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xce1582440fb1f7ea expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263904.706838:0:22887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1789263904.706839:0:22919:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dd987f50800/0xce1582440fb1f892 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263904.706844:0:22892:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd987f50400/0xce1582440fb1f7e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xce1582440fb1f7ea expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789263904.706861:0:22892:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd987f50400/0xce1582440fb1f7e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xce1582440fb1f7ea expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263904.706861:0:22893:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:1.0:1789263904.706868:0:22892:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:2.0:1789263904.706881:0:22899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9ab805050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+21:24405:x1876178898170496:12345-0@lo:253:mount.lustre.0 Request processed in 2335us (2500us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263904.706887:0:22899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00010000:1.0:1789263904.706899:0:22892:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff9dd987f50400/0xce1582440fb1f7e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1f7ea expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263904.706908:0:22892:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789263904.706923:0:24405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:24405:1876178898170496:0@lo:253:mount.lustre.0 00010000:00010000:1.0:1789263904.706929:0:22892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd987f50400/0xce1582440fb1f7e3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1f7ea expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263904.706943:0:22892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd987f50400/0xce1582440fb1f7e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1f7ea expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789263904.706946:0:24405:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789263904.706951:0:24405:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789263904.706954:0:24405:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789263904.706956:0:24405:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789263904.706957:0:24405:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789263904.706959:0:24405:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00010000:00010000:1.0:1789263904.706960:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789263904.706961:0:24405:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789263904.706964:0:24405:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00010000:00010000:1.0:1789263904.706964:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789263904.706969:0:24405:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00010000:00010000:1.0:1789263904.706970:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789263904.706971:0:24405:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1789263904.706986:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882437100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec0ec848-5fac-4f6a-ba8a-daed864d309d:3618:1876178898171136:0@lo:103:ldlm_bl.0 00000020:02000000:2.0:1789263904.706987:0:24405:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1789263904.706989:0:24436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263904.706998:0:22893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd987f50600/0xce1582440fb1f7d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1f7dc expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263904.707008:0:22893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd987f50600 already unused, calling callback (ffffffffc12b1c20) 10000000:00010000:0.0:1789263904.707011:0:22893:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd987f50600/0xce1582440fb1f7d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xce1582440fb1f7dc expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263904.707021:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789263904.707033:0:22893:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd987f50600/0xce1582440fb1f7d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xce1582440fb1f7dc expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789263904.707040:0:22893:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd987f50600/0xce1582440fb1f7d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xce1582440fb1f7dc expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789263904.707045:0:22893:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:1.0:1789263904.707056:0:22889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898171136 00000100:00100000:1.0:1789263904.707060:0:22889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898171136 00010000:00010000:0.0:1789263904.707069:0:22893:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff9dd987f50600/0xce1582440fb1f7d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1f7dc expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263904.707098:0:22889:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd8841a2200/0xce1582440fb1f7ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1f7e3 expref: 21 pid: 22898 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263904.707108:0:22893:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789263904.707131:0:22893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd987f50600/0xce1582440fb1f7d5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1f7dc expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263904.707134:0:22889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1789263904.707143:0:22893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd987f50600/0xce1582440fb1f7d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1f7dc expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263904.707146:0:22889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882434700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+21:3618:x1876178898171136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789263904.707162:0:22889:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789263904.707165:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263904.707168:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263904.707170:0:22889:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd8841a2200/0xce1582440fb1f7ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1f7e3 expref: 21 pid: 22898 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263904.707171:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263904.707178:0:24436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263904.707182:0:24436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263904.707192:0:22889:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd8841a2200/0xce1582440fb1f7ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce1582440fb1f7e3 expref: 21 pid: 22898 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263904.707208:0:22889:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd8841a2200/0xce1582440fb1f7ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce1582440fb1f7e3 expref: 21 pid: 22898 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263904.707219:0:22889:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789263904.707251:0:22889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882434700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+20:3618:x1876178898171136:12345-0@lo:103:ldlm_bl.0 Request processed in 108us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263904.707259:0:22889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789263904.707282:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ec0ec848-5fac-4f6a-ba8a-daed864d309d:3619:1876178898171264:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789263904.707304:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263904.707335:0:22891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898171264 00000100:00100000:1.0:1789263904.707338:0:22891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898171264 00010000:00010000:1.0:1789263904.707352:0:22891:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd8841a2400/0xce1582440fb1f7dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1f7d5 expref: 20 pid: 22899 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263904.707371:0:22891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789263904.707377:0:22891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98fe85850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+20:3619:x1876178898171264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789263904.707383:0:22891:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789263904.707387:0:22891:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd8841a2400/0xce1582440fb1f7dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1f7d5 expref: 20 pid: 22899 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263904.707394:0:22891:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd8841a2400/0xce1582440fb1f7dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce1582440fb1f7d5 expref: 20 pid: 22899 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263904.707402:0:22891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd8841a2400/0xce1582440fb1f7dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce1582440fb1f7d5 expref: 20 pid: 22899 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263904.707418:0:22891:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dd987f50800/0xce1582440fb1f892 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263904.707424:0:22891:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd987f50800/0xce1582440fb1f892 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789263904.707433:0:22891:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004489663s 00010000:00010000:1.0:1789263904.707436:0:22891:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd987f50800/0xce1582440fb1f892 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263904.707441:0:22891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd987f50800/0xce1582440fb1f892 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263904.707447:0:22891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dd987f50800/0xce1582440fb1f892 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263904.707454:0:22891:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dd987f50800/0xce1582440fb1f892 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263904.707460:0:22891:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd987f50800 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263904.707464:0:22891:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dd987f50800/0xce1582440fb1f892 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263904.707472:0:22891:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dd987f50800/0xce1582440fb1f892 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263904.707489:0:22891:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dd987f50800/0xce1582440fb1f892 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263904.707496:0:22891:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789263904.707511:0:22919:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dd987f50800/0xce1582440fb1f892 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263904.707522:0:22919:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dd987f50800/0xce1582440fb1f892 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263904.707529:0:22891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98fe85850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+19:3619:x1876178898171264:12345-0@lo:103:ldlm_bl.0 Request processed in 151us (223us total) trans 0 rc 0/0 00010000:00010000:2.0:1789263904.707534:0:22919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd987f50800/0xce1582440fb1f892 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263904.707539:0:22891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789263904.707599:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ec0ec848-5fac-4f6a-ba8a-daed864d309d:3619:1876178898171264:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789263904.707625:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882437100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec0ec848-5fac-4f6a-ba8a-daed864d309d:3618:1876178898171136:0@lo:103:ldlm_bl.0 00000001:00000004:0.0:1789263904.708094:0:24405:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:3.0:1789263904.713333:0:24405:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1789263904.713341:0:24405:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1789263904.713400:0:24405:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789263904.713459:0:24405:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.120@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789263904.713491:0:24405:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1789263904.713521:0:24405:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1789263904.714434:0:24405:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789263904.714622:0:24405:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1789263904.813209:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883b6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898171392:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789263904.813281:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263904.813316:0:22908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898171392 00000100:00100000:0.0:1789263904.813323:0:22908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898171392 00000100:00100000:0.0:1789263904.813361:0:22908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789263904.813367:0:22908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882437100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898171392:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789263904.813398:0:22908:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446297600 avail 1300058112 00000100:00100000:0.0:1789263904.813492:0:22908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882437100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898171392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 124us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263904.813518:0:22908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789263904.813531:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883b6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898171392:0@lo:41:osp-pre-0-1.0 00000020:00000004:1.0:1789263905.015106:0:24486:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789263905.015302:0:24486:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789263905.133220:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789263905.517169:0:22901:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789263905.517177:0:22901:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9dd883f8c000 from 13 10000000:01000000:1.0:1789263905.517190:0:22901:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789263905.517238:0:22901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd8841a2c00/0xce1582440fb1f899 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.517250:0:22901:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd8841a2c00/0xce1582440fb1f899 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.517262:0:22901:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd8841a2c00/0xce1582440fb1f899 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263905.517288:0:22901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882437800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22901:1876178898171520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789263905.517356:0:22901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263905.517397:0:22901:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9c09d3840 going to sleep for 11 seconds 00000100:00100000:0.0:1789263905.517401:0:22896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898171520 00000100:00100000:0.0:1789263905.517410:0:22896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898171520 00000100:00100000:0.0:1789263905.517468:0:22896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789263905.517477:0:22896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+19:22901:x1876178898171520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789263905.517490:0:22896:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263905.517503:0:22896:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd987f50600/0xce1582440fb1f8a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1f899 expref: -99 pid: 22896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.517525:0:22896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd987f50600/0xce1582440fb1f8a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1f899 expref: 20 pid: 22896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.517533:0:22896:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd987f50600/0xce1582440fb1f8a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1f899 expref: 20 pid: 22896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.517540:0:22896:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd987f50600, rc 0) 00000100:00100000:0.0:1789263905.517582:0:22896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+20:22901:x1876178898171520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263905.517589:0:22896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789263905.517624:0:22901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882437800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22901:1876178898171520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789263905.517652:0:22901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd8841a2c00/0xce1582440fb1f899 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f8a0 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.517662:0:22901:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd8841a2c00/0xce1582440fb1f899 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1f8a0 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263905.517712:0:22901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882437800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22901:1876178898171648:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789263905.517755:0:22901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263905.517782:0:22901:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9c09d3840 going to sleep for 11 seconds 00000100:00100000:2.0:1789263905.517805:0:22899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898171648 00000100:00100000:2.0:1789263905.517810:0:22899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898171648 00000100:00100000:2.0:1789263905.517840:0:22899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789263905.517846:0:22899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+20:22901:x1876178898171648:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789263905.517857:0:22899:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789263905.517870:0:22899:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789263905.517872:0:22899:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:2.0:1789263905.517958:0:22899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+20:22901:x1876178898171648:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 111us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263905.517966:0:22899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789263905.517973:0:22901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882437800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22901:1876178898171648:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789263905.518027:0:22901:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789263905.518033:0:22901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd8841a2c00/0xce1582440fb1f899 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f8a0 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.518040:0:22901:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd8841a2c00/0xce1582440fb1f899 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f8a0 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789263905.518048:0:22901:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789263905.518049:0:22901:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9dd9ac8fd000 from 13 10000000:01000000:1.0:1789263905.518052:0:22901:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789263905.518065:0:22901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd8841a2e00/0xce1582440fb1f8a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.518071:0:22901:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd8841a2e00/0xce1582440fb1f8a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.518105:0:22901:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd8841a2e00/0xce1582440fb1f8a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263905.518128:0:22901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882437800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22901:1876178898171776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789263905.518154:0:22901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263905.518175:0:22901:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd985e14000 going to sleep for 11 seconds 00000100:00100000:0.0:1789263905.518362:0:22896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898171776 00000100:00100000:0.0:1789263905.518367:0:22896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898171776 00000100:00100000:0.0:1789263905.518394:0:22896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789263905.518400:0:22896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+20:22901:x1876178898171776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789263905.518408:0:22896:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263905.518416:0:22896:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd987f50400/0xce1582440fb1f8ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1f8a7 expref: -99 pid: 22896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.518431:0:22896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd987f50400/0xce1582440fb1f8ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1f8a7 expref: 21 pid: 22896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.518447:0:22896:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd987f50400/0xce1582440fb1f8ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1f8a7 expref: 21 pid: 22896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.518454:0:22896:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd987f50400, rc 0) 00000100:00100000:0.0:1789263905.518488:0:22896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+21:22901:x1876178898171776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263905.518494:0:22896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789263905.518525:0:22901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882437800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22901:1876178898171776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789263905.518536:0:22901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd8841a2e00/0xce1582440fb1f8a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f8ae expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.518544:0:22901:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd8841a2e00/0xce1582440fb1f8a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1f8ae expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263905.518581:0:22901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882437800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22901:1876178898171904:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789263905.518608:0:22901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263905.518628:0:22901:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd985e14000 going to sleep for 11 seconds 00000100:00100000:2.0:1789263905.518661:0:22899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898171904 00000100:00100000:2.0:1789263905.518666:0:22899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898171904 00000100:00100000:2.0:1789263905.518698:0:22899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789263905.518705:0:22899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+21:22901:x1876178898171904:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789263905.518715:0:22899:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789263905.518726:0:22899:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789263905.518734:0:22899:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:2.0:1789263905.518823:0:22899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+21:22901:x1876178898171904:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 119us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263905.518829:0:22899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789263905.518836:0:22901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882437800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22901:1876178898171904:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789263905.518879:0:22901:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789263905.518884:0:22901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd8841a2e00/0xce1582440fb1f8a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f8ae expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.518892:0:22901:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd8841a2e00/0xce1582440fb1f8a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f8ae expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263905.709171:0:3617:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789263894/real 1789263894] req@ffff9dd9bfaaf800 x1876178898157440/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789263904 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263905.709193:0:3617:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9dd9bfaaf800 x1876178898157440/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789263904 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263905.709200:0:3617:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789263894/real 1789263894] req@ffff9dd9bfaad180 x1876178898157312/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789263904 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263905.709215:0:3617:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9dd9bfaad180 x1876178898157312/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789263904 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789263905.709233:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd9c088f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789263905.709253:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789263905.709257:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1876178898157440:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1789263905.709263:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd9838d5000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789263905.709268:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789263905.709271:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1876178898157312:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1789263905.709399:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789263905.709403:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789263905.709405:0:38:0:(import.c:65:import_set_state_nolock()) ffff9dd9838d5000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789263905.709409:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 337 00000100:00080000:3.0:1789263905.709413:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789263905.709418:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9dd9838d5000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:0.0:1789263905.709429:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883b6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898172032:0@lo:400:kworker.0 00000100:00100000:3.0:1789263905.709452:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd883b6fb80 x1876178898172160/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789263905.709469:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789263905.709472:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789263905.709474:0:38:0:(import.c:65:import_set_state_nolock()) ffff9dd9c088f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789263905.709478:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 337 00000100:00080000:3.0:1789263905.709481:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789263905.709485:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9dd9c088f000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:0.0:1789263905.709505:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263905.709507:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd883b6c700 x1876178898172288/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789263905.709535:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789263905.709539:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789263905.709542:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789263905.709545:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789263905.709555:0:22909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898172032 00000100:00100000:0.0:1789263905.709563:0:22909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898172032 00000100:00100000:3.0:1789263905.709598:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883b6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3621:1876178898172800:0@lo:400:kworker.0 00000100:00100000:0.0:1789263905.709610:0:22909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789263905.709619:0:22909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3621:x1876178898172032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263905.709635:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263905.709663:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789263905.709668:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883b6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3621:1876178898172672:0@lo:400:kworker.0 00000100:00100000:0.0:1789263905.709677:0:22909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3621:x1876178898172032:12345-0@lo:400:kworker.0 Request processed in 59us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263905.709686:0:22909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789263905.709690:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263905.709715:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883b6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1876178898172160:0@lo:8:kworker.0 00000100:00100000:3.0:1789263905.709717:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883b6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898172032:0@lo:400:kworker.0 00000100:00100000:3.0:1789263905.709748:0:22905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898172800 00000100:00100000:3.0:1789263905.709752:0:22905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898172800 00000100:00100000:0.0:1789263905.709756:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263905.709800:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883b6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1876178898172288:0@lo:8:kworker.0 00000100:00100000:1.0:1789263905.709820:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883b6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876178898172416:0@lo:400:kworker.0 00000100:00100000:0.0:1789263905.709833:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263905.709858:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263905.709885:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883b6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1876178898172544:0@lo:400:kworker.0 00000100:00100000:1.0:1789263905.709903:0:24411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898172160 00000100:00100000:1.0:1789263905.709908:0:24411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898172160 00000100:00100000:0.0:1789263905.709910:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263905.709931:0:22904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898172672 00000100:00100000:0.0:1789263905.709935:0:22904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898172672 00000100:00100000:1.0:1789263905.709945:0:24411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898172288 00000100:00100000:1.0:1789263905.709950:0:24411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898172288 00000100:00100000:1.0:1789263905.709970:0:24411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789263905.709974:0:24411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3617:x1876178898172160:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1789263905.709999:0:24411:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 347 last 0 00000020:00000080:1.0:1789263905.710022:0:24411:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xce1582440fb1f8b5 00002000:00100000:1.0:1789263905.710034:0:24411:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9dd9abd30800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1789263905.710038:0:24411:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1789263905.710040:0:24411:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789263905.710218:0:24411:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789263905.710237:0:24411:0:(import.c:65:import_set_state_nolock()) ffff9dd9abd32800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789263905.710276:0:24411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3617:x1876178898172160:12345-0@lo:8:kworker.0 Request processed in 300us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263905.710283:0:24411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789263905.710296:0:24411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789263905.710299:0:24411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3617:x1876178898172288:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1789263905.710310:0:24411:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789263905.710683:0:22905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898172416 00000100:00100000:3.0:1789263905.710688:0:22905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898172416 00000100:00100000:0.0:1789263905.710698:0:22904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898172544 00000100:00100000:0.0:1789263905.710704:0:22904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898172544 00000100:00080000:2.0:1789263905.710709:0:22900:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789263905.710715:0:22900:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789263905.710717:0:22905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789263905.710729:0:22905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1876178898172800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263905.710736:0:22904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789263905.710746:0:22904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1876178898172672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263905.710787:0:22905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1876178898172800:12345-0@lo:400:kworker.0 Request processed in 61us (1152us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263905.710794:0:22904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1876178898172672:12345-0@lo:400:kworker.0 Request processed in 51us (1103us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263905.710798:0:22905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789263905.710805:0:22904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789263905.710821:0:22905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789263905.710828:0:22904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789263905.710833:0:22905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882437800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876178898172416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263905.710841:0:22904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1876178898172544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263905.710879:0:22905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882437800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876178898172416:12345-0@lo:400:kworker.0 Request processed in 50us (1021us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263905.710887:0:22905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789263905.710893:0:22904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1876178898172544:12345-0@lo:400:kworker.0 Request processed in 54us (980us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263905.710908:0:22904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1789263905.710938:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd883b6df80 x1876178898172672/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263905.710951:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883b6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3621:1876178898172672:0@lo:400:kworker.0 00010000:00080000:0.0:1789263905.710954:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd883b6f800 x1876178898172544/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263905.710964:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883b6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1876178898172544:0@lo:400:kworker.0 00010000:00080000:3.0:1789263905.710973:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd883b6d880 x1876178898172800/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263905.710983:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883b6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3621:1876178898172800:0@lo:400:kworker.0 00010000:00080000:0.0:1789263905.711006:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd883b6fb80 x1876178898172160/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789263920 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263905.711012:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789263905.711017:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1789263905.711023:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789263905.711026:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1789263905.711028:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd9838d5000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789263905.711039:0:3617:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789263905.711042:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883b6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1876178898172160:0@lo:8:kworker.0 00010000:00080000:3.0:1789263905.711053:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd883b6c000 x1876178898172416/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263905.711071:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883b6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876178898172416:0@lo:400:kworker.0 00000004:00080000:0.0:1789263905.711105:0:22929:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x22:0x0] 00000100:00100000:3.0:1789263905.711121:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898172928:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789263905.711127:0:22929:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaac380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22929:1876178898173056:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1789263905.711161:0:22929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263905.711172:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263905.711178:0:22929:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9bb50c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789263905.711194:0:24409:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1789263905.711199:0:24409:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1789263905.711210:0:24413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898172928 00000100:00100000:2.0:1789263905.711216:0:24413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898172928 00000004:00080000:3.0:1789263905.711226:0:22928:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1789263905.711252:0:24413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789263905.711263:0:24413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3618:x1876178898172928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789263905.711283:0:24413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923501056 avail 3691978752 00000004:00080000:3.0:1789263905.711299:0:22928:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 348001220864ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789263905.711308:0:22928:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1789263905.711328:0:24409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898173056 00000100:00100000:2.0:1789263905.711331:0:24413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3618:x1876178898172928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263905.711334:0:24409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898173056 00000100:00100000:2.0:1789263905.711341:0:24413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1789263905.711361:0:22900:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789263905.711440:0:24595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789263905.711449:0:24595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22929:x1876178898173056:12345-0@lo:5:osp-pre-0-0.0 00010000:00080000:3.0:1789263905.711505:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd9bfaae300 x1876178898172928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789263921 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263905.711520:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898172928:0@lo:13:osp-pre-0-0.0 00000004:00080000:3.0:1789263905.712480:0:22884:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:0.0:1789263905.713254:0:24595:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1789263905.713261:0:24595:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:0.0:1789263905.713271:0:24595:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:35 to 0x280000401:65) 00000100:00100000:1.0:1789263905.717417:0:24411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3617:x1876178898172288:12345-0@lo:8:kworker.0 Request processed in 7110us (7579us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789263905.717429:0:24411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1789263905.717474:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd9c088f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789263905.717479:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789263905.717482:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883b6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1876178898172288:0@lo:8:kworker.0 00002000:00010000:0.0:1789263905.721823:0:24595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789263905.721834:0:24595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e4ff603/0xce1582440fb1f8bc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.721852:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=348s v=(0 0) 00010000:00010000:0.0:1789263905.721857:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789263905.721864:0:24595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e4ff603/0xce1582440fb1f8bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.721882:0:24595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e4ff603/0xce1582440fb1f8bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.721893:0:24595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e4ff603/0xce1582440fb1f8bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.721902:0:24595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e4ff603/0xce1582440fb1f8bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.721925:0:24595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789263905.721948:0:22893:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263905.721954:0:22893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e4ff603/0xce1582440fb1f8bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.721971:0:22893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd987f50800 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263905.721975:0:22893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e4ff603/0xce1582440fb1f8bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.721982:0:22893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e4ff603/0xce1582440fb1f8bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.721997:0:22893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e4ff603/0xce1582440fb1f8bc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.722001:0:22893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e4ff603/0xce1582440fb1f8bc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.722019:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263905.722021:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263905.722024:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789263905.722209:0:24595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789263905.722227:0:24595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef135b26/0xce1582440fb1f8c3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263905.722237:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=348s v=(0 0) 00010000:00010000:2.0:1789263905.722241:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789263905.722246:0:24595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef135b26/0xce1582440fb1f8c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263905.722272:0:24595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef135b26/0xce1582440fb1f8c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263905.722281:0:24595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef135b26/0xce1582440fb1f8c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263905.722288:0:24595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef135b26/0xce1582440fb1f8c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263905.722305:0:24595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789263905.722315:0:24436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789263905.722322:0:24436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef135b26/0xce1582440fb1f8c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.722331:0:24436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bfa23200 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:0.0:1789263905.722336:0:24436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef135b26/0xce1582440fb1f8c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.722357:0:24436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef135b26/0xce1582440fb1f8c3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.722371:0:24436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef135b26/0xce1582440fb1f8c3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.722378:0:24436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef135b26/0xce1582440fb1f8c3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.722394:0:24436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263905.722396:0:24436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263905.722398:0:24436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789263905.722583:0:24595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789263905.722590:0:24595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002bd8a9f/0xce1582440fb1f8ca lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263905.722599:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=348s v=(0 0) 00010000:00010000:2.0:1789263905.722602:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789263905.722607:0:24595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002bd8a9f/0xce1582440fb1f8ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263905.722617:0:24595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000002bd8a9f/0xce1582440fb1f8ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263905.722625:0:24595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002bd8a9f/0xce1582440fb1f8ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263905.722644:0:24595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000002bd8a9f/0xce1582440fb1f8ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263905.722661:0:24595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789263905.722681:0:22892:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263905.722688:0:22892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000002bd8a9f/0xce1582440fb1f8ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.722697:0:22892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9bfa22400 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263905.722700:0:22892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000002bd8a9f/0xce1582440fb1f8ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.722708:0:22892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000002bd8a9f/0xce1582440fb1f8ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.722726:0:22892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000002bd8a9f/0xce1582440fb1f8ca lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.722733:0:22892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002bd8a9f/0xce1582440fb1f8ca lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.722746:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263905.722748:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263905.722750:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789263905.722900:0:24595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789263905.722907:0:24595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012367ff8/0xce1582440fb1f8d1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.722917:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=348s v=(0 0) 00010000:00010000:0.0:1789263905.722920:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789263905.722924:0:24595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012367ff8/0xce1582440fb1f8d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.722934:0:24595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012367ff8/0xce1582440fb1f8d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.722942:0:24595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012367ff8/0xce1582440fb1f8d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.722956:0:24595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012367ff8/0xce1582440fb1f8d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.722973:0:24595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789263905.722993:0:22893:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263905.722999:0:22893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012367ff8/0xce1582440fb1f8d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.723007:0:22893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd987f51000 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263905.723011:0:22893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012367ff8/0xce1582440fb1f8d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.723020:0:22893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012367ff8/0xce1582440fb1f8d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.723032:0:22893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012367ff8/0xce1582440fb1f8d1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.723040:0:22893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012367ff8/0xce1582440fb1f8d1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.723065:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263905.723066:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263905.723068:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789263905.723191:0:24595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789263905.723197:0:24595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e55a6a6f/0xce1582440fb1f8d8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.723207:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=348s v=(0 0) 00010000:00010000:0.0:1789263905.723210:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789263905.723214:0:24595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e55a6a6f/0xce1582440fb1f8d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.723223:0:24595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e55a6a6f/0xce1582440fb1f8d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.723232:0:24595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e55a6a6f/0xce1582440fb1f8d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.723239:0:24595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e55a6a6f/0xce1582440fb1f8d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.723259:0:24595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789263905.723280:0:24436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263905.723285:0:24436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e55a6a6f/0xce1582440fb1f8d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.723293:0:24436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd987f51800 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263905.723296:0:24436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e55a6a6f/0xce1582440fb1f8d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.723305:0:24436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e55a6a6f/0xce1582440fb1f8d8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.723317:0:24436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e55a6a6f/0xce1582440fb1f8d8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.723324:0:24436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e55a6a6f/0xce1582440fb1f8d8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.723337:0:24436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263905.723338:0:24436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263905.723340:0:24436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789263905.723461:0:24595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789263905.723467:0:24595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000928f8396/0xce1582440fb1f8df lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.723482:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=348s v=(0 0) 00010000:00010000:0.0:1789263905.723485:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789263905.723490:0:24595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000928f8396/0xce1582440fb1f8df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.723500:0:24595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000928f8396/0xce1582440fb1f8df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.723508:0:24595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000928f8396/0xce1582440fb1f8df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.723517:0:24595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000928f8396/0xce1582440fb1f8df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.723533:0:24595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789263905.723561:0:22892:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263905.723567:0:22892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000928f8396/0xce1582440fb1f8df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.723587:0:22892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd987f51a00 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263905.723591:0:22892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000928f8396/0xce1582440fb1f8df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.723598:0:22892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000928f8396/0xce1582440fb1f8df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.723612:0:22892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000928f8396/0xce1582440fb1f8df lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.723619:0:22892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000928f8396/0xce1582440fb1f8df lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.723633:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263905.723635:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263905.723638:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789263905.723748:0:24595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789263905.723754:0:24595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005569000e/0xce1582440fb1f8e6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.723774:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=348s v=(0 0) 00010000:00010000:0.0:1789263905.723778:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789263905.723782:0:24595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005569000e/0xce1582440fb1f8e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.723792:0:24595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005569000e/0xce1582440fb1f8e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.723812:0:24595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005569000e/0xce1582440fb1f8e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.723820:0:24595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005569000e/0xce1582440fb1f8e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.723836:0:24595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789263905.723859:0:22893:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263905.723864:0:22893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005569000e/0xce1582440fb1f8e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.723872:0:22893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9c10f1a00 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263905.723876:0:22893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005569000e/0xce1582440fb1f8e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.723885:0:22893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005569000e/0xce1582440fb1f8e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.723903:0:22893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005569000e/0xce1582440fb1f8e6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.723911:0:22893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005569000e/0xce1582440fb1f8e6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.723925:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263905.723928:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263905.723930:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789263905.724050:0:24595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789263905.724057:0:24595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f81e3ef5/0xce1582440fb1f8ed lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.724065:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=348s v=(0 0) 00010000:00010000:0.0:1789263905.724068:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789263905.724073:0:24595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f81e3ef5/0xce1582440fb1f8ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.724102:0:24595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f81e3ef5/0xce1582440fb1f8ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.724111:0:24595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f81e3ef5/0xce1582440fb1f8ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.724118:0:24595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f81e3ef5/0xce1582440fb1f8ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.724148:0:24595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789263905.724156:0:24436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263905.724162:0:24436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f81e3ef5/0xce1582440fb1f8ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.724172:0:24436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9c10f1400 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263905.724175:0:24436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f81e3ef5/0xce1582440fb1f8ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.724183:0:24436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f81e3ef5/0xce1582440fb1f8ed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.724197:0:24436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f81e3ef5/0xce1582440fb1f8ed lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.724205:0:24436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f81e3ef5/0xce1582440fb1f8ed lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.724226:0:24436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263905.724227:0:24436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263905.724228:0:24436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789263905.724361:0:24595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789263905.724367:0:24595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd65149f/0xce1582440fb1f8f4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.724375:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=348s v=(0 0) 00010000:00010000:0.0:1789263905.724378:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789263905.724382:0:24595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd65149f/0xce1582440fb1f8f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.724390:0:24595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd65149f/0xce1582440fb1f8f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.724399:0:24595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd65149f/0xce1582440fb1f8f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.724406:0:24595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd65149f/0xce1582440fb1f8f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.724422:0:24595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789263905.724433:0:22892:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263905.724437:0:22892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd65149f/0xce1582440fb1f8f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.724442:0:22892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9c10f0000 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263905.724445:0:22892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd65149f/0xce1582440fb1f8f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.724450:0:22892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd65149f/0xce1582440fb1f8f4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.724458:0:22892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd65149f/0xce1582440fb1f8f4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.724463:0:22892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd65149f/0xce1582440fb1f8f4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.724471:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263905.724472:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263905.724473:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789263905.724625:0:24595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789263905.724631:0:24595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be36c664/0xce1582440fb1f8fb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.724639:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=348s v=(0 0) 00010000:00010000:0.0:1789263905.724649:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789263905.724654:0:24595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be36c664/0xce1582440fb1f8fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.724664:0:24595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be36c664/0xce1582440fb1f8fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.724672:0:24595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be36c664/0xce1582440fb1f8fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.724680:0:24595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000be36c664/0xce1582440fb1f8fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.724696:0:24595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789263905.724711:0:22893:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263905.724715:0:22893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000be36c664/0xce1582440fb1f8fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.724728:0:22893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9c10f0400 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263905.724731:0:22893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000be36c664/0xce1582440fb1f8fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.724738:0:22893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000be36c664/0xce1582440fb1f8fb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.724746:0:22893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000be36c664/0xce1582440fb1f8fb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.724751:0:22893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be36c664/0xce1582440fb1f8fb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.724770:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263905.724771:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263905.724772:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789263905.724909:0:24595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789263905.724916:0:24595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000998d8243/0xce1582440fb1f902 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.724924:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=348s v=(0 0) 00010000:00010000:0.0:1789263905.724927:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789263905.724931:0:24595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000998d8243/0xce1582440fb1f902 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.724942:0:24595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000998d8243/0xce1582440fb1f902 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.724950:0:24595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000998d8243/0xce1582440fb1f902 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.724964:0:24595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000998d8243/0xce1582440fb1f902 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.724980:0:24595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789263905.724996:0:24436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263905.725002:0:24436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000998d8243/0xce1582440fb1f902 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.725010:0:24436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9c10f1000 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263905.725014:0:24436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000998d8243/0xce1582440fb1f902 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.725023:0:24436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000998d8243/0xce1582440fb1f902 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.725050:0:24436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000998d8243/0xce1582440fb1f902 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.725057:0:24436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000998d8243/0xce1582440fb1f902 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.725071:0:24436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263905.725073:0:24436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263905.725098:0:24436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789263905.725189:0:24595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789263905.725196:0:24595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092ceb521/0xce1582440fb1f909 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.725204:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=348s v=(0 0) 00010000:00010000:0.0:1789263905.725208:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789263905.725212:0:24595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092ceb521/0xce1582440fb1f909 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.725221:0:24595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092ceb521/0xce1582440fb1f909 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.725229:0:24595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092ceb521/0xce1582440fb1f909 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.725237:0:24595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092ceb521/0xce1582440fb1f909 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.725253:0:24595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789263905.725274:0:22892:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263905.725280:0:22892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092ceb521/0xce1582440fb1f909 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.725287:0:22892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9c10f1e00 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263905.725291:0:22892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092ceb521/0xce1582440fb1f909 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.725301:0:22892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092ceb521/0xce1582440fb1f909 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.725313:0:22892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092ceb521/0xce1582440fb1f909 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.725320:0:22892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092ceb521/0xce1582440fb1f909 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.725345:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263905.725347:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263905.725349:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789263905.725467:0:24595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789263905.725473:0:24595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007982d3a5/0xce1582440fb1f910 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.725487:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=348s v=(0 0) 00010000:00010000:0.0:1789263905.725490:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789263905.725495:0:24595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007982d3a5/0xce1582440fb1f910 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.725505:0:24595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007982d3a5/0xce1582440fb1f910 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.725513:0:24595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007982d3a5/0xce1582440fb1f910 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.725520:0:24595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007982d3a5/0xce1582440fb1f910 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.725537:0:24595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789263905.725556:0:22893:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263905.725561:0:22893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007982d3a5/0xce1582440fb1f910 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.725569:0:22893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9c10f1200 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263905.725573:0:22893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007982d3a5/0xce1582440fb1f910 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.725581:0:22893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007982d3a5/0xce1582440fb1f910 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.725591:0:22893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007982d3a5/0xce1582440fb1f910 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.725596:0:22893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007982d3a5/0xce1582440fb1f910 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.725609:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263905.725611:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263905.725612:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789263905.725743:0:24595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789263905.725749:0:24595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e2ee0ea/0xce1582440fb1f917 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.725757:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=348s v=(0 0) 00010000:00010000:0.0:1789263905.725774:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789263905.725779:0:24595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e2ee0ea/0xce1582440fb1f917 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.725789:0:24595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e2ee0ea/0xce1582440fb1f917 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.725810:0:24595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e2ee0ea/0xce1582440fb1f917 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.725817:0:24595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e2ee0ea/0xce1582440fb1f917 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.725833:0:24595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789263905.725853:0:24436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263905.725859:0:24436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e2ee0ea/0xce1582440fb1f917 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.725877:0:24436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9c10f0600 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263905.725881:0:24436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e2ee0ea/0xce1582440fb1f917 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.725889:0:24436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e2ee0ea/0xce1582440fb1f917 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.725902:0:24436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e2ee0ea/0xce1582440fb1f917 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.725910:0:24436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e2ee0ea/0xce1582440fb1f917 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.725924:0:24436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263905.725926:0:24436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263905.725928:0:24436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789263905.726019:0:24595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789263905.726026:0:24595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022d7bf0f/0xce1582440fb1f91e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.726035:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=348s v=(0 0) 00010000:00010000:0.0:1789263905.726039:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789263905.726043:0:24595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022d7bf0f/0xce1582440fb1f91e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.726052:0:24595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022d7bf0f/0xce1582440fb1f91e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.726060:0:24595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022d7bf0f/0xce1582440fb1f91e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.726067:0:24595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022d7bf0f/0xce1582440fb1f91e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.726126:0:24595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789263905.726132:0:22892:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263905.726136:0:22892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022d7bf0f/0xce1582440fb1f91e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.726141:0:22892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9c10f1600 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263905.726144:0:22892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022d7bf0f/0xce1582440fb1f91e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.726150:0:22892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022d7bf0f/0xce1582440fb1f91e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.726164:0:22892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022d7bf0f/0xce1582440fb1f91e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.726170:0:22892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022d7bf0f/0xce1582440fb1f91e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.726188:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263905.726190:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263905.726193:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789263905.726322:0:24595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789263905.726328:0:24595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093528ded/0xce1582440fb1f925 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.726337:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=348s v=(0 0) 00010000:00010000:0.0:1789263905.726341:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789263905.726345:0:24595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093528ded/0xce1582440fb1f925 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.726355:0:24595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000093528ded/0xce1582440fb1f925 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.726363:0:24595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093528ded/0xce1582440fb1f925 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.726370:0:24595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000093528ded/0xce1582440fb1f925 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.726385:0:24595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789263905.726391:0:22893:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263905.726396:0:22893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000093528ded/0xce1582440fb1f925 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.726403:0:22893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9c10f0200 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263905.726407:0:22893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000093528ded/0xce1582440fb1f925 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.726415:0:22893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000093528ded/0xce1582440fb1f925 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.726424:0:22893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000093528ded/0xce1582440fb1f925 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.726429:0:22893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000093528ded/0xce1582440fb1f925 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.726452:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263905.726454:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263905.726455:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789263905.726605:0:24595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789263905.726612:0:24595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b744e16/0xce1582440fb1f92c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.726621:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=348s v=(0 0) 00010000:00010000:0.0:1789263905.726629:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789263905.726634:0:24595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b744e16/0xce1582440fb1f92c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.726645:0:24595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b744e16/0xce1582440fb1f92c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.726653:0:24595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b744e16/0xce1582440fb1f92c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.726661:0:24595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005b744e16/0xce1582440fb1f92c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.726676:0:24595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789263905.726700:0:24436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263905.726706:0:24436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005b744e16/0xce1582440fb1f92c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.726714:0:24436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9c10f1c00 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263905.726718:0:24436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005b744e16/0xce1582440fb1f92c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.726725:0:24436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005b744e16/0xce1582440fb1f92c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.726735:0:24436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005b744e16/0xce1582440fb1f92c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.726740:0:24436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b744e16/0xce1582440fb1f92c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.726751:0:24436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263905.726753:0:24436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263905.726754:0:24436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789263905.726885:0:24595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789263905.726891:0:24595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f314dabd/0xce1582440fb1f933 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.726899:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=348s v=(0 0) 00010000:00010000:0.0:1789263905.726902:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789263905.726906:0:24595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f314dabd/0xce1582440fb1f933 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.726915:0:24595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f314dabd/0xce1582440fb1f933 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.726923:0:24595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f314dabd/0xce1582440fb1f933 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.726939:0:24595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f314dabd/0xce1582440fb1f933 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.726955:0:24595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789263905.726972:0:22892:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263905.726977:0:22892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f314dabd/0xce1582440fb1f933 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.726996:0:22892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9c10f0a00 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263905.727000:0:22892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f314dabd/0xce1582440fb1f933 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.727008:0:22892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f314dabd/0xce1582440fb1f933 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.727020:0:22892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f314dabd/0xce1582440fb1f933 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.727027:0:22892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f314dabd/0xce1582440fb1f933 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.727040:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263905.727042:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263905.727044:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789263905.727160:0:24595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789263905.727167:0:24595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd6637e8/0xce1582440fb1f93a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.727175:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=348s v=(0 0) 00010000:00010000:0.0:1789263905.727179:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789263905.727183:0:24595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd6637e8/0xce1582440fb1f93a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.727192:0:24595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd6637e8/0xce1582440fb1f93a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.727201:0:24595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd6637e8/0xce1582440fb1f93a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.727209:0:24595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd6637e8/0xce1582440fb1f93a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.727222:0:24595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789263905.727230:0:22893:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263905.727236:0:22893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd6637e8/0xce1582440fb1f93a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.727244:0:22893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9c10f0c00 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263905.727247:0:22893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd6637e8/0xce1582440fb1f93a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.727255:0:22893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd6637e8/0xce1582440fb1f93a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.727273:0:22893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd6637e8/0xce1582440fb1f93a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.727281:0:22893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd6637e8/0xce1582440fb1f93a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.727294:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263905.727296:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263905.727298:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789263905.727419:0:24595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789263905.727424:0:24595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d65c7c8/0xce1582440fb1f941 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.727434:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=348s v=(0 0) 00010000:00010000:0.0:1789263905.727436:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789263905.727439:0:24595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d65c7c8/0xce1582440fb1f941 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.727445:0:24595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d65c7c8/0xce1582440fb1f941 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.727449:0:24595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d65c7c8/0xce1582440fb1f941 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.727454:0:24595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d65c7c8/0xce1582440fb1f941 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.727464:0:24595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789263905.727475:0:24436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263905.727481:0:24436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d65c7c8/0xce1582440fb1f941 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.727489:0:24436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9c10f0e00 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263905.727493:0:24436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d65c7c8/0xce1582440fb1f941 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.727501:0:24436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d65c7c8/0xce1582440fb1f941 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.727512:0:24436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d65c7c8/0xce1582440fb1f941 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.727520:0:24436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d65c7c8/0xce1582440fb1f941 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.727547:0:24436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263905.727549:0:24436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263905.727551:0:24436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789263905.727643:0:24595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789263905.727649:0:24595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed474837/0xce1582440fb1f948 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.727657:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=348s v=(0 0) 00010000:00010000:0.0:1789263905.727660:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789263905.727664:0:24595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed474837/0xce1582440fb1f948 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.727673:0:24595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed474837/0xce1582440fb1f948 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.727687:0:24595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed474837/0xce1582440fb1f948 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.727692:0:24595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed474837/0xce1582440fb1f948 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.727702:0:24595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789263905.727712:0:22892:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263905.727718:0:22892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed474837/0xce1582440fb1f948 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.727726:0:22892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9c10f0800 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263905.727730:0:22892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed474837/0xce1582440fb1f948 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.727739:0:22892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed474837/0xce1582440fb1f948 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.727750:0:22892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed474837/0xce1582440fb1f948 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.727758:0:22892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed474837/0xce1582440fb1f948 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.727785:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263905.727787:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263905.727789:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789263905.727875:0:24595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789263905.727880:0:24595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e471994c/0xce1582440fb1f94f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.727885:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=348s v=(0 0) 00010000:00010000:0.0:1789263905.727887:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789263905.727890:0:24595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e471994c/0xce1582440fb1f94f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.727896:0:24595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e471994c/0xce1582440fb1f94f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.727901:0:24595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e471994c/0xce1582440fb1f94f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.727906:0:24595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e471994c/0xce1582440fb1f94f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.727923:0:24595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789263905.727934:0:22893:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263905.727940:0:22893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e471994c/0xce1582440fb1f94f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.727958:0:22893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9c10f1800 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263905.727962:0:22893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e471994c/0xce1582440fb1f94f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.727970:0:22893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e471994c/0xce1582440fb1f94f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.727981:0:22893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e471994c/0xce1582440fb1f94f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.727989:0:22893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e471994c/0xce1582440fb1f94f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.728003:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263905.728005:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263905.728007:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789263905.728135:0:24595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789263905.728142:0:24595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1aaf017/0xce1582440fb1f956 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.728152:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=348s v=(0 0) 00010000:00010000:0.0:1789263905.728155:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789263905.728159:0:24595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1aaf017/0xce1582440fb1f956 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.728168:0:24595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a1aaf017/0xce1582440fb1f956 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.728177:0:24595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1aaf017/0xce1582440fb1f956 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.728184:0:24595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a1aaf017/0xce1582440fb1f956 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.728198:0:24595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789263905.728208:0:24436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263905.728214:0:24436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a1aaf017/0xce1582440fb1f956 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.728222:0:24436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9abf3a200 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263905.728226:0:24436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1aaf017/0xce1582440fb1f956 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.728234:0:24436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1aaf017/0xce1582440fb1f956 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.728253:0:24436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a1aaf017/0xce1582440fb1f956 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.728261:0:24436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a1aaf017/0xce1582440fb1f956 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.728274:0:24436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263905.728277:0:24436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263905.728279:0:24436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789263905.728407:0:24595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789263905.728413:0:24595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dac35b66/0xce1582440fb1f95d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.728421:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=348s v=(0 0) 00010000:00010000:0.0:1789263905.728429:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789263905.728434:0:24595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dac35b66/0xce1582440fb1f95d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.728444:0:24595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dac35b66/0xce1582440fb1f95d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.728452:0:24595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dac35b66/0xce1582440fb1f95d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.728459:0:24595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dac35b66/0xce1582440fb1f95d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.728472:0:24595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789263905.728478:0:22892:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263905.728481:0:22892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dac35b66/0xce1582440fb1f95d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.728486:0:22892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9abf3bc00 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263905.728489:0:22892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dac35b66/0xce1582440fb1f95d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.728495:0:22892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dac35b66/0xce1582440fb1f95d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.728503:0:22892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dac35b66/0xce1582440fb1f95d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.728508:0:22892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dac35b66/0xce1582440fb1f95d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.728526:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263905.728527:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263905.728529:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789263905.728671:0:24595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789263905.728677:0:24595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fac9018/0xce1582440fb1f964 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.728685:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=348s v=(0 0) 00010000:00010000:0.0:1789263905.728688:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789263905.728691:0:24595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fac9018/0xce1582440fb1f964 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.728700:0:24595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fac9018/0xce1582440fb1f964 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.728707:0:24595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fac9018/0xce1582440fb1f964 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.728719:0:24595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001fac9018/0xce1582440fb1f964 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.728732:0:24595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789263905.728738:0:22893:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263905.728741:0:22893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001fac9018/0xce1582440fb1f964 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.728746:0:22893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9abf3aa00 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263905.728749:0:22893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001fac9018/0xce1582440fb1f964 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.728754:0:22893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001fac9018/0xce1582440fb1f964 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.728774:0:22893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001fac9018/0xce1582440fb1f964 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.728780:0:22893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fac9018/0xce1582440fb1f964 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.728788:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263905.728790:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263905.728791:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789263905.728929:0:24595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789263905.728935:0:24595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000420ec6f3/0xce1582440fb1f96b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.728943:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=348s v=(0 0) 00010000:00010000:0.0:1789263905.728946:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789263905.728951:0:24595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000420ec6f3/0xce1582440fb1f96b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.728961:0:24595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000420ec6f3/0xce1582440fb1f96b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.728970:0:24595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000420ec6f3/0xce1582440fb1f96b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.728977:0:24595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000420ec6f3/0xce1582440fb1f96b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.728991:0:24595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789263905.729002:0:24436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263905.729007:0:24436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000420ec6f3/0xce1582440fb1f96b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.729027:0:24436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9abf3ac00 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263905.729031:0:24436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000420ec6f3/0xce1582440fb1f96b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.729038:0:24436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000420ec6f3/0xce1582440fb1f96b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.729046:0:24436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000420ec6f3/0xce1582440fb1f96b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.729051:0:24436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000420ec6f3/0xce1582440fb1f96b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.729068:0:24436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263905.729070:0:24436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263905.729073:0:24436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789263905.729181:0:24595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789263905.729185:0:24595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000ce2f28/0xce1582440fb1f972 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.729196:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=348s v=(0 0) 00010000:00010000:0.0:1789263905.729198:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789263905.729201:0:24595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000ce2f28/0xce1582440fb1f972 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.729207:0:24595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000000ce2f28/0xce1582440fb1f972 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.729213:0:24595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000ce2f28/0xce1582440fb1f972 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.729217:0:24595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000000ce2f28/0xce1582440fb1f972 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.729227:0:24595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789263905.729239:0:22892:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263905.729245:0:22892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000000ce2f28/0xce1582440fb1f972 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.729254:0:22892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9abf3ae00 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263905.729258:0:22892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000000ce2f28/0xce1582440fb1f972 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.729267:0:22892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000000ce2f28/0xce1582440fb1f972 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.729285:0:22892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000000ce2f28/0xce1582440fb1f972 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.729293:0:22892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000000ce2f28/0xce1582440fb1f972 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.729314:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263905.729315:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263905.729317:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789263905.729382:0:24595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789263905.729387:0:24595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aaf3714a/0xce1582440fb1f979 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.729392:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=348s v=(0 0) 00010000:00010000:0.0:1789263905.729394:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789263905.729397:0:24595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aaf3714a/0xce1582440fb1f979 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.729403:0:24595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aaf3714a/0xce1582440fb1f979 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.729418:0:24595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aaf3714a/0xce1582440fb1f979 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.729423:0:24595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aaf3714a/0xce1582440fb1f979 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.729435:0:24595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789263905.729446:0:22893:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263905.729451:0:22893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aaf3714a/0xce1582440fb1f979 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.729457:0:22893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9abf3a800 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263905.729460:0:22893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aaf3714a/0xce1582440fb1f979 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.729465:0:22893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aaf3714a/0xce1582440fb1f979 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.729473:0:22893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aaf3714a/0xce1582440fb1f979 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.729481:0:22893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aaf3714a/0xce1582440fb1f979 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.729509:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263905.729511:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263905.729513:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789263905.729629:0:24595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789263905.729635:0:24595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000639a2b8e/0xce1582440fb1f980 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.729643:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=348s v=(0 0) 00010000:00010000:0.0:1789263905.729646:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789263905.729651:0:24595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000639a2b8e/0xce1582440fb1f980 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.729661:0:24595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000639a2b8e/0xce1582440fb1f980 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.729669:0:24595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000639a2b8e/0xce1582440fb1f980 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.729677:0:24595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000639a2b8e/0xce1582440fb1f980 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.729702:0:24595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789263905.729710:0:24436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263905.729714:0:24436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000639a2b8e/0xce1582440fb1f980 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.729721:0:24436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9abf3b800 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263905.729723:0:24436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000639a2b8e/0xce1582440fb1f980 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.729729:0:24436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000639a2b8e/0xce1582440fb1f980 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.729738:0:24436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000639a2b8e/0xce1582440fb1f980 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.729743:0:24436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000639a2b8e/0xce1582440fb1f980 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.729753:0:24436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263905.729755:0:24436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263905.729756:0:24436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789263905.729915:0:24595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789263905.729919:0:24595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046dc2a7f/0xce1582440fb1f987 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.729925:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=348s v=(0 0) 00010000:00010000:0.0:1789263905.729927:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789263905.729930:0:24595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046dc2a7f/0xce1582440fb1f987 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.729936:0:24595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000046dc2a7f/0xce1582440fb1f987 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.729941:0:24595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046dc2a7f/0xce1582440fb1f987 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.729946:0:24595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000046dc2a7f/0xce1582440fb1f987 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.729955:0:24595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789263905.729966:0:22892:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263905.729970:0:22892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000046dc2a7f/0xce1582440fb1f987 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.729986:0:22892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9abf3ba00 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263905.729989:0:22892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000046dc2a7f/0xce1582440fb1f987 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.729994:0:22892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000046dc2a7f/0xce1582440fb1f987 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.730006:0:22892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000046dc2a7f/0xce1582440fb1f987 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.730014:0:22892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046dc2a7f/0xce1582440fb1f987 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.730032:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263905.730034:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263905.730036:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789263905.730196:0:24595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789263905.730201:0:24595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c054c049/0xce1582440fb1f98e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.730206:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=348s v=(0 0) 00010000:00010000:0.0:1789263905.730213:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789263905.730216:0:24595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c054c049/0xce1582440fb1f98e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.730223:0:24595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c054c049/0xce1582440fb1f98e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.730228:0:24595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c054c049/0xce1582440fb1f98e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.730233:0:24595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c054c049/0xce1582440fb1f98e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263905.730242:0:24595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789263905.730252:0:22893:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263905.730257:0:22893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c054c049/0xce1582440fb1f98e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.730263:0:22893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9abf3b400 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263905.730265:0:22893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c054c049/0xce1582440fb1f98e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1789263905.730267:0:24595:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:34 00010000:00010000:1.0:1789263905.730273:0:22893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c054c049/0xce1582440fb1f98e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.730287:0:22893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c054c049/0xce1582440fb1f98e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.730292:0:22893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c054c049/0xce1582440fb1f98e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263905.730302:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263905.730304:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263905.730305:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789263905.730358:0:24595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22929:x1876178898173056:12345-0@lo:5:osp-pre-0-0.0 Request processed in 18906us (19191us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263905.730367:0:24595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789263905.730382:0:22929:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaac380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22929:1876178898173056:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1789263905.730398:0:22929:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x22:0x0] 00000100:00100000:1.0:1789263905.730441:0:22929:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882434700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22929:1876178898173184:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1789263905.730479:0:22929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263905.730505:0:22929:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9c09d3a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789263905.730510:0:24409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898173184 00000100:00100000:0.0:1789263905.730516:0:24409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898173184 00000100:00100000:0.0:1789263905.730548:0:24409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789263905.730554:0:24409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882435c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22929:x1876178898173184:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1789263905.730581:0:24409:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00000001:00080000:1.0:1789263905.733446:0:24406:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:1.0:1789263905.733483:0:24406:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1789263905.733604:0:24409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882435c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:22929:x1876178898173184:12345-0@lo:5:osp-pre-0-0.0 Request processed in 3046us (3121us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1789263905.733612:0:22929:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901889 gen 2 00000100:00100000:0.0:1789263905.733616:0:24409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789263905.733621:0:22929:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882434700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22929:1876178898173184:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1789263905.733631:0:22929:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00010000:00010000:1.0:1789263906.157445:0:24436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789263906.683188:0:24776:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg320-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000020:00000004:1.0:1789263907.034890:0:24829:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789263907.035121:0:24829:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789263907.181200:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789263907.309237:0:22941:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789263907.309245:0:22941:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789263907.309329:0:22941:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 4 count 3 00000040:00080000:3.0:1789263907.309336:0:22941:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000020:00000004:1.0:1789263907.344525:0:24879:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789263907.344682:0:24879:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789263908.207635:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263909.229203:0:24436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789263909.619818:0:25223:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789263909.619827:0:25223:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1789263909.619828:0:25223:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1789263909.619949:0:25223:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9dd9abedd000 00000020:01000004:0.0:1789263909.619963:0:25223:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1789263909.619977:0:25223:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789263909.619991:0:25223:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9dd9c1ba8000) 00000020:00000080:0.0:1789263909.620009:0:25223:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789263909.648515:0:25223:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1789263909.649907:0:25223:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1789263909.650097:0:25223:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1789263909.650419:0:25223:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1789263909.650578:0:25223:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1789263909.650765:0:25223:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1789263909.650918:0:25223:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:2.0:1789263909.652015:0:25223:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789263909.652201:0:25223:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1789263909.652211:0:25223:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789263909.652219:0:25223:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xce1582440fb1f99c 00000020:01000004:2.0:1789263909.652224:0:25223:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1789263909.652242:0:25223:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.120@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789263909.652245:0:25223:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.120@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789263909.652250:0:25223:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1789263909.652275:0:25223:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1789263909.652280:0:25223:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.120@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1789263909.657515:0:25223:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.120@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789263909.657551:0:25223:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.120@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1789263909.657555:0:25223:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789263909.657557:0:25223:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789263909.657558:0:25223:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789263909.657559:0:25223:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789263909.657564:0:25223:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789263909.657566:0:25223:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789263909.657567:0:25223:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789263909.657569:0:25223:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789263909.657570:0:25223:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789263909.657573:0:25223:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1789263909.657575:0:25223:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789263909.657576:0:25223:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789263909.657577:0:25223:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789263909.657578:0:25223:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789263909.657579:0:25223:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789263909.657580:0:25223:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789263909.657581:0:25223:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789263909.657581:0:25223:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789263909.657582:0:25223:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789263909.657612:0:25223:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789263909.657631:0:25223:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:25223:1876178898173312:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789263909.657692:0:25223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263909.657749:0:25223:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd986221b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789263909.657754:0:22896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898173312 00000100:00100000:0.0:1789263909.657763:0:22896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898173312 00000100:00100000:0.0:1789263909.657817:0:22896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789263909.657826:0:22896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+21:25223:x1876178898173312:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789263909.657853:0:22896:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789263909.657856:0:22896:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1789263909.657860:0:22896:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1789263909.658642:0:22896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+21:25223:x1876178898173312:12345-0@lo:253:mount.lustre.0 Request processed in 817us (948us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263909.658648:0:22896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789263909.658681:0:25223:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:25223:1876178898173312:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789263909.658694:0:25223:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789263909.658697:0:25223:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789263909.658698:0:25223:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789263909.658699:0:25223:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789263909.658700:0:25223:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789263909.658701:0:25223:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789263909.658701:0:25223:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789263909.658702:0:25223:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789263909.658703:0:25223:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789263909.658704:0:25223:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789263909.658720:0:25223:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9dd9abedd000 from lustre-OST0001 10000000:01000000:2.0:1789263909.658764:0:25223:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1789263909.658768:0:25223:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789263909.658775:0:25223:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9dd8838099b8 local copy 00010000:00010000:2.0:1789263909.658784:0:25223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22000/0xce1582440fb1f5dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f5e4 expref: -99 pid: 22883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263909.658860:0:25223:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:25223:1876178898173440:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789263909.658881:0:25223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263909.658904:0:25223:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd986221180 going to sleep for 11 seconds 00000100:00100000:0.0:1789263909.658932:0:22899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898173440 00000100:00100000:0.0:1789263909.658938:0:22899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898173440 00000100:00100000:0.0:1789263909.658967:0:22899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789263909.658974:0:22899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+21:25223:x1876178898173440:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789263909.659056:0:22899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+21:25223:x1876178898173440:12345-0@lo:501:mount.lustre.0 Request processed in 82us (173us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789263909.659064:0:22899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789263909.659106:0:25223:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:25223:1876178898173440:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789263909.659121:0:25223:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.120@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789263909.659138:0:25223:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.120@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789263909.659145:0:25223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22000/0xce1582440fb1f5dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f5e4 expref: -99 pid: 22883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263909.659153:0:25223:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22000/0xce1582440fb1f5dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f5e4 expref: -99 pid: 22883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789263909.659179:0:25223:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9dd9abedd000 10000000:01000000:2.0:1789263909.659183:0:25223:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789263909.659189:0:25223:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789263909.659190:0:25223:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789263909.659193:0:25223:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1789263909.659195:0:25223:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789263909.659211:0:25223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23200/0xce1582440fb1f9a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263909.659216:0:25223:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23200/0xce1582440fb1f9a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263909.659222:0:25223:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23200/0xce1582440fb1f9a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263909.659240:0:25223:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:25223:1876178898173568:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789263909.659265:0:25223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263909.659286:0:25223:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd986221180 going to sleep for 11 seconds 00000100:00100000:0.0:1789263909.659305:0:22896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898173568 00000100:00100000:0.0:1789263909.659309:0:22896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898173568 00000100:00100000:0.0:1789263909.659336:0:22896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789263909.659342:0:22896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+21:25223:x1876178898173568:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789263909.659349:0:22896:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263909.659364:0:22896:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd9abf3a000/0xce1582440fb1f9aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1f9a3 expref: -99 pid: 22896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263909.659380:0:22896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd9abf3a000/0xce1582440fb1f9aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1f9a3 expref: 22 pid: 22896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263909.659387:0:22896:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd9abf3a000/0xce1582440fb1f9aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1f9a3 expref: 22 pid: 22896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263909.659393:0:22896:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9abf3a000, rc 0) 00000100:00100000:0.0:1789263909.659423:0:22896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+22:25223:x1876178898173568:12345-0@lo:101:mount.lustre.0 Request processed in 82us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263909.659427:0:22896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789263909.659456:0:25223:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:25223:1876178898173568:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789263909.659468:0:25223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23200/0xce1582440fb1f9a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f9aa expref: -99 pid: 25223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263909.659475:0:25223:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23200/0xce1582440fb1f9a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1f9aa expref: -99 pid: 25223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789263909.659975:0:25223:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:2.0:1789263909.660376:0:25223:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789263909.661572:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1789263909.661603:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:2.0:1789263909.661618:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:2.0:1789263909.661631:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:2.0:1789263909.661643:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:2.0:1789263909.661655:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:2.0:1789263909.661666:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:2.0:1789263909.661680:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:2.0:1789263909.661692:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:2.0:1789263909.661712:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:2.0:1789263909.661717:0:25223:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:2.0:1789263909.661796:0:25223:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:25223:1876178898173696:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789263909.661841:0:25223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263909.661875:0:25223:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd986221cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789263909.661891:0:22899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898173696 00000100:00100000:0.0:1789263909.661898:0:22899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898173696 00000100:00100000:0.0:1789263909.661934:0:22899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789263909.661943:0:22899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+22:25223:x1876178898173696:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789263909.662058:0:22899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+22:25223:x1876178898173696:12345-0@lo:501:mount.lustre.0 Request processed in 116us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263909.662067:0:22899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789263909.662135:0:25223:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:25223:1876178898173696:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789263909.662170:0:25223:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:25223:1876178898173824:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789263909.662210:0:25223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263909.662232:0:25223:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd986221cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789263909.662253:0:22896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898173824 00000100:00100000:0.0:1789263909.662259:0:22896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898173824 00000100:00100000:0.0:1789263909.662284:0:22896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789263909.662290:0:22896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+22:25223:x1876178898173824:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789263909.662726:0:22896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+22:25223:x1876178898173824:12345-0@lo:503:mount.lustre.0 Request processed in 434us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263909.662745:0:22896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789263909.662823:0:25223:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:25223:1876178898173824:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789263909.663175:0:25223:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789263909.663215:0:25223:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:25223:1876178898173952:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789263909.663255:0:25223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263909.663325:0:25223:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd98a6a2b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789263909.663358:0:22899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898173952 00000100:00100000:0.0:1789263909.663368:0:22899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898173952 00000100:00100000:0.0:1789263909.663395:0:22899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789263909.663402:0:22899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+22:25223:x1876178898173952:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789263909.663628:0:22899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+22:25223:x1876178898173952:12345-0@lo:502:mount.lustre.0 Request processed in 224us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263909.663634:0:22899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789263909.663657:0:25223:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:25223:1876178898173952:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789263909.663792:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1789263909.663816:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:2.0:1789263909.663830:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:2.0:1789263909.663858:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:2.0:1789263909.663875:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:2.0:1789263909.663888:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:2.0:1789263909.663901:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:2.0:1789263909.663915:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:2.0:1789263909.663928:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:2.0:1789263909.663948:0:25223:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:25223:1876178898174080:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789263909.663983:0:25223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263909.664007:0:25223:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd98a6a2b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789263909.664027:0:22896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898174080 00000100:00100000:0.0:1789263909.664032:0:22896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898174080 00000100:00100000:0.0:1789263909.664060:0:22896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789263909.664068:0:22896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+22:25223:x1876178898174080:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789263909.664160:0:22896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+22:25223:x1876178898174080:12345-0@lo:502:mount.lustre.0 Request processed in 92us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263909.664168:0:22896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789263909.664182:0:25223:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:25223:1876178898174080:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789263909.664223:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:2.0:1789263909.664231:0:25223:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:2.0:1789263909.664602:0:25227:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789263909.664610:0:25227:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1789263909.664621:0:25227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263909.664624:0:25227:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1789263909.664629:0:25227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789263909.664641:0:25227:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9dd8838999b8) 00000020:00000080:2.0:1789263909.664665:0:25227:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789263909.664670:0:25227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789263909.664744:0:25227:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dd9abedd000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1789263909.664752:0:25227:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789263909.664758:0:25227:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xce1582440fb1f9b8 00010000:00010000:2.0:1789263909.667433:0:25227:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:2.0:1789263909.667762:0:25227:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934601 00080000:10000000:2.0:1789263909.668655:0:25227:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:2.0:1789263909.669615:0:25227:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1789263909.669625:0:25227:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789263909.669631:0:25227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263909.669633:0:25227:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1789263909.669636:0:25227:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789263909.669640:0:25227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263909.669642:0:25227:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789263909.669645:0:25227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789263909.669647:0:25227:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789263909.669649:0:25227:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789263909.669652:0:25227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263909.669653:0:25227:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789263909.669655:0:25227:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789263909.669658:0:25227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263909.669659:0:25227:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789263909.669662:0:25227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1789263909.669683:0:25227:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789263909.669686:0:25227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789263909.669687:0:25227:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789263909.669691:0:25227:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:0.0:1789263909.669910:0:25223:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1789263909.669938:0:25223:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789263909.669958:0:25223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23200/0xce1582440fb1f9a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f9aa expref: -99 pid: 25223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263909.669979:0:25223:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa23200/0xce1582440fb1f9a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f9aa expref: -99 pid: 25223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789263909.669988:0:25223:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dd9abedd000 from 1 10000000:01000000:0.0:1789263909.669991:0:25223:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789263909.670025:0:25223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9abf3a400/0xce1582440fb1f9bf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263909.670046:0:25223:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd9abf3a400/0xce1582440fb1f9bf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263909.670071:0:25223:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd9abf3a400/0xce1582440fb1f9bf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263909.670131:0:25223:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaafb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:25223:1876178898174208:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789263909.670209:0:25223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263909.670248:0:22899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898174208 00000100:00100000:0.0:1789263909.670254:0:25223:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9c0b53540 going to sleep for 11 seconds 00000100:00100000:2.0:1789263909.670263:0:22899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898174208 00000100:00100000:2.0:1789263909.670309:0:22899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789263909.670319:0:22899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+22:25223:x1876178898174208:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789263909.670329:0:22899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263909.670339:0:22899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd9bfa22400/0xce1582440fb1f9c6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1f9bf expref: -99 pid: 22899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263909.670357:0:22899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd9bfa22400/0xce1582440fb1f9c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1f9bf expref: 23 pid: 22899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263909.670364:0:22899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd9bfa22400/0xce1582440fb1f9c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1f9bf expref: 23 pid: 22899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263909.670370:0:22899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bfa22400, rc 0) 00000100:00100000:2.0:1789263909.670407:0:22899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+23:25223:x1876178898174208:12345-0@lo:101:mount.lustre.0 Request processed in 92us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263909.670412:0:22899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789263909.671395:0:25223:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaafb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:25223:1876178898174208:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789263909.671414:0:25223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd9abf3a400/0xce1582440fb1f9bf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f9c6 expref: -99 pid: 25223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263909.671422:0:25223:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd9abf3a400/0xce1582440fb1f9bf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1f9c6 expref: -99 pid: 25223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789263909.672142:0:25223:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:0.0:1789263909.672350:0:25223:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789263909.672518:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:0.0:1789263909.672547:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:0.0:1789263909.672565:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:0.0:1789263909.672582:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:0.0:1789263909.672598:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:0.0:1789263909.672613:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:0.0:1789263909.672625:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:0.0:1789263909.672635:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:0.0:1789263909.672644:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:0.0:1789263909.672654:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:0.0:1789263909.672663:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:0.0:1789263909.672674:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:0.0:1789263909.672679:0:25223:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:0.0:1789263909.672751:0:25223:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaafb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:25223:1876178898174336:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789263909.672798:0:25223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263909.672826:0:25223:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9c0b53000 going to sleep for 11 seconds 00000100:00100000:1.0:1789263909.672857:0:22896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898174336 00000100:00100000:1.0:1789263909.672864:0:22896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898174336 00000100:00100000:1.0:1789263909.672909:0:22896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789263909.672919:0:22896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+23:25223:x1876178898174336:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789263909.673022:0:22896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+23:25223:x1876178898174336:12345-0@lo:501:mount.lustre.0 Request processed in 105us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263909.673031:0:22896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789263909.673057:0:25223:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaafb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:25223:1876178898174336:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789263909.673124:0:25223:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaafb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:25223:1876178898174464:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789263909.673155:0:25223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263909.673181:0:25223:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9c0b53000 going to sleep for 11 seconds 00000100:00100000:1.0:1789263909.673212:0:22899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898174464 00000100:00100000:1.0:1789263909.673217:0:22899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898174464 00000100:00100000:1.0:1789263909.673248:0:22899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789263909.673262:0:22899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+23:25223:x1876178898174464:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789263909.673350:0:22899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+23:25223:x1876178898174464:12345-0@lo:503:mount.lustre.0 Request processed in 93us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263909.673357:0:22899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789263909.673422:0:25223:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaafb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:25223:1876178898174464:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789263909.673668:0:25223:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789263909.673717:0:25223:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaafb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:25223:1876178898174592:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789263909.673775:0:25223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263909.673797:0:25223:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd98de43780 going to sleep for 11 seconds 00000100:00100000:1.0:1789263909.673822:0:22896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898174592 00000100:00100000:1.0:1789263909.673828:0:22896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898174592 00000100:00100000:1.0:1789263909.673869:0:22896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789263909.673877:0:22896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+23:25223:x1876178898174592:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789263909.673963:0:22896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+23:25223:x1876178898174592:12345-0@lo:502:mount.lustre.0 Request processed in 86us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263909.673971:0:22896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789263909.673975:0:25223:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaafb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:25223:1876178898174592:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789263909.674150:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:0.0:1789263909.674179:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:0.0:1789263909.674201:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:0.0:1789263909.674215:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:0.0:1789263909.674229:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:0.0:1789263909.674241:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:0.0:1789263909.674254:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:0.0:1789263909.674265:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:0.0:1789263909.674277:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:0.0:1789263909.674304:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:0.0:1789263909.674320:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:0.0:1789263909.674339:0:25223:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaafb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:25223:1876178898174720:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789263909.674368:0:25223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263909.674393:0:25223:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd98de43780 going to sleep for 11 seconds 00000100:00100000:1.0:1789263909.674425:0:22899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898174720 00000100:00100000:1.0:1789263909.674430:0:22899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898174720 00000100:00100000:1.0:1789263909.674459:0:22899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789263909.674465:0:22899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+23:25223:x1876178898174720:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789263909.674529:0:22899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+23:25223:x1876178898174720:12345-0@lo:502:mount.lustre.0 Request processed in 64us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263909.674536:0:22899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789263909.674539:0:25223:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaafb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:25223:1876178898174720:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789263909.674571:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:0.0:1789263909.674583:0:25223:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1789263909.675029:0:25231:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789263909.675038:0:25231:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789263909.675041:0:25231:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789263909.675048:0:25231:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dd9abedd000 00000020:00000080:0.0:1789263909.675052:0:25231:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789263909.675059:0:25231:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789263909.675061:0:25231:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789263909.675063:0:25231:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789263909.675065:0:25231:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789263909.675067:0:25231:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789263909.675068:0:25231:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789263909.675072:0:25231:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dd9abedd000 00000020:00000080:0.0:1789263909.675074:0:25231:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789263909.675143:0:25231:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789263909.675145:0:25231:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789263909.675146:0:25231:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789263909.675147:0:25231:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789263909.675149:0:25231:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789263909.675150:0:25231:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789263909.675152:0:25231:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9dd9abedd000 00000020:00000080:0.0:1789263909.675153:0:25231:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789263909.675162:0:25231:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789263909.675164:0:25231:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789263909.675165:0:25231:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789263909.675166:0:25231:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789263909.675168:0:25231:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789263909.675169:0:25231:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789263909.675172:0:25231:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9dd9abedd000 00000020:00000080:0.0:1789263909.675173:0:25231:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789263909.675202:0:25231:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789263909.675206:0:25231:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789263909.675207:0:25231:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789263909.675211:0:25231:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:2.0:1789263909.675259:0:25223:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1789263909.675288:0:25223:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789263909.675317:0:25223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9abf3a400/0xce1582440fb1f9bf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f9c6 expref: -99 pid: 25223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263909.675328:0:25223:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd9abf3a400/0xce1582440fb1f9bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f9c6 expref: -99 pid: 25223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789263909.675383:0:25223:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789263909.675387:0:25223:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9dd9abedd000 10000000:01000000:2.0:1789263909.675390:0:25223:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9dd9abedd000 10000000:01000000:2.0:1789263909.675394:0:25223:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789263909.675400:0:25223:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9dd9abedd000 from 1 10000000:01000000:2.0:1789263909.675411:0:25223:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789263909.675444:0:25223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22200/0xce1582440fb1f9cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263909.675452:0:25223:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22200/0xce1582440fb1f9cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263909.675461:0:25223:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22200/0xce1582440fb1f9cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263909.675476:0:25223:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:25223:1876178898174848:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789263909.675513:0:25223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263909.675558:0:22896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898174848 00000100:00100000:2.0:1789263909.675559:0:25223:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd8841cf6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789263909.675563:0:22896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898174848 00000100:00100000:1.0:1789263909.675598:0:22896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789263909.675605:0:22896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+23:25223:x1876178898174848:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789263909.675616:0:22896:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263909.675629:0:22896:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd8841a2600/0xce1582440fb1f9d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1f9cd expref: -99 pid: 22896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263909.675656:0:22896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd8841a2600/0xce1582440fb1f9d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1f9cd expref: 24 pid: 22896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263909.675667:0:22896:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd8841a2600/0xce1582440fb1f9d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1f9cd expref: 24 pid: 22896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263909.675676:0:22896:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd8841a2600, rc 0) 00000100:00100000:1.0:1789263909.675722:0:22896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+24:25223:x1876178898174848:12345-0@lo:101:mount.lustre.0 Request processed in 117us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263909.675728:0:22896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789263909.675800:0:25223:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:25223:1876178898174848:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789263909.675813:0:25223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22200/0xce1582440fb1f9cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f9d4 expref: -99 pid: 25223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263909.675823:0:25223:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22200/0xce1582440fb1f9cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1f9d4 expref: -99 pid: 25223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789263909.679839:0:25223:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:3.0:1789263909.680349:0:25223:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789263909.680589:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1789263909.680628:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:3.0:1789263909.680649:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:3.0:1789263909.680665:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:3.0:1789263909.680683:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:3.0:1789263909.680700:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:3.0:1789263909.680717:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:3.0:1789263909.680747:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:3.0:1789263909.680767:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1789263909.680785:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:3.0:1789263909.680817:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:3.0:1789263909.680846:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:3.0:1789263909.680868:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:3.0:1789263909.680890:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:3.0:1789263909.680912:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:3.0:1789263909.680931:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:3.0:1789263909.680949:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:3.0:1789263909.680971:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:3.0:1789263909.680991:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:3.0:1789263909.681011:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:3.0:1789263909.681039:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:3.0:1789263909.681062:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:3.0:1789263909.681101:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:3.0:1789263909.681129:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:3.0:1789263909.681156:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:3.0:1789263909.681181:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:3.0:1789263909.681219:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:3.0:1789263909.681244:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:3.0:1789263909.681268:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:3.0:1789263909.681292:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:3.0:1789263909.681315:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:3.0:1789263909.681338:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:3.0:1789263909.681359:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:3.0:1789263909.681381:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:3.0:1789263909.681403:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:3.0:1789263909.681424:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:3.0:1789263909.681444:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:3.0:1789263909.681465:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:3.0:1789263909.681489:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:3.0:1789263909.681513:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:3.0:1789263909.681537:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:3.0:1789263909.681561:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:3.0:1789263909.681596:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:3.0:1789263909.681624:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:3.0:1789263909.681658:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:3.0:1789263909.681677:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:3.0:1789263909.681694:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:3.0:1789263909.681716:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:3.0:1789263909.681877:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:3.0:1789263909.681903:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:3.0:1789263909.681929:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:3.0:1789263909.681935:0:25223:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:3.0:1789263909.682021:0:25223:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88297c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:25223:1876178898174976:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789263909.682108:0:25223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263909.682145:0:22899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898174976 00000100:00100000:3.0:1789263909.682149:0:25223:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd884041e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789263909.682152:0:22899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898174976 00000100:00100000:2.0:1789263909.682194:0:22899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789263909.682203:0:22899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+24:25223:x1876178898174976:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789263909.682312:0:22899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+24:25223:x1876178898174976:12345-0@lo:501:mount.lustre.0 Request processed in 109us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263909.682322:0:22899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789263909.682334:0:25223:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88297c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:25223:1876178898174976:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789263909.682367:0:25223:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88297c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:25223:1876178898175104:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789263909.682405:0:25223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263909.682423:0:25223:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd884041e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789263909.682435:0:22898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898175104 00000100:00100000:2.0:1789263909.682439:0:22898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898175104 00000100:00100000:2.0:1789263909.682467:0:22898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789263909.682472:0:22898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec0ec848-5fac-4f6a-ba8a-daed864d309d+24:25223:x1876178898175104:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789263909.682539:0:22898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec0ec848-5fac-4f6a-ba8a-daed864d309d+24:25223:x1876178898175104:12345-0@lo:503:mount.lustre.0 Request processed in 66us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263909.682544:0:22898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789263909.682561:0:25223:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88297c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:25223:1876178898175104:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789263909.683009:0:25223:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789263909.683062:0:25223:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88297c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:25223:1876178898175232:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789263909.683128:0:25223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263909.683149:0:22899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898175232 00000100:00100000:2.0:1789263909.683154:0:22899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898175232 00000100:00100000:3.0:1789263909.683159:0:25223:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd884041e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789263909.683193:0:22899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789263909.683202:0:22899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+24:25223:x1876178898175232:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789263909.683285:0:22899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+24:25223:x1876178898175232:12345-0@lo:502:mount.lustre.0 Request processed in 84us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263909.683295:0:22899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789263909.683306:0:25223:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88297c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:25223:1876178898175232:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789263909.683465:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1789263909.683489:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:3.0:1789263909.683506:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:3.0:1789263909.683522:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:3.0:1789263909.683557:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:3.0:1789263909.683582:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:3.0:1789263909.683617:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:3.0:1789263909.683641:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:3.0:1789263909.683665:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1789263909.683683:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:3.0:1789263909.683698:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:3.0:1789263909.683712:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:3.0:1789263909.683747:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:3.0:1789263909.683770:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:3.0:1789263909.683787:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:3.0:1789263909.683803:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:3.0:1789263909.683818:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:3.0:1789263909.683835:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:3.0:1789263909.683855:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:3.0:1789263909.683872:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:3.0:1789263909.683898:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:3.0:1789263909.683916:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:3.0:1789263909.683933:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:3.0:1789263909.683945:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:3.0:1789263909.683960:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:3.0:1789263909.683976:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:3.0:1789263909.683994:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:3.0:1789263909.684010:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:3.0:1789263909.684029:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:3.0:1789263909.684045:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:3.0:1789263909.684062:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:3.0:1789263909.684109:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:3.0:1789263909.684131:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:3.0:1789263909.684151:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:3.0:1789263909.684171:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:3.0:1789263909.684192:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:3.0:1789263909.684223:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:3.0:1789263909.684241:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:3.0:1789263909.684262:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:3.0:1789263909.684287:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:3.0:1789263909.684301:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:3.0:1789263909.684319:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:3.0:1789263909.684339:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:3.0:1789263909.684359:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:3.0:1789263909.684378:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:3.0:1789263909.684393:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:3.0:1789263909.684407:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:3.0:1789263909.684423:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:3.0:1789263909.684460:0:25223:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88297c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:25223:1876178898175360:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789263909.684505:0:25223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263909.684535:0:25223:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd884041e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789263909.684548:0:22898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898175360 00000100:00100000:2.0:1789263909.684554:0:22898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898175360 00000100:00100000:2.0:1789263909.684587:0:22898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789263909.684594:0:22898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa60850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec0ec848-5fac-4f6a-ba8a-daed864d309d+24:25223:x1876178898175360:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789263909.684699:0:22898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa60850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec0ec848-5fac-4f6a-ba8a-daed864d309d+24:25223:x1876178898175360:12345-0@lo:502:mount.lustre.0 Request processed in 104us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263909.684703:0:25223:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88297c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:25223:1876178898175360:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789263909.684711:0:22898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000040:00080000:3.0:1789263909.684885:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:3.0:1789263909.684915:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:3.0:1789263909.684939:0:25223:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88297c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:25223:1876178898175488:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789263909.684978:0:25223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263909.685001:0:25223:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd884041e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789263909.685022:0:22899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898175488 00000100:00100000:2.0:1789263909.685027:0:22899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898175488 00000100:00100000:2.0:1789263909.685052:0:22899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789263909.685059:0:22899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+24:25223:x1876178898175488:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789263909.685165:0:22899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+24:25223:x1876178898175488:12345-0@lo:502:mount.lustre.0 Request processed in 105us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263909.685171:0:22899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789263909.685193:0:25223:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88297c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:25223:1876178898175488:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789263909.685268:0:25223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:3.0:1789263909.685276:0:25223:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1789263909.686233:0:25236:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1789263909.686256:0:25236:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9dd8826bb370) 00000020:00000080:2.0:1789263909.686279:0:25236:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:2.0:1789263909.686372:0:25236:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dd9abedd000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789263909.686376:0:25236:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dd9abedd000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789263909.686378:0:25236:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dd9abedd000 3 00010000:00080000:2.0:1789263909.686407:0:25236:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dd883ae5000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.120@tcp at head 00010000:00010000:2.0:1789263909.688034:0:25236:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:2.0:1789263909.688250:0:25236:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1789263909.688286:0:25236:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789263909.688298:0:25236:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xce1582440fb1f9e2 00000100:00080000:2.0:1789263909.688307:0:25236:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789263909.688313:0:25236:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9dd883ae5000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:2.0:1789263909.688347:0:25236:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd99f9a5c00 x1876178898175616/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789263909.688374:0:25236:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789263909.688628:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3617:1876178898175616:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789263909.688708:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263909.688759:0:22905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898175616 00000100:00100000:2.0:1789263909.688766:0:22905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898175616 00000100:00100000:2.0:1789263909.688794:0:22905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789263909.688801:0:22905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3617:x1876178898175616:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789263909.688820:0:22905:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 351 last 0 00000100:00080000:3.0:1789263909.688826:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789263909.688831:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789263909.688834:0:8:0:(import.c:65:import_set_state_nolock()) ffff9dd9c088f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789263909.688839:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 347 00000100:00080000:3.0:1789263909.688852:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789263909.688857:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9dd9c088f000 using connection 192.168.203.120@tcp/0@lo 00000020:00000080:2.0:1789263909.688863:0:22905:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xce1582440fb1f9e9 00000100:00100000:3.0:1789263909.688876:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd88297e680 x1876178898176000/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000004:00100000:2.0:1789263909.688877:0:22905:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789263909.688905:0:22905:0:(import.c:65:import_set_state_nolock()) ffff9dd88289f000 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1789263909.688919:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789263909.688923:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789263909.688926:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789263909.688930:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789263909.688949:0:22905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1876178898175616:12345-0@lo:38:llog_process_th.0 Request processed in 147us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263909.688955:0:22905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789263909.688984:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88297d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876178898175744:0@lo:400:kworker.0 00000100:00100000:3.0:1789263909.689038:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263909.689074:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88297fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1876178898176384:0@lo:400:kworker.0 00000100:00100000:3.0:1789263909.689130:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263909.689152:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789263909.689160:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88297d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898176256:0@lo:400:kworker.0 00000100:00100000:3.0:1789263909.689192:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263909.689225:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88297dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1876178898176128:0@lo:400:kworker.0 00000100:00100000:3.0:1789263909.689257:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263909.689278:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88297ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3621:1876178898176640:0@lo:400:kworker.0 00000100:00100000:3.0:1789263909.689319:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263909.689330:0:22908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898175744 00000100:00100000:3.0:1789263909.689342:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789263909.689343:0:22908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898175744 00000100:00100000:3.0:1789263909.689351:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88297ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898175872:0@lo:400:kworker.0 00000100:00100000:3.0:1789263909.689384:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263909.689408:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88297df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3621:1876178898176512:0@lo:400:kworker.0 00000100:00100000:2.0:1789263909.689414:0:22908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898176256 00000100:00100000:2.0:1789263909.689418:0:22908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898176256 00000100:00100000:2.0:1789263909.689448:0:22908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789263909.689460:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263909.689460:0:22908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3619:x1876178898175744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263909.689493:0:22903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898176384 00000100:00100000:3.0:1789263909.689498:0:22903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898176384 00000100:00100000:2.0:1789263909.689518:0:22908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3619:x1876178898175744:12345-0@lo:400:kworker.0 Request processed in 62us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263909.689526:0:22908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789263909.689545:0:22903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898176128 00000100:00100000:2.0:1789263909.689546:0:22908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789263909.689551:0:22903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898176128 00000100:00100000:2.0:1789263909.689558:0:22908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1876178898176256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263909.689573:0:22903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898176640 00000100:00100000:3.0:1789263909.689578:0:22903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898176640 00000100:00100000:2.0:1789263909.689597:0:22908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1876178898176256:12345-0@lo:400:kworker.0 Request processed in 42us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263909.689605:0:22908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789263909.689606:0:22903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898176512 00000100:00100000:3.0:1789263909.689611:0:22903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898176512 00000100:00100000:3.0:1789263909.689640:0:22903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789263909.689648:0:22903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1876178898176384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263909.689690:0:22903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1876178898176384:12345-0@lo:400:kworker.0 Request processed in 43us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263909.689697:0:22903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789263909.689712:0:22903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789263909.689720:0:22903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1876178898176128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263909.689766:0:22903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1876178898176128:12345-0@lo:400:kworker.0 Request processed in 47us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263909.689772:0:22903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789263909.689785:0:22903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789263909.689792:0:22903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1876178898176640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263909.689825:0:22903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1876178898176640:12345-0@lo:400:kworker.0 Request processed in 34us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263909.689832:0:22903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789263909.689846:0:24411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898175872 00000100:00100000:3.0:1789263909.689849:0:22903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789263909.689853:0:24411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898175872 00000100:00100000:3.0:1789263909.689859:0:22903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883b6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1876178898176512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263909.689892:0:22903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883b6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1876178898176512:12345-0@lo:400:kworker.0 Request processed in 35us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263909.689897:0:24411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789263909.689910:0:22903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789263909.689915:0:24411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1876178898175872:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789263909.689939:0:22900:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789263909.689945:0:22900:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789263909.689948:0:22900:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789263909.689960:0:24411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1876178898175872:12345-0@lo:400:kworker.0 Request processed in 50us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263909.689964:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88297e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1876178898176000:0@lo:8:kworker.0 00000100:00100000:1.0:1789263909.689979:0:24411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789263909.689999:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263909.690028:0:24595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898176000 00000100:00100000:1.0:1789263909.690033:0:24595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898176000 00000100:00100000:1.0:1789263909.690055:0:24595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789263909.690060:0:24595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883b6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3617:x1876178898176000:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1789263909.690134:0:24595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883b6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3617:x1876178898176000:12345-0@lo:8:kworker.0 Request processed in 71us (134us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789263909.690142:0:24595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789263909.690198:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88297d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898176256:0@lo:400:kworker.0 00000100:00100000:1.0:1789263909.690210:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88297d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876178898175744:0@lo:400:kworker.0 00010000:00080000:1.0:1789263909.690228:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd88297fb80 x1876178898176384/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263925 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789263909.690239:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88297fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1876178898176384:0@lo:400:kworker.0 00000020:01000004:1.0:1789263909.690392:0:25236:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1789263909.690405:0:25236:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9dd99f9c19b8) 00000020:00000080:1.0:1789263909.690425:0:25236:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:1.0:1789263909.690521:0:25236:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dd9abedd000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789263909.690526:0:25236:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dd9abedd000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789263909.690529:0:25236:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dd9abedd000 3 00010000:00080000:1.0:1789263909.690559:0:25236:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dd9abd31000@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.120@tcp at head 00000100:00100000:3.0:1789263909.691611:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789263909.691620:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd9c088f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789263909.691626:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789263909.691631:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88297e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1876178898176000:0@lo:8:kworker.0 00010000:00080000:3.0:1789263909.691649:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd99f9a5c00 x1876178898175616/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789263919 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263909.691658:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789263909.691665:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:3.0:1789263909.691673:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789263909.691677:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789263909.691680:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd883ae5000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789263909.691686:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3617:1876178898175616:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789263909.691765:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88297ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898175872:0@lo:400:kworker.0 00010000:00080000:3.0:1789263909.691782:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd88297df80 x1876178898176512/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263925 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263909.691793:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88297df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3621:1876178898176512:0@lo:400:kworker.0 00010000:00080000:3.0:1789263909.691804:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd88297dc00 x1876178898176128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263925 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263909.691820:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88297dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1876178898176128:0@lo:400:kworker.0 00010000:00080000:3.0:1789263909.691830:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd88297ca80 x1876178898176640/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263925 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263909.691835:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88297ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3621:1876178898176640:0@lo:400:kworker.0 00010000:00010000:1.0:1789263909.693139:0:25236:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:1.0:1789263909.693365:0:25236:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1789263909.693411:0:25236:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789263909.693425:0:25236:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xce1582440fb1f9f7 00000100:00080000:1.0:1789263909.693433:0:25236:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789263909.693439:0:25236:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9dd9abd31000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:1.0:1789263909.693480:0:25236:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd882434700 x1876178898176768/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789263909.693504:0:25236:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1789263909.693578:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789263909.693583:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789263909.693586:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789263909.693589:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:1.0:1789263909.693762:0:25236:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:0.0:1789263909.693845:0:25223:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1789263909.693882:0:25223:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789263909.693900:0:25223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22200/0xce1582440fb1f9cd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f9d4 expref: -99 pid: 25223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263909.693910:0:25223:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd9bfa22200/0xce1582440fb1f9cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1f9d4 expref: -99 pid: 25223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789263909.693968:0:25223:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789263909.693971:0:25223:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789263909.693973:0:25223:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789263909.693975:0:25223:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789263909.693976:0:25223:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789263909.693977:0:25223:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789263909.693978:0:25223:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789263909.693980:0:25223:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789263909.693981:0:25223:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789263909.693985:0:25223:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1789263909.693987:0:25223:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789263909.693989:0:25223:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789263909.693990:0:25223:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789263909.693992:0:25223:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789263909.693993:0:25223:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789263909.693995:0:25223:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789263909.693996:0:25223:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789263909.694002:0:25223:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789263909.694003:0:25223:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789263909.694022:0:25223:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1789263909.694038:0:25223:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaafb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:25223:1876178898176896:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789263909.694125:0:25223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263909.694166:0:22898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898176896 00000100:00100000:0.0:1789263909.694169:0:25223:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd8841cf540 going to sleep for 11 seconds 00000100:00100000:2.0:1789263909.694174:0:22898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898176896 00000100:00100000:2.0:1789263909.694227:0:22898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789263909.694239:0:22898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec0ec848-5fac-4f6a-ba8a-daed864d309d+24:25223:x1876178898176896:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789263909.694266:0:22898:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1789263909.694281:0:22898:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1789263909.694344:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882434700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3617:1876178898176768:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789263909.694389:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263909.694436:0:22903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898176768 00000100:00100000:0.0:1789263909.694442:0:22903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898176768 00000100:00100000:0.0:1789263909.694474:0:22903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789263909.694480:0:22903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883b6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3617:x1876178898176768:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789263909.694503:0:22903:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 351 last 0 00000020:00000080:0.0:1789263909.694540:0:22903:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xce1582440fb1f9fe 00000004:00100000:0.0:1789263909.694554:0:22903:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789263909.694582:0:22903:0:(import.c:65:import_set_state_nolock()) ffff9dd88296c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789263909.694720:0:22903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883b6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1876178898176768:12345-0@lo:38:llog_process_th.0 Request processed in 238us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263909.694725:0:22903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1789263909.694778:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd882434700 x1876178898176768/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789263919 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263909.694789:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789263909.694795:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:3.0:1789263909.694800:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789263909.694804:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1789263909.694806:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd9abd31000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789263909.694810:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882434700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3617:1876178898176768:0@lo:38:llog_process_th.0 20000000:01000000:2.0:1789263909.696758:0:22898:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789263909.696806:0:22898:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1789263909.697041:0:22898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec0ec848-5fac-4f6a-ba8a-daed864d309d+24:25223:x1876178898176896:12345-0@lo:253:mount.lustre.0 Request processed in 2802us (2913us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263909.697053:0:22898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789263909.697066:0:25223:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaafb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec0ec848-5fac-4f6a-ba8a-daed864d309d:25223:1876178898176896:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789263909.697099:0:25223:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789263909.697103:0:25223:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789263909.697105:0:25223:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789263909.697106:0:25223:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789263909.697107:0:25223:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789263909.697109:0:25223:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789263909.697110:0:25223:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789263909.697111:0:25223:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789263909.697112:0:25223:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789263909.697114:0:25223:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789263909.697131:0:25223:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1789263909.697156:0:22919:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789263909.697161:0:22919:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789263909.697180:0:22919:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dd981530800/0xce1582440fb1fa05 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263909.697194:0:22919:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd987f50600/0xce1582440fb1f8a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1f899 expref: 23 pid: 22896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263909.697201:0:22919:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd987f50400/0xce1582440fb1f8ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1f8a7 expref: 23 pid: 22896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263909.697218:0:22919:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dd981530800/0xce1582440fb1fa05 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263909.697249:0:22919:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd987f50400/0xce1582440fb1f8ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce1582440fb1f8a7 expref: 23 pid: 22896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263909.697262:0:22919:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dd987f50400/0xce1582440fb1f8ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce1582440fb1f8a7 expref: 23 pid: 22896 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263909.697275:0:22919:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883b6d880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22919:1876178898177024:0@lo:104: 00000100:00100000:3.0:1789263909.697306:0:22919:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789263909.697394:0:22919:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd987f50600/0xce1582440fb1f8a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce1582440fb1f899 expref: 23 pid: 22896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263909.697403:0:22919:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dd987f50600/0xce1582440fb1f8a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce1582440fb1f899 expref: 23 pid: 22896 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263909.697412:0:22919:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883b6f800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22919:1876178898177152:0@lo:104: 00000100:00100000:3.0:1789263909.697434:0:22919:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263909.697505:0:22919:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd884041e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789263909.697544:0:24058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898177024 00000100:00100000:2.0:1789263909.697551:0:24058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898177024 00000100:00100000:2.0:1789263909.697585:0:24058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898177152 00000100:00100000:2.0:1789263909.697588:0:24058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898177152 00000100:00100000:2.0:1789263909.697603:0:24058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789263909.697616:0:24058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883b6df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+4:22919:x1876178898177024:12345-0@lo:104: 00010000:00010000:2.0:1789263909.697627:0:24058:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff9dd8841a2e00/0xce1582440fb1f8a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1f8ae expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263909.697669:0:24058:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789263909.697675:0:24058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883b6df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+4:22919:x1876178898177024:12345-0@lo:104: Request processed in 60us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263909.697681:0:24058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789263909.697695:0:24058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789263909.697701:0:24058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883b6d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+3:22919:x1876178898177152:12345-0@lo:104: 00010000:00010000:2.0:1789263909.697708:0:24058:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff9dd8841a2c00/0xce1582440fb1f899 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1f8a0 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263909.697752:0:24058:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789263909.697757:0:24058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883b6d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+3:22919:x1876178898177152:12345-0@lo:104: Request processed in 56us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263909.697763:0:24058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789263909.697804:0:22919:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883b6d880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22919:1876178898177024:0@lo:104: 00000100:00100000:2.0:1789263909.697813:0:22919:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883b6f800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22919:1876178898177152:0@lo:104: 00010000:00010000:2.0:1789263909.697832:0:22919:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dd981530800/0xce1582440fb1fa05 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263909.698186:0:22892:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789263909.698196:0:22892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd8841a2e00/0xce1582440fb1f8a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1f8ae expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263909.698205:0:22892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd8841a2e00 already unused, calling callback (ffffffffc12b1c20) 10000000:00010000:1.0:1789263909.698209:0:22892:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd8841a2e00/0xce1582440fb1f8a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xce1582440fb1f8ae expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263909.698218:0:22892:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd8841a2e00/0xce1582440fb1f8a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xce1582440fb1f8ae expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789263909.698226:0:22892:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd8841a2e00/0xce1582440fb1f8a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xce1582440fb1f8ae expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789263909.698231:0:22892:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789263909.698261:0:22892:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff9dd8841a2e00/0xce1582440fb1f8a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1f8ae expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263909.698266:0:22892:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789263909.698288:0:22892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd8841a2e00/0xce1582440fb1f8a7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1f8ae expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263909.698293:0:22892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd8841a2e00/0xce1582440fb1f8a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1f8ae expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263909.698305:0:22892:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1789263909.698309:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882434700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec0ec848-5fac-4f6a-ba8a-daed864d309d:3618:1876178898177280:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789263909.698315:0:22892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd8841a2c00/0xce1582440fb1f899 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1f8a0 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263909.698322:0:22892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd8841a2c00 already unused, calling callback (ffffffffc12b1c20) 10000000:00010000:1.0:1789263909.698326:0:22892:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd8841a2c00/0xce1582440fb1f899 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xce1582440fb1f8a0 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263909.698333:0:22892:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd8841a2c00/0xce1582440fb1f899 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xce1582440fb1f8a0 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789263909.698340:0:22892:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd8841a2c00/0xce1582440fb1f899 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xce1582440fb1f8a0 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789263909.698349:0:22892:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:3.0:1789263909.698350:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789263909.698379:0:22892:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff9dd8841a2c00/0xce1582440fb1f899 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1f8a0 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263909.698387:0:22892:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789263909.698396:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1789263909.698397:0:22892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd8841a2c00/0xce1582440fb1f899 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1f8a0 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263909.698406:0:22889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898177280 00010000:00010000:1.0:1789263909.698406:0:22892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd8841a2c00/0xce1582440fb1f899 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1f8a0 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263909.698408:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882437b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec0ec848-5fac-4f6a-ba8a-daed864d309d:3618:1876178898177408:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789263909.698413:0:22889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898177280 00010000:00010000:1.0:1789263909.698430:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263909.698434:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789263909.698438:0:22889:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd987f50400/0xce1582440fb1f8ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1f8a7 expref: 24 pid: 22896 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263909.698438:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789263909.698446:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789263909.698449:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789263909.698479:0:22889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898177408 00000100:00100000:2.0:1789263909.698487:0:22889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898177408 00000100:00100000:3.0:1789263909.698494:0:23658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00010000:00010000:2.0:1789263909.698504:0:22889:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd987f50600/0xce1582440fb1f8a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1f899 expref: 25 pid: 22896 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263909.698509:0:23658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883b6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec0ec848-5fac-4f6a-ba8a-daed864d309d+25:3618:x1876178898177280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789263909.698530:0:23658:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789263909.698531:0:22889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789263909.698536:0:22891:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00010000:00010000:3.0:1789263909.698540:0:23658:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd987f50400/0xce1582440fb1f8ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1f8a7 expref: 25 pid: 22896 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263909.698542:0:22889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883b6d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+25:3618:x1876178898177408:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789263909.698545:0:22891:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00010000:00010000:2.0:1789263909.698558:0:22889:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789263909.698561:0:23658:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd987f50400/0xce1582440fb1f8ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce1582440fb1f8a7 expref: 25 pid: 22896 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263909.698566:0:22889:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd987f50600/0xce1582440fb1f8a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1f899 expref: 25 pid: 22896 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263909.698585:0:23658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd987f50400/0xce1582440fb1f8ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce1582440fb1f8a7 expref: 25 pid: 22896 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263909.698588:0:22889:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd987f50600/0xce1582440fb1f8a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce1582440fb1f899 expref: 25 pid: 22896 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263909.698611:0:22889:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd987f50600/0xce1582440fb1f8a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce1582440fb1f899 expref: 24 pid: 22896 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263909.698612:0:23658:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dd981530800/0xce1582440fb1fa05 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263909.698627:0:23658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd981530800/0xce1582440fb1fa05 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263909.698635:0:22889:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 20000000:01000000:3.0:1789263909.698640:0:23658:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004489663s 00010000:00010000:3.0:1789263909.698646:0:23658:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd981530800/0xce1582440fb1fa05 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263909.698652:0:23658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd981530800/0xce1582440fb1fa05 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263909.698659:0:23658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dd981530800/0xce1582440fb1fa05 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263909.698666:0:23658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dd981530800/0xce1582440fb1fa05 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263909.698670:0:22889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883b6d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+23:3618:x1876178898177408:12345-0@lo:103:ldlm_bl.0 Request processed in 130us (227us total) trans 0 rc 0/0 00010000:00010000:3.0:1789263909.698679:0:23658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981530800 already unused, calling callback (ffffffffc0cc9350) 00000100:00100000:2.0:1789263909.698684:0:22889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1789263909.698685:0:23658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dd981530800/0xce1582440fb1fa05 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263909.698702:0:23658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dd981530800/0xce1582440fb1fa05 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263909.698720:0:23658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dd981530800/0xce1582440fb1fa05 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263909.698723:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882437b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec0ec848-5fac-4f6a-ba8a-daed864d309d:3618:1876178898177408:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789263909.698751:0:23658:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789263909.698778:0:22919:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dd981530800/0xce1582440fb1fa05 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263909.698788:0:22919:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dd981530800/0xce1582440fb1fa05 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263909.698793:0:23658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883b6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec0ec848-5fac-4f6a-ba8a-daed864d309d+22:3618:x1876178898177280:12345-0@lo:103:ldlm_bl.0 Request processed in 288us (444us total) trans 0 rc 0/0 00010000:00010000:2.0:1789263909.698800:0:22919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd981530800/0xce1582440fb1fa05 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263909.698808:0:23658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789263909.698843:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882434700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec0ec848-5fac-4f6a-ba8a-daed864d309d:3618:1876178898177280:0@lo:103:ldlm_bl.0 00000001:00000004:2.0:1789263909.699483:0:25223:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:2.0:1789263909.700795:0:25223:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1789263909.700800:0:25223:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1789263909.700832:0:25223:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789263909.700880:0:25223:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.120@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789263909.700893:0:25223:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1789263909.700920:0:25223:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1789263909.701801:0:25223:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789263909.702032:0:25223:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1789263909.933224:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882434a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898177536:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789263909.933294:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263909.933335:0:22908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898177536 00000100:00100000:2.0:1789263909.933343:0:22908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898177536 00000100:00100000:2.0:1789263909.933407:0:22908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789263909.933419:0:22908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882436d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3620:x1876178898177536:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789263909.933453:0:22908:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789263909.933498:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88431dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898177664:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789263909.933505:0:22908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882436d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3620:x1876178898177536:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263909.933515:0:22908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789263909.933541:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263909.933546:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882434a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898177536:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789263909.933570:0:22927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898177664 00000100:00100000:2.0:1789263909.933576:0:22927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898177664 00000100:00100000:2.0:1789263909.933609:0:22927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789263909.933617:0:22927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88431e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1876178898177664:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789263909.933635:0:22927:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446297600 avail 1300058112 00000100:00100000:2.0:1789263909.933677:0:22927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88431e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1876178898177664:12345-0@lo:41:osp-pre-0-1.0 Request processed in 61us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263909.933683:0:22927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789263909.933711:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88431dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898177664:0@lo:41:osp-pre-0-1.0 00000020:00000004:2.0:1789263910.028932:0:25290:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789263910.029182:0:25290:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789263910.254187:0:24436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789263910.445976:0:23638:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1789263910.702126:0:3617:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789263899/real 1789263899] req@ffff9dd883b6e680 x1876178898162048/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789263909 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263910.702149:0:3617:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9dd883b6e680 x1876178898162048/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789263909 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263910.702157:0:3617:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789263899/real 1789263899] req@ffff9dd883b6ce00 x1876178898161920/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789263909 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263910.702168:0:3617:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9dd883b6ce00 x1876178898161920/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789263909 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789263910.702185:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd9862e5800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789263910.702209:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789263910.702220:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883b6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1876178898162048:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1789263910.702226:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd98850d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789263910.702231:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789263910.702234:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883b6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1876178898161920:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1789263910.702292:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:3.0:1789263910.702301:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec0ec848-5fac-4f6a-ba8a-daed864d309d:3618:1876178898177792:0@lo:400:kworker.0 00000100:00080000:0.0:1789263910.702305:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789263910.702309:0:8:0:(import.c:65:import_set_state_nolock()) ffff9dd9c088f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789263910.702318:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9dd9c088f000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:1.0:1789263910.702320:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876178898177920:0@lo:400:kworker.0 00000100:00100000:0.0:1789263910.702339:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd9bfaaed80 x1876178898178048/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789263910.702368:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263910.702368:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789263910.702370:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789263910.702375:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789263910.702377:0:8:0:(import.c:65:import_set_state_nolock()) ffff9dd98850d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789263910.702380:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 341 00000100:00080000:0.0:1789263910.702385:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789263910.702388:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9dd98850d800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:0.0:1789263910.702410:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd9bfaae300 x1876178898178304/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789263910.702413:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1876178898178176:0@lo:400:kworker.0 00000100:00080000:0.0:1789263910.702421:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789263910.702424:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789263910.702426:0:8:0:(import.c:65:import_set_state_nolock()) ffff9dd9862e5800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789263910.702428:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 341 00000100:00080000:0.0:1789263910.702431:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789263910.702435:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9dd9862e5800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:3.0:1789263910.702442:0:22899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898177792 00000100:00100000:1.0:1789263910.702443:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263910.702448:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd884acc700 x1876178898178432/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789263910.702452:0:22899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898177792 00000100:00100000:1.0:1789263910.702479:0:24411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898177920 00000100:00100000:1.0:1789263910.702484:0:24411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898177920 00000100:00100000:3.0:1789263910.702512:0:22899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789263910.702517:0:24411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789263910.702525:0:22899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+22:3618:x1876178898177792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789263910.702530:0:24411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882434a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1876178898177920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263910.702544:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd884acd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1876178898178944:0@lo:400:kworker.0 00000100:00100000:0.0:1789263910.702586:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263910.702591:0:22899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+22:3618:x1876178898177792:12345-0@lo:400:kworker.0 Request processed in 63us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263910.702600:0:22899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789263910.702601:0:24411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882434a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1876178898177920:12345-0@lo:400:kworker.0 Request processed in 74us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263910.702610:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789263910.702611:0:24411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789263910.702623:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd884acce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1876178898178560:0@lo:400:kworker.0 00000100:00100000:3.0:1789263910.702635:0:22938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898178176 00000100:00100000:3.0:1789263910.702640:0:22938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898178176 00000100:00100000:1.0:1789263910.702640:0:22905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898178944 00000100:00100000:1.0:1789263910.702646:0:22905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898178944 00000100:00100000:0.0:1789263910.702653:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263910.702672:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd884acdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1876178898179072:0@lo:400:kworker.0 00000100:00100000:3.0:1789263910.702673:0:22938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898178560 00000100:00100000:3.0:1789263910.702678:0:22938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898178560 00000100:00100000:1.0:1789263910.702682:0:22905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789263910.702692:0:22905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882437480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1876178898178176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263910.702702:0:22938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789263910.702706:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263910.702715:0:22938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd884ace300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1876178898178944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789263910.702738:0:22905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882437480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1876178898178176:12345-0@lo:400:kworker.0 Request processed in 36us (282us total) trans 0 rc 0/0 00010000:00080000:0.0:1789263910.702744:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd9bfaac380 x1876178898178176/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263926 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789263910.702745:0:22905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789263910.702757:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1876178898178176:0@lo:400:kworker.0 00000100:00100000:1.0:1789263910.702759:0:22905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898179072 00000100:00100000:1.0:1789263910.702763:0:22905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898179072 00000100:00100000:3.0:1789263910.702770:0:22938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd884ace300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1876178898178944:12345-0@lo:400:kworker.0 Request processed in 57us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263910.702779:0:22938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1789263910.702784:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd884acd180 x1876178898178944/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263926 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789263910.702794:0:22905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789263910.702794:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd884acd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1876178898178944:0@lo:400:kworker.0 00000100:00100000:3.0:1789263910.702801:0:22938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789263910.702806:0:22905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd884acd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1876178898178560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263910.702813:0:22938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd884acdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1876178898179072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263910.702822:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd884acf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3619:1876178898178816:0@lo:400:kworker.0 00000100:00100000:1.0:1789263910.702852:0:22905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd884acd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1876178898178560:12345-0@lo:400:kworker.0 Request processed in 52us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263910.702864:0:22938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd884acdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1876178898179072:12345-0@lo:400:kworker.0 Request processed in 51us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263910.702864:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263910.702870:0:22905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789263910.702889:0:22905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898178816 00000100:00100000:3.0:1789263910.702890:0:22938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789263910.702893:0:22905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898178816 00000100:00100000:0.0:1789263910.702893:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876178898177920:0@lo:400:kworker.0 00000100:00100000:0.0:1789263910.702909:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789263910.702917:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd884acfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1876178898178688:0@lo:400:kworker.0 00000100:00100000:3.0:1789263910.702927:0:22903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789263910.702935:0:22903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd884acd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1876178898178816:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789263910.702944:0:22900:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789263910.702944:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789263910.702949:0:22900:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789263910.702958:0:22938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898178688 00000100:00100000:1.0:1789263910.702961:0:22938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898178688 00000100:00100000:3.0:1789263910.702976:0:22903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd884acd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1876178898178816:12345-0@lo:400:kworker.0 Request processed in 41us (114us total) trans 0 rc 0/0 00010000:00080000:0.0:1789263910.702983:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd884acf800 x1876178898178816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263926 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263910.702984:0:22903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789263910.702995:0:22938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789263910.702998:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd884acf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3619:1876178898178816:0@lo:400:kworker.0 00000100:00100000:1.0:1789263910.703005:0:22938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd884acca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1876178898178688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263910.703029:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec0ec848-5fac-4f6a-ba8a-daed864d309d:3618:1876178898177792:0@lo:400:kworker.0 00000100:00100000:1.0:1789263910.703046:0:22938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd884acca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1876178898178688:12345-0@lo:400:kworker.0 Request processed in 44us (102us total) trans 0 rc 0/0 00010000:00080000:0.0:1789263910.703046:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd884acce00 x1876178898178560/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263926 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789263910.703054:0:22938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789263910.703056:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd884acce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1876178898178560:0@lo:400:kworker.0 00000100:00100000:3.0:1789263910.703061:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1876178898178048:0@lo:8:kworker.0 00010000:00080000:0.0:1789263910.703067:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd884acdf80 x1876178898179072/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263926 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263910.703105:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd884acdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1876178898179072:0@lo:400:kworker.0 00010000:00080000:1.0:1789263910.703106:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd884acfb80 x1876178898178688/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263926 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789263910.703114:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd884acfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1876178898178688:0@lo:400:kworker.0 00000100:00100000:3.0:1789263910.703151:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263910.703173:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfaae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1876178898178304:0@lo:8:kworker.0 00000100:00100000:3.0:1789263910.703195:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263910.703210:0:24409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898178048 00000100:00100000:1.0:1789263910.703216:0:24409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898178048 00000100:00100000:3.0:1789263910.703232:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd884acc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1876178898178432:0@lo:8:kworker.0 00000100:00100000:1.0:1789263910.703240:0:24409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898178304 00000100:00100000:1.0:1789263910.703244:0:24409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898178304 00000100:00100000:3.0:1789263910.703266:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263910.703270:0:24409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789263910.703280:0:24409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88431dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3617:x1876178898178048:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1789263910.703305:0:24409:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 352 last 0 00000100:00100000:3.0:1789263910.703317:0:24411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898178432 00000100:00100000:3.0:1789263910.703322:0:24411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898178432 00000020:00000080:1.0:1789263910.703339:0:24409:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xce1582440fb1fa0c 00000100:00100000:3.0:1789263910.703347:0:24411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00002000:00100000:1.0:1789263910.703352:0:24409:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9dd883ae4800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 1 ocd_group 0 00000100:00100000:3.0:1789263910.703353:0:24411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88431c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3617:x1876178898178304:12345-0@lo:8:kworker.0 00002000:00080000:1.0:1789263910.703358:0:24409:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1789263910.703361:0:24409:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00010000:00080000:3.0:1789263910.703375:0:24411:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 352 last 0 00000020:00000080:3.0:1789263910.703397:0:24411:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xce1582440fb1fa13 00002000:00100000:3.0:1789263910.703406:0:24411:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9dd881feb800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1789263910.703409:0:24411:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:3.0:1789263910.703410:0:24411:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789263910.703457:0:24411:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1789263910.703484:0:24411:0:(import.c:65:import_set_state_nolock()) ffff9dd881fea800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789263910.703537:0:24411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88431c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3617:x1876178898178304:12345-0@lo:8:kworker.0 Request processed in 182us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263910.703544:0:24411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00002000:00080000:1.0:1789263910.703561:0:24409:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:3.0:1789263910.703564:0:24411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789263910.703571:0:24411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88431f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3617:x1876178898178432:12345-0@lo:8:kworker.0 00000100:00080000:1.0:1789263910.703581:0:24409:0:(import.c:65:import_set_state_nolock()) ffff9dd883ae2800 : changing import state from RECOVER to FULL 00010000:00080000:3.0:1789263910.703590:0:24411:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 352 last 0 00000020:00000080:3.0:1789263910.703612:0:24411:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xce1582440fb1fa1a 00002000:00100000:3.0:1789263910.703620:0:24411:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9dd881fec800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 1 ocd_group 1 00000100:00100000:1.0:1789263910.703621:0:24409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88431dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3617:x1876178898178048:12345-0@lo:8:kworker.0 Request processed in 341us (468us total) trans 0 rc 0/0 00002000:00080000:3.0:1789263910.703630:0:24411:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000100:00100000:1.0:1789263910.703632:0:24409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00002000:00100000:3.0:1789263910.703635:0:24411:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789263910.703666:0:24411:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1789263910.703681:0:24411:0:(import.c:65:import_set_state_nolock()) ffff9dd881fef000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789263910.703709:0:24411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88431f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3617:x1876178898178432:12345-0@lo:8:kworker.0 Request processed in 138us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263910.703716:0:24411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1789263910.703758:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd9bfaaed80 x1876178898178048/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789263930 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789263910.703770:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1789263910.703777:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789263910.703783:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1789263910.703785:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd9c088f000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789263910.703801:0:3617:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789263910.703804:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1876178898178048:0@lo:8:kworker.0 00000100:00100000:3.0:1789263910.703815:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789263910.703819:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1789263910.703823:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789263910.703831:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1789263910.703833:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd98850d800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789263910.703842:0:3617:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789263910.703845:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfaae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1876178898178304:0@lo:8:kworker.0 00010000:00080000:3.0:1789263910.703857:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd884acc700 x1876178898178432/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789263925 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263910.703862:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789263910.703865:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1789263910.703867:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789263910.703869:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1789263910.703870:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9dd9862e5800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789263910.703876:0:3617:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789263910.703878:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd884acc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1876178898178432:0@lo:8:kworker.0 00000004:00080000:3.0:1789263910.703907:0:22930:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789263910.703990:0:22930:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 352993912318ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789263910.703999:0:22930:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1789263910.704046:0:23647:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1789263910.704065:0:23647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88431e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23647:1876178898179328:0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1789263910.704124:0:23647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263910.704141:0:23647:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9bf9823c0 going to sleep for 11 seconds 00000004:00080000:3.0:1789263910.704171:0:23649:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1789263910.704186:0:23649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88431d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23649:1876178898179584:0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1789263910.704216:0:23649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263910.704234:0:23649:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9bf982b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789263910.704358:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88431fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898179200:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789263910.704392:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263910.704425:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789263910.704431:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88431c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898179456:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789263910.704453:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263910.704486:0:24414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898179200 00000100:00100000:3.0:1789263910.704489:0:24414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898179200 00000100:00100000:3.0:1789263910.704523:0:24414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898179456 00000100:00100000:3.0:1789263910.704525:0:24414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898179456 00000004:00080000:1.0:1789263910.704530:0:22931:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x22:0x0] 00000100:00100000:3.0:1789263910.704546:0:24414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789263910.704554:0:22931:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882435500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22931:1876178898179840:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1789263910.704559:0:24414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88431ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3618:x1876178898179200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789263910.704583:0:24414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1789263910.704596:0:22931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263910.704620:0:22931:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd983852540 going to sleep for 11 seconds 00000100:00100000:3.0:1789263910.704633:0:24414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88431ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3618:x1876178898179200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (240us total) trans 0 rc 0/0 00000004:00080000:1.0:1789263910.704637:0:23646:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1789263910.704641:0:24414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789263910.704658:0:24414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789263910.704666:0:24414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88431d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3618:x1876178898179456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789263910.704674:0:24414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789263910.704708:0:24414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88431d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3618:x1876178898179456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43us (253us total) trans 0 rc 0/0 00000004:00080000:1.0:1789263910.704710:0:23646:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 352994631586ns, next at 0ns, rc = 0 00000100:00100000:3.0:1789263910.704719:0:24414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00080000:00080000:1.0:1789263910.704719:0:23646:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:1.0:1789263910.704758:0:23648:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00010000:00080000:3.0:1789263910.704775:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd88431c380 x1876178898179456/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789263926 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263910.704793:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88431c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898179456:0@lo:13:osp-pre-1-1.0 00000004:00080000:1.0:1789263910.704798:0:23648:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 352994720159ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789263910.704804:0:23648:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1789263910.704815:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88431fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898179200:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789263910.704865:0:24595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898179328 00000100:00100000:3.0:1789263910.704869:0:24595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898179328 00000100:00100000:3.0:1789263910.704894:0:24595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898179584 00000100:00100000:3.0:1789263910.704903:0:24595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898179584 00000100:00100000:3.0:1789263910.704927:0:24595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898179840 00000100:00100000:3.0:1789263910.704930:0:24595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898179840 00000100:00100000:1.0:1789263910.704948:0:24412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789263910.704959:0:24412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88431f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23647:x1876178898179328:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1789263910.704965:0:24595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789263910.704977:0:24595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88431ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23649:x1876178898179584:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:1.0:1789263910.705140:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789263910.705152:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882435180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898179712:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789263910.705186:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789263910.705220:0:22900:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789263910.705225:0:22900:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789263910.705243:0:24414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898179712 00000100:00100000:1.0:1789263910.705248:0:24414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898179712 00000100:00100000:1.0:1789263910.705283:0:24414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789263910.705291:0:24414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882435880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3621:x1876178898179712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789263910.705302:0:24414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789263910.705347:0:24414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882435880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3621:x1876178898179712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263910.705362:0:24414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789263910.705473:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd882435180 x1876178898179712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789263926 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789263910.705490:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882435180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898179712:0@lo:13:osp-pre-1-0.0 00000004:00080000:2.0:1789263910.706166:0:23638:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000004:00080000:2.0:1789263910.706185:0:23638:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:1.0:1789263910.706433:0:24412:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1789263910.706440:0:24412:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:1.0:1789263910.706496:0:24412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88431f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23647:x1876178898179328:12345-0@lo:7:osp-pre-0-1.0 Request processed in 1538us (2369us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263910.706506:0:24412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789263910.706527:0:24412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789263910.706536:0:24412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882436300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22931:x1876178898179840:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1789263910.706546:0:23647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88431e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23647:1876178898179328:0@lo:7:osp-pre-0-1.0 00000004:00080000:2.0:1789263910.706557:0:23647:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:2.0:1789263910.706595:0:23647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a5f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23647:1876178898179968:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1789263910.706631:0:23647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263910.706654:0:23647:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd98a3b8000 going to sleep for 11 seconds 00000100:00100000:1.0:1789263910.706668:0:24409:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1789263910.706687:0:24409:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:1.0:1789263910.706826:0:24409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898179968 00000100:00100000:1.0:1789263910.706831:0:24409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898179968 00000100:00100000:3.0:1789263910.706931:0:25398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789263910.706942:0:25398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:23647:x1876178898179968:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1789263910.706961:0:25398:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000004:00080000:0.0:1789263910.706982:0:22884:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1789263910.707005:0:25398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:23647:x1876178898179968:12345-0@lo:5:osp-pre-0-1.0 Request processed in 65us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263910.707016:0:25398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789263910.707016:0:23647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a5f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23647:1876178898179968:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1789263910.707038:0:23647:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:2.0:1789263910.707071:0:23647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a5f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23647:1876178898180096:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1789263910.707151:0:23647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263910.707172:0:23647:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd98a3b8000 going to sleep for 11 seconds 00000100:00100000:2.0:1789263910.707190:0:24409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898180096 00000100:00100000:2.0:1789263910.707195:0:24409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898180096 00000100:00100000:2.0:1789263910.707228:0:24409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789263910.707234:0:24411:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 5 min 3 max 116 00000100:00100000:2.0:1789263910.707239:0:24409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23647:x1876178898180096:12345-0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1789263910.707245:0:24411:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_005' 00002000:00080000:2.0:1789263910.707268:0:24409:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00002000:00080000:2.0:1789263910.708046:0:24595:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1789263910.708050:0:24595:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1789263910.708853:0:24595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88431ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23649:x1876178898179584:12345-0@lo:7:osp-pre-1-1.0 Request processed in 3877us (4634us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263910.708863:0:24595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1789263910.709169:0:23649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd88431d880 x1876178898179584/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789263926 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263910.709185:0:23649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88431d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23649:1876178898179584:0@lo:7:osp-pre-1-1.0 00000004:00080000:0.0:1789263910.709198:0:23649:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1789263910.709231:0:23649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd884acdf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23649:1876178898180224:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1789263910.709266:0:23649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263910.709288:0:23649:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9c0be3c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789263910.709308:0:25398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898180224 00000100:00100000:1.0:1789263910.709315:0:25398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898180224 00000100:00100000:1.0:1789263910.709360:0:25398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789263910.709370:0:25398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd884acce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:23649:x1876178898180224:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1789263910.709393:0:25398:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:1.0:1789263910.709582:0:25398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd884acce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:23649:x1876178898180224:12345-0@lo:5:osp-pre-1-1.0 Request processed in 210us (311us total) trans 0 rc 0/0 00010000:00080000:0.0:1789263910.709582:0:23649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd884acdf80 x1876178898180224/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789263926 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789263910.709599:0:25398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789263910.709604:0:23649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd884acdf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23649:1876178898180224:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1789263910.709615:0:23649:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1789263910.709641:0:23649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd884acdf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23649:1876178898180352:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1789263910.709664:0:23649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263910.709683:0:23649:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9c0be3c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789263910.709698:0:25399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898180352 00000100:00100000:1.0:1789263910.709704:0:25399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898180352 00000100:00100000:1.0:1789263910.709744:0:25399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789263910.709752:0:25399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd884acf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+6:23649:x1876178898180352:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1789263910.709758:0:24412:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1789263910.709767:0:24412:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:2.0:1789263910.709773:0:24412:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:65) 00002000:00080000:1.0:1789263910.709773:0:25399:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00000001:00080000:1.0:1789263910.718246:0:24406:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:1.0:1789263910.718265:0:24406:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1789263910.718475:0:24409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:23647:x1876178898180096:12345-0@lo:5:osp-pre-0-1.0 Request processed in 11228us (11312us total) trans 12884901890 rc 0/0 00000100:00100000:0.0:1789263910.718490:0:24409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789263910.718535:0:23647:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901890 gen 2 00000100:00100000:1.0:1789263910.718547:0:23647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a5f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23647:1876178898180096:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1789263910.718567:0:23647:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:1.0:1789263910.718632:0:23647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882435180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23647:1876178898180480:0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1789263910.718704:0:23647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263910.718759:0:23647:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9838526c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789263910.718812:0:22915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898180480 00000100:00100000:2.0:1789263910.718830:0:22915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898180480 00002000:00010000:3.0:1789263910.718876:0:24412:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789263910.718884:0:24412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087b958fa/0xce1582440fb1fa21 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263910.718898:0:22915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1789263910.718903:0:24412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=353s v=(0 0) 00010000:00010000:3.0:1789263910.718908:0:24412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789263910.718913:0:24412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087b958fa/0xce1582440fb1fa21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263910.718915:0:22915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882436680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23647:x1876178898180480:12345-0@lo:900:osp-pre-0-1.0 00010000:00010000:3.0:1789263910.718943:0:24412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087b958fa/0xce1582440fb1fa21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.718952:0:24412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087b958fa/0xce1582440fb1fa21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.718957:0:24412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000087b958fa/0xce1582440fb1fa21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.718982:0:24412:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789263910.719016:0:22915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882436680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23647:x1876178898180480:12345-0@lo:900:osp-pre-0-1.0 Request processed in 101us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263910.719025:0:22915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789263910.719048:0:23647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd882435180 x1876178898180480/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789263926 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263910.719065:0:23647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882435180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23647:1876178898180480:0@lo:900:osp-pre-0-1.0 00010000:00010000:1.0:1789263910.719136:0:22892:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263910.719147:0:22892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000087b958fa/0xce1582440fb1fa21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263910.719158:0:22892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981530600 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263910.719163:0:22892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000087b958fa/0xce1582440fb1fa21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263910.719174:0:22892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000087b958fa/0xce1582440fb1fa21 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263910.719197:0:22892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000087b958fa/0xce1582440fb1fa21 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263910.719205:0:22892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087b958fa/0xce1582440fb1fa21 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263910.719239:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263910.719242:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263910.719245:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789263910.719541:0:24412:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789263910.719548:0:24412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001cccf412/0xce1582440fb1fa28 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.719558:0:24412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=353s v=(0 0) 00010000:00010000:3.0:1789263910.719561:0:24412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789263910.719564:0:24412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001cccf412/0xce1582440fb1fa28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.719572:0:24412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001cccf412/0xce1582440fb1fa28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.719577:0:24412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001cccf412/0xce1582440fb1fa28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.719582:0:24412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001cccf412/0xce1582440fb1fa28 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.719599:0:24412:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789263910.719626:0:22893:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789263910.719634:0:22893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001cccf412/0xce1582440fb1fa28 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.719641:0:22893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981531000 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:0.0:1789263910.719644:0:22893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001cccf412/0xce1582440fb1fa28 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.719649:0:22893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001cccf412/0xce1582440fb1fa28 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.719660:0:22893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001cccf412/0xce1582440fb1fa28 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.719665:0:22893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001cccf412/0xce1582440fb1fa28 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.719678:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263910.719681:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263910.719683:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789263910.719793:0:24412:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789263910.719798:0:24412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d90bc7f6/0xce1582440fb1fa2f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.719805:0:24412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=353s v=(0 0) 00010000:00010000:3.0:1789263910.719812:0:24412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789263910.719815:0:24412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d90bc7f6/0xce1582440fb1fa2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.719823:0:24412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d90bc7f6/0xce1582440fb1fa2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.719828:0:24412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d90bc7f6/0xce1582440fb1fa2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.719833:0:24412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d90bc7f6/0xce1582440fb1fa2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.719847:0:24412:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000001:00080000:1.0:1789263910.719858:0:25224:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:1.0:1789263910.719868:0:25224:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1789263910.719875:0:25224:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1789263910.719879:0:24436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789263910.719886:0:24436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d90bc7f6/0xce1582440fb1fa2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.719895:0:24436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981531200 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:0.0:1789263910.719899:0:24436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d90bc7f6/0xce1582440fb1fa2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.719920:0:24436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d90bc7f6/0xce1582440fb1fa2f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.719937:0:24436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d90bc7f6/0xce1582440fb1fa2f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.719945:0:24436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d90bc7f6/0xce1582440fb1fa2f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.719960:0:24436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263910.719962:0:24436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263910.719963:0:24436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789263910.720035:0:24412:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789263910.720041:0:24412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aea88dc7/0xce1582440fb1fa36 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.720049:0:24412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=353s v=(0 0) 00010000:00010000:3.0:1789263910.720052:0:24412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789263910.720056:0:24412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aea88dc7/0xce1582440fb1fa36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.720067:0:24412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aea88dc7/0xce1582440fb1fa36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263910.720068:0:25399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd884acf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:23649:x1876178898180352:12345-0@lo:5:osp-pre-1-1.0 Request processed in 10316us (10400us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1789263910.720105:0:23649:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:0.0:1789263910.720112:0:23649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd884acdf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23649:1876178898180352:0@lo:5:osp-pre-1-1.0 00010000:00010000:3.0:1789263910.720120:0:24412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aea88dc7/0xce1582440fb1fa36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789263910.720126:0:23649:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:2.0:1789263910.720139:0:25399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:3.0:1789263910.720143:0:24412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aea88dc7/0xce1582440fb1fa36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.720156:0:24412:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789263910.720169:0:22892:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1789263910.720175:0:23649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd884acdf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23649:1876178898180608:0@lo:900:osp-pre-1-1.0 00010000:00010000:1.0:1789263910.720177:0:22892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aea88dc7/0xce1582440fb1fa36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263910.720189:0:22892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981530800 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263910.720194:0:22892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aea88dc7/0xce1582440fb1fa36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263910.720212:0:22892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aea88dc7/0xce1582440fb1fa36 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263910.720223:0:23649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789263910.720229:0:22892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aea88dc7/0xce1582440fb1fa36 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263910.720238:0:22892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aea88dc7/0xce1582440fb1fa36 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263910.720252:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789263910.720253:0:23649:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9c0be3c00 going to sleep for 11 seconds 00010000:00010000:1.0:1789263910.720254:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263910.720257:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789263910.720268:0:22914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898180608 00000100:00100000:2.0:1789263910.720275:0:22914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898180608 00000100:00100000:2.0:1789263910.720309:0:22914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789263910.720318:0:22914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd884acf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23649:x1876178898180608:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1789263910.720366:0:22914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd884acf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23649:x1876178898180608:12345-0@lo:900:osp-pre-1-1.0 Request processed in 50us (147us total) trans 0 rc 0/0 00002000:00010000:3.0:1789263910.720370:0:24412:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:2.0:1789263910.720375:0:22914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1789263910.720380:0:24412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d51fd86/0xce1582440fb1fa3d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1789263910.720386:0:23649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd884acdf80 x1876178898180608/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789263926 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1789263910.720394:0:24412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=353s v=(0 0) 00010000:00010000:3.0:1789263910.720402:0:24412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1789263910.720406:0:23649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd884acdf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23649:1876178898180608:0@lo:900:osp-pre-1-1.0 00010000:00010000:3.0:1789263910.720409:0:24412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d51fd86/0xce1582440fb1fa3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.720420:0:24412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d51fd86/0xce1582440fb1fa3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.720427:0:24412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d51fd86/0xce1582440fb1fa3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.720434:0:24412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d51fd86/0xce1582440fb1fa3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.720448:0:24412:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789263910.720455:0:22893:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789263910.720466:0:22893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d51fd86/0xce1582440fb1fa3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.720487:0:22893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981531600 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:0.0:1789263910.720490:0:22893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d51fd86/0xce1582440fb1fa3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.720495:0:22893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d51fd86/0xce1582440fb1fa3d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.720505:0:22893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d51fd86/0xce1582440fb1fa3d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.720513:0:22893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d51fd86/0xce1582440fb1fa3d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.720528:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263910.720530:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263910.720531:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789263910.720633:0:24412:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789263910.720638:0:24412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002534652b/0xce1582440fb1fa44 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.720647:0:24412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=353s v=(0 0) 00010000:00010000:3.0:1789263910.720649:0:24412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789263910.720652:0:24412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002534652b/0xce1582440fb1fa44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.720658:0:24412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002534652b/0xce1582440fb1fa44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.720663:0:24412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002534652b/0xce1582440fb1fa44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.720667:0:24412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002534652b/0xce1582440fb1fa44 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.720677:0:24412:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789263910.720688:0:24436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789263910.720694:0:24436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002534652b/0xce1582440fb1fa44 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.720701:0:24436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981531a00 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:0.0:1789263910.720705:0:24436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002534652b/0xce1582440fb1fa44 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.720713:0:24436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002534652b/0xce1582440fb1fa44 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.720750:0:24436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002534652b/0xce1582440fb1fa44 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.720758:0:24436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002534652b/0xce1582440fb1fa44 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.720774:0:24436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263910.720776:0:24436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263910.720777:0:24436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789263910.720865:0:24412:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789263910.720870:0:24412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000134eefe8/0xce1582440fb1fa4b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.720877:0:24412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=353s v=(0 0) 00010000:00010000:3.0:1789263910.720880:0:24412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789263910.720884:0:24412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000134eefe8/0xce1582440fb1fa4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.720893:0:24412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000134eefe8/0xce1582440fb1fa4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.720913:0:24412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000134eefe8/0xce1582440fb1fa4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.720917:0:24412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000134eefe8/0xce1582440fb1fa4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.720928:0:24412:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789263910.720945:0:22892:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263910.720951:0:22892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000134eefe8/0xce1582440fb1fa4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263910.720956:0:22892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883e73a00 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263910.720959:0:22892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000134eefe8/0xce1582440fb1fa4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263910.720964:0:22892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000134eefe8/0xce1582440fb1fa4b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263910.720974:0:22892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000134eefe8/0xce1582440fb1fa4b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263910.720978:0:22892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000134eefe8/0xce1582440fb1fa4b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263910.720989:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263910.720990:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263910.720991:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789263910.721134:0:24412:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789263910.721140:0:24412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac12bb8b/0xce1582440fb1fa52 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.721147:0:24412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=353s v=(0 0) 00010000:00010000:3.0:1789263910.721150:0:24412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789263910.721154:0:24412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac12bb8b/0xce1582440fb1fa52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.721164:0:24412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac12bb8b/0xce1582440fb1fa52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.721172:0:24412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac12bb8b/0xce1582440fb1fa52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.721179:0:24412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac12bb8b/0xce1582440fb1fa52 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.721204:0:24412:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789263910.721214:0:22893:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789263910.721221:0:22893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac12bb8b/0xce1582440fb1fa52 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.721230:0:22893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883e73800 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:0.0:1789263910.721233:0:22893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac12bb8b/0xce1582440fb1fa52 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.721244:0:22893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac12bb8b/0xce1582440fb1fa52 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.721257:0:22893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac12bb8b/0xce1582440fb1fa52 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.721264:0:22893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac12bb8b/0xce1582440fb1fa52 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.721291:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263910.721293:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263910.721295:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789263910.721411:0:24412:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789263910.721416:0:24412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e262b0b/0xce1582440fb1fa59 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.721425:0:24412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=353s v=(0 0) 00010000:00010000:3.0:1789263910.721428:0:24412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789263910.721432:0:24412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e262b0b/0xce1582440fb1fa59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.721441:0:24412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e262b0b/0xce1582440fb1fa59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.721448:0:24412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e262b0b/0xce1582440fb1fa59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.721455:0:24412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e262b0b/0xce1582440fb1fa59 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.721470:0:24412:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789263910.721491:0:24436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789263910.721497:0:24436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e262b0b/0xce1582440fb1fa59 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.721505:0:24436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883e72c00 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:0.0:1789263910.721509:0:24436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e262b0b/0xce1582440fb1fa59 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.721518:0:24436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e262b0b/0xce1582440fb1fa59 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.721530:0:24436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e262b0b/0xce1582440fb1fa59 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.721537:0:24436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e262b0b/0xce1582440fb1fa59 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.721550:0:24436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263910.721552:0:24436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263910.721553:0:24436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789263910.721637:0:24412:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789263910.721643:0:24412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d41be70/0xce1582440fb1fa60 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.721651:0:24412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=353s v=(0 0) 00010000:00010000:3.0:1789263910.721660:0:24412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789263910.721664:0:24412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d41be70/0xce1582440fb1fa60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.721674:0:24412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003d41be70/0xce1582440fb1fa60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.721682:0:24412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d41be70/0xce1582440fb1fa60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.721689:0:24412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003d41be70/0xce1582440fb1fa60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.721708:0:24412:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789263910.721745:0:22892:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263910.721752:0:22892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003d41be70/0xce1582440fb1fa60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263910.721761:0:22892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883e73000 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263910.721765:0:22892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003d41be70/0xce1582440fb1fa60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263910.721786:0:22892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003d41be70/0xce1582440fb1fa60 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263910.721799:0:22892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003d41be70/0xce1582440fb1fa60 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263910.721806:0:22892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d41be70/0xce1582440fb1fa60 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263910.721819:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263910.721820:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263910.721822:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789263910.721906:0:24412:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789263910.721912:0:24412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a23b93d/0xce1582440fb1fa67 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.721918:0:24412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=353s v=(0 0) 00010000:00010000:3.0:1789263910.721920:0:24412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789263910.721923:0:24412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a23b93d/0xce1582440fb1fa67 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.721929:0:24412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a23b93d/0xce1582440fb1fa67 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.721936:0:24412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a23b93d/0xce1582440fb1fa67 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.721949:0:24412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002a23b93d/0xce1582440fb1fa67 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.721964:0:24412:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789263910.721984:0:22893:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789263910.721990:0:22893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002a23b93d/0xce1582440fb1fa67 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.722009:0:22893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883e72600 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:0.0:1789263910.722013:0:22893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002a23b93d/0xce1582440fb1fa67 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.722021:0:22893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002a23b93d/0xce1582440fb1fa67 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.722033:0:22893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002a23b93d/0xce1582440fb1fa67 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.722041:0:22893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a23b93d/0xce1582440fb1fa67 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.722055:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263910.722057:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263910.722059:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789263910.722140:0:24412:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789263910.722145:0:24412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000112939d1/0xce1582440fb1fa6e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.722151:0:24412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=353s v=(0 0) 00010000:00010000:3.0:1789263910.722154:0:24412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789263910.722156:0:24412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000112939d1/0xce1582440fb1fa6e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.722162:0:24412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000112939d1/0xce1582440fb1fa6e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.722167:0:24412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000112939d1/0xce1582440fb1fa6e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.722172:0:24412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000112939d1/0xce1582440fb1fa6e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.722182:0:24412:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789263910.722194:0:24436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789263910.722200:0:24436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000112939d1/0xce1582440fb1fa6e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.722207:0:24436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883e73e00 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:0.0:1789263910.722211:0:24436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000112939d1/0xce1582440fb1fa6e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.722218:0:24436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000112939d1/0xce1582440fb1fa6e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.722238:0:24436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000112939d1/0xce1582440fb1fa6e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.722246:0:24436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000112939d1/0xce1582440fb1fa6e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.722261:0:24436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263910.722263:0:24436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263910.722265:0:24436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789263910.722351:0:24412:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789263910.722357:0:24412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d74daa3f/0xce1582440fb1fa75 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.722370:0:24412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=353s v=(0 0) 00010000:00010000:3.0:1789263910.722374:0:24412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789263910.722376:0:24412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d74daa3f/0xce1582440fb1fa75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.722383:0:24412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d74daa3f/0xce1582440fb1fa75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.722388:0:24412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d74daa3f/0xce1582440fb1fa75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.722392:0:24412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d74daa3f/0xce1582440fb1fa75 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.722403:0:24412:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789263910.722426:0:22892:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263910.722433:0:22892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d74daa3f/0xce1582440fb1fa75 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263910.722441:0:22892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883e72e00 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263910.722446:0:22892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d74daa3f/0xce1582440fb1fa75 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263910.722454:0:22892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d74daa3f/0xce1582440fb1fa75 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263910.722466:0:22892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d74daa3f/0xce1582440fb1fa75 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263910.722486:0:22892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d74daa3f/0xce1582440fb1fa75 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263910.722500:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263910.722502:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263910.722503:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789263910.722572:0:24412:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789263910.722576:0:24412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000862ac085/0xce1582440fb1fa7c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.722581:0:24412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=353s v=(0 0) 00010000:00010000:3.0:1789263910.722582:0:24412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789263910.722585:0:24412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000862ac085/0xce1582440fb1fa7c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.722590:0:24412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000862ac085/0xce1582440fb1fa7c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.722603:0:24412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000862ac085/0xce1582440fb1fa7c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.722607:0:24412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000862ac085/0xce1582440fb1fa7c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.722619:0:24412:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789263910.722639:0:22893:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789263910.722644:0:22893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000862ac085/0xce1582440fb1fa7c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.722651:0:22893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883e72a00 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:0.0:1789263910.722654:0:22893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000862ac085/0xce1582440fb1fa7c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.722660:0:22893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000862ac085/0xce1582440fb1fa7c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.722668:0:22893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000862ac085/0xce1582440fb1fa7c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.722674:0:22893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000862ac085/0xce1582440fb1fa7c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.722700:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263910.722702:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263910.722704:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789263910.722801:0:24412:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789263910.722807:0:24412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb54b328/0xce1582440fb1fa83 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.722815:0:24412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=353s v=(0 0) 00010000:00010000:3.0:1789263910.722817:0:24412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789263910.722822:0:24412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb54b328/0xce1582440fb1fa83 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.722831:0:24412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb54b328/0xce1582440fb1fa83 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.722839:0:24412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb54b328/0xce1582440fb1fa83 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.722845:0:24412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cb54b328/0xce1582440fb1fa83 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.722865:0:24412:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789263910.722883:0:24436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789263910.722889:0:24436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cb54b328/0xce1582440fb1fa83 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.722894:0:24436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883e73c00 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:0.0:1789263910.722897:0:24436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb54b328/0xce1582440fb1fa83 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.722902:0:24436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb54b328/0xce1582440fb1fa83 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.722910:0:24436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cb54b328/0xce1582440fb1fa83 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.722915:0:24436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb54b328/0xce1582440fb1fa83 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.722925:0:24436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263910.722927:0:24436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263910.722928:0:24436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789263910.723109:0:24412:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789263910.723114:0:24412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cd40203/0xce1582440fb1fa8a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.723121:0:24412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=353s v=(0 0) 00010000:00010000:3.0:1789263910.723123:0:24412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789263910.723126:0:24412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007cd40203/0xce1582440fb1fa8a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.723133:0:24412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007cd40203/0xce1582440fb1fa8a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.723140:0:24412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cd40203/0xce1582440fb1fa8a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.723147:0:24412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007cd40203/0xce1582440fb1fa8a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.723164:0:24412:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789263910.723183:0:22892:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263910.723189:0:22892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007cd40203/0xce1582440fb1fa8a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263910.723205:0:22892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883e73200 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263910.723209:0:22892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007cd40203/0xce1582440fb1fa8a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263910.723217:0:22892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007cd40203/0xce1582440fb1fa8a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263910.723230:0:22892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007cd40203/0xce1582440fb1fa8a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263910.723237:0:22892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007cd40203/0xce1582440fb1fa8a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263910.723252:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263910.723253:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263910.723255:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789263910.723380:0:24412:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789263910.723384:0:24412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf0df8e8/0xce1582440fb1fa91 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.723389:0:24412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=353s v=(0 0) 00010000:00010000:3.0:1789263910.723395:0:24412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789263910.723399:0:24412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf0df8e8/0xce1582440fb1fa91 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.723408:0:24412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf0df8e8/0xce1582440fb1fa91 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.723415:0:24412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf0df8e8/0xce1582440fb1fa91 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.723421:0:24412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bf0df8e8/0xce1582440fb1fa91 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.723439:0:24412:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789263910.723462:0:22893:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789263910.723468:0:22893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bf0df8e8/0xce1582440fb1fa91 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.723485:0:22893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883e72400 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:0.0:1789263910.723487:0:22893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf0df8e8/0xce1582440fb1fa91 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.723493:0:22893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf0df8e8/0xce1582440fb1fa91 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.723503:0:22893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bf0df8e8/0xce1582440fb1fa91 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.723508:0:22893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf0df8e8/0xce1582440fb1fa91 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.723517:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263910.723518:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263910.723519:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789263910.723643:0:24412:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789263910.723648:0:24412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083027e70/0xce1582440fb1fa98 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.723656:0:24412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=353s v=(0 0) 00010000:00010000:3.0:1789263910.723659:0:24412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789263910.723663:0:24412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083027e70/0xce1582440fb1fa98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.723673:0:24412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083027e70/0xce1582440fb1fa98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.723682:0:24412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083027e70/0xce1582440fb1fa98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.723696:0:24412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000083027e70/0xce1582440fb1fa98 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.723715:0:24412:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789263910.723746:0:24436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789263910.723753:0:24436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000083027e70/0xce1582440fb1fa98 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.723762:0:24436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883e73600 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:0.0:1789263910.723766:0:24436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000083027e70/0xce1582440fb1fa98 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.723775:0:24436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000083027e70/0xce1582440fb1fa98 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.723789:0:24436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000083027e70/0xce1582440fb1fa98 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.723794:0:24436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083027e70/0xce1582440fb1fa98 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.723805:0:24436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263910.723807:0:24436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263910.723809:0:24436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789263910.723916:0:24412:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789263910.723922:0:24412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cf4e937/0xce1582440fb1fa9f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.723931:0:24412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=353s v=(0 0) 00010000:00010000:3.0:1789263910.723934:0:24412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789263910.723939:0:24412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004cf4e937/0xce1582440fb1fa9f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.723947:0:24412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004cf4e937/0xce1582440fb1fa9f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.723956:0:24412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cf4e937/0xce1582440fb1fa9f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.723963:0:24412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004cf4e937/0xce1582440fb1fa9f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.723977:0:24412:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789263910.724004:0:22892:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263910.724010:0:22892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004cf4e937/0xce1582440fb1fa9f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263910.724017:0:22892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883e72000 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263910.724021:0:22892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004cf4e937/0xce1582440fb1fa9f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263910.724029:0:22892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004cf4e937/0xce1582440fb1fa9f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263910.724040:0:22892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004cf4e937/0xce1582440fb1fa9f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263910.724048:0:22892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004cf4e937/0xce1582440fb1fa9f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263910.724061:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263910.724063:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263910.724064:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789263910.725617:0:24412:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789263910.725628:0:24412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff3deb5b/0xce1582440fb1faa6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.725645:0:24412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=353s v=(0 0) 00010000:00010000:3.0:1789263910.725647:0:24412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789263910.725650:0:24412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff3deb5b/0xce1582440fb1faa6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.725659:0:24412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ff3deb5b/0xce1582440fb1faa6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.725667:0:24412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff3deb5b/0xce1582440fb1faa6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.725675:0:24412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ff3deb5b/0xce1582440fb1faa6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.725691:0:24412:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789263910.725774:0:22893:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789263910.725790:0:22893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ff3deb5b/0xce1582440fb1faa6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.725799:0:22893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883e73400 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:0.0:1789263910.725802:0:22893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff3deb5b/0xce1582440fb1faa6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.725808:0:22893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff3deb5b/0xce1582440fb1faa6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.725820:0:22893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ff3deb5b/0xce1582440fb1faa6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.725825:0:22893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff3deb5b/0xce1582440fb1faa6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.725849:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263910.725852:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263910.725854:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789263910.726036:0:24412:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789263910.726045:0:24412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000926f9a9d/0xce1582440fb1faad lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.726053:0:24412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=353s v=(0 0) 00010000:00010000:3.0:1789263910.726057:0:24412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789263910.726061:0:24412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000926f9a9d/0xce1582440fb1faad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.726071:0:24412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000926f9a9d/0xce1582440fb1faad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.726111:0:24412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000926f9a9d/0xce1582440fb1faad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.726119:0:24412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000926f9a9d/0xce1582440fb1faad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.726133:0:24412:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789263910.726142:0:24436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789263910.726148:0:24436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000926f9a9d/0xce1582440fb1faad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.726158:0:24436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883e72200 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:0.0:1789263910.726162:0:24436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000926f9a9d/0xce1582440fb1faad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.726171:0:24436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000926f9a9d/0xce1582440fb1faad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.726183:0:24436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000926f9a9d/0xce1582440fb1faad lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.726191:0:24436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000926f9a9d/0xce1582440fb1faad lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.726207:0:24436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263910.726209:0:24436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263910.726211:0:24436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789263910.726369:0:24412:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789263910.726375:0:24412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2b5897a/0xce1582440fb1fab4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.726383:0:24412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=353s v=(0 0) 00010000:00010000:3.0:1789263910.726387:0:24412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789263910.726391:0:24412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b5897a/0xce1582440fb1fab4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.726400:0:24412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2b5897a/0xce1582440fb1fab4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.726418:0:24412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2b5897a/0xce1582440fb1fab4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.726426:0:24412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b5897a/0xce1582440fb1fab4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.726452:0:24412:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789263910.726469:0:22892:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263910.726474:0:22892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2b5897a/0xce1582440fb1fab4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263910.726480:0:22892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883e72800 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263910.726483:0:22892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b5897a/0xce1582440fb1fab4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263910.726498:0:22892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b5897a/0xce1582440fb1fab4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263910.726506:0:22892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2b5897a/0xce1582440fb1fab4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263910.726512:0:22892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2b5897a/0xce1582440fb1fab4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263910.726523:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263910.726524:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263910.726525:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789263910.726717:0:24412:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789263910.726740:0:24412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a23b93d/0xce1582440fb1fabb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.726749:0:24412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=353s v=(0 0) 00010000:00010000:3.0:1789263910.726752:0:24412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789263910.726756:0:24412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a23b93d/0xce1582440fb1fabb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.726766:0:24412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a23b93d/0xce1582440fb1fabb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.726774:0:24412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a23b93d/0xce1582440fb1fabb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.726782:0:24412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002a23b93d/0xce1582440fb1fabb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.726796:0:24412:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789263910.726819:0:22893:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789263910.726823:0:22893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002a23b93d/0xce1582440fb1fabb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.726840:0:22893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883e72600 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:0.0:1789263910.726844:0:22893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002a23b93d/0xce1582440fb1fabb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.726851:0:22893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002a23b93d/0xce1582440fb1fabb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.726862:0:22893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002a23b93d/0xce1582440fb1fabb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.726869:0:22893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a23b93d/0xce1582440fb1fabb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.726883:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263910.726884:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263910.726886:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789263910.726992:0:24412:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789263910.726996:0:24412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e262b0b/0xce1582440fb1fac2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.727002:0:24412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=353s v=(0 0) 00010000:00010000:3.0:1789263910.727010:0:24412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789263910.727014:0:24412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e262b0b/0xce1582440fb1fac2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.727024:0:24412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e262b0b/0xce1582440fb1fac2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.727031:0:24412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e262b0b/0xce1582440fb1fac2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.727039:0:24412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e262b0b/0xce1582440fb1fac2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.727054:0:24412:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789263910.727098:0:24436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789263910.727105:0:24436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e262b0b/0xce1582440fb1fac2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.727114:0:24436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883e72c00 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:0.0:1789263910.727118:0:24436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e262b0b/0xce1582440fb1fac2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.727126:0:24436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e262b0b/0xce1582440fb1fac2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.727142:0:24436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e262b0b/0xce1582440fb1fac2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.727147:0:24436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e262b0b/0xce1582440fb1fac2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.727159:0:24436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263910.727160:0:24436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263910.727161:0:24436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789263910.727269:0:24412:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789263910.727274:0:24412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac12bb8b/0xce1582440fb1fac9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.727279:0:24412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=353s v=(0 0) 00010000:00010000:3.0:1789263910.727281:0:24412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789263910.727284:0:24412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac12bb8b/0xce1582440fb1fac9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.727290:0:24412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac12bb8b/0xce1582440fb1fac9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.727294:0:24412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac12bb8b/0xce1582440fb1fac9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.727303:0:24412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac12bb8b/0xce1582440fb1fac9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.727315:0:24412:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789263910.727336:0:22892:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263910.727342:0:22892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac12bb8b/0xce1582440fb1fac9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263910.727349:0:22892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883e73800 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263910.727352:0:22892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac12bb8b/0xce1582440fb1fac9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263910.727357:0:22892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac12bb8b/0xce1582440fb1fac9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263910.727367:0:22892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac12bb8b/0xce1582440fb1fac9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263910.727387:0:22892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac12bb8b/0xce1582440fb1fac9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263910.727402:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263910.727404:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263910.727405:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789263910.727492:0:24412:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789263910.727497:0:24412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000134eefe8/0xce1582440fb1fad0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.727505:0:24412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=353s v=(0 0) 00010000:00010000:3.0:1789263910.727508:0:24412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789263910.727512:0:24412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000134eefe8/0xce1582440fb1fad0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.727520:0:24412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000134eefe8/0xce1582440fb1fad0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.727525:0:24412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000134eefe8/0xce1582440fb1fad0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.727529:0:24412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000134eefe8/0xce1582440fb1fad0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.727541:0:24412:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789263910.727563:0:22893:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789263910.727568:0:22893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000134eefe8/0xce1582440fb1fad0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.727576:0:22893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883e73a00 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:0.0:1789263910.727579:0:22893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000134eefe8/0xce1582440fb1fad0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.727587:0:22893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000134eefe8/0xce1582440fb1fad0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.727599:0:22893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000134eefe8/0xce1582440fb1fad0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.727606:0:22893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000134eefe8/0xce1582440fb1fad0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.727630:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263910.727632:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263910.727634:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789263910.727704:0:24412:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789263910.727708:0:24412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c4cb8bd/0xce1582440fb1fad7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.727717:0:24412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=353s v=(0 0) 00010000:00010000:3.0:1789263910.727719:0:24412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789263910.727722:0:24412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c4cb8bd/0xce1582440fb1fad7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.727758:0:24412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c4cb8bd/0xce1582440fb1fad7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.727763:0:24412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c4cb8bd/0xce1582440fb1fad7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.727768:0:24412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c4cb8bd/0xce1582440fb1fad7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.727819:0:24412:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789263910.727820:0:24436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789263910.727824:0:24436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c4cb8bd/0xce1582440fb1fad7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.727831:0:24436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd990432400 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:0.0:1789263910.727835:0:24436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c4cb8bd/0xce1582440fb1fad7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.727842:0:24436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c4cb8bd/0xce1582440fb1fad7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.727853:0:24436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c4cb8bd/0xce1582440fb1fad7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.727860:0:24436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c4cb8bd/0xce1582440fb1fad7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.727873:0:24436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263910.727875:0:24436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263910.727876:0:24436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789263910.728026:0:24412:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789263910.728032:0:24412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099154c8f/0xce1582440fb1fade lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.728040:0:24412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=353s v=(0 0) 00010000:00010000:3.0:1789263910.728043:0:24412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789263910.728047:0:24412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099154c8f/0xce1582440fb1fade lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.728055:0:24412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099154c8f/0xce1582440fb1fade lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.728073:0:24412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099154c8f/0xce1582440fb1fade lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.728100:0:24412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000099154c8f/0xce1582440fb1fade lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.728114:0:24412:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789263910.728134:0:22892:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263910.728141:0:22892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000099154c8f/0xce1582440fb1fade lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263910.728149:0:22892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd990433c00 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263910.728152:0:22892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000099154c8f/0xce1582440fb1fade lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263910.728162:0:22892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000099154c8f/0xce1582440fb1fade lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263910.728173:0:22892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000099154c8f/0xce1582440fb1fade lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263910.728184:0:22892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099154c8f/0xce1582440fb1fade lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263910.728197:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263910.728199:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263910.728200:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789263910.728311:0:24412:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789263910.728315:0:24412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000edd439af/0xce1582440fb1fae5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.728320:0:24412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=353s v=(0 0) 00010000:00010000:3.0:1789263910.728322:0:24412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789263910.728325:0:24412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000edd439af/0xce1582440fb1fae5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.728331:0:24412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000edd439af/0xce1582440fb1fae5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.728335:0:24412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000edd439af/0xce1582440fb1fae5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.728340:0:24412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000edd439af/0xce1582440fb1fae5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.728358:0:24412:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789263910.728525:0:22893:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789263910.728531:0:22893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000edd439af/0xce1582440fb1fae5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.728551:0:22893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd990432e00 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:0.0:1789263910.728555:0:22893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000edd439af/0xce1582440fb1fae5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789263910.728557:0:24412:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789263910.728569:0:24412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000819f5dce/0xce1582440fb1faec lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.728570:0:22893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000edd439af/0xce1582440fb1fae5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.728592:0:24412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=353s v=(0 0) 00010000:00010000:3.0:1789263910.728597:0:24412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789263910.728598:0:22893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000edd439af/0xce1582440fb1fae5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.728601:0:24412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000819f5dce/0xce1582440fb1faec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.728613:0:22893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000edd439af/0xce1582440fb1fae5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.728619:0:24412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000819f5dce/0xce1582440fb1faec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.728629:0:24412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000819f5dce/0xce1582440fb1faec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.728632:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263910.728636:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263910.728638:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789263910.728639:0:24412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000819f5dce/0xce1582440fb1faec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.728656:0:24412:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789263910.728661:0:24436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789263910.728665:0:24436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000819f5dce/0xce1582440fb1faec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.728670:0:24436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd990432000 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:0.0:1789263910.728674:0:24436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000819f5dce/0xce1582440fb1faec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.728689:0:24436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000819f5dce/0xce1582440fb1faec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.728709:0:24436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000819f5dce/0xce1582440fb1faec lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.728717:0:24436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000819f5dce/0xce1582440fb1faec lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.728743:0:24436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263910.728745:0:24436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263910.728747:0:24436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789263910.728901:0:24412:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789263910.728907:0:24412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db67ccb7/0xce1582440fb1faf3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.728915:0:24412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=353s v=(0 0) 00010000:00010000:3.0:1789263910.728923:0:24412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789263910.728928:0:24412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db67ccb7/0xce1582440fb1faf3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.728938:0:24412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000db67ccb7/0xce1582440fb1faf3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.728945:0:24412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db67ccb7/0xce1582440fb1faf3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.728952:0:24412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000db67ccb7/0xce1582440fb1faf3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263910.728968:0:24412:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789263910.728989:0:22892:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263910.728995:0:22892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000db67ccb7/0xce1582440fb1faf3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1789263910.728997:0:24412:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:34 00010000:00010000:1.0:1789263910.729006:0:22892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd990433400 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:1.0:1789263910.729010:0:22892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000db67ccb7/0xce1582440fb1faf3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263910.729019:0:22892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000db67ccb7/0xce1582440fb1faf3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263910.729031:0:22892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000db67ccb7/0xce1582440fb1faf3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263910.729046:0:22892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000db67ccb7/0xce1582440fb1faf3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263910.729064:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263910.729066:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263910.729068:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789263910.729178:0:24412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882436300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:22931:x1876178898179840:12345-0@lo:5:osp-pre-1-0.0 Request processed in 22640us (24580us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263910.729187:0:24412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789263910.729263:0:22931:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882435500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22931:1876178898179840:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1789263910.729279:0:22931:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x22:0x0] 00000100:00100000:2.0:1789263910.729315:0:22931:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22931:1876178898180736:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1789263910.729346:0:22931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263910.729405:0:22931:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd98a3b8000 going to sleep for 11 seconds 00000100:00100000:3.0:1789263910.729438:0:24411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898180736 00000100:00100000:3.0:1789263910.729444:0:24411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898180736 00000100:00100000:3.0:1789263910.729499:0:24411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789263910.729509:0:24411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:22931:x1876178898180736:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1789263910.729541:0:24411:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00000100:00100000:3.0:1789263910.731295:0:24411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22931:x1876178898180736:12345-0@lo:5:osp-pre-1-0.0 Request processed in 1786us (1945us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1789263910.731304:0:24411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789263910.731324:0:22931:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22931:1876178898180736:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1789263910.731338:0:22931:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 10000000:01000000:1.0:1789263910.894157:0:22901:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789263910.894163:0:22901:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9dd883f8c000 from 14 10000000:01000000:1.0:1789263910.894169:0:22901:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789263910.894212:0:22901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd8841a3200/0xce1582440fb1fafa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263910.894224:0:22901:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd8841a3200/0xce1582440fb1fafa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263910.894246:0:22901:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd8841a3200/0xce1582440fb1fafa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263910.894277:0:22901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882436a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22901:1876178898180864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789263910.894348:0:22901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263910.894390:0:22901:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd884041240 going to sleep for 11 seconds 00000100:00100000:2.0:1789263910.894394:0:22898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898180864 00000100:00100000:2.0:1789263910.894403:0:22898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898180864 00000100:00100000:2.0:1789263910.894464:0:22898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789263910.894474:0:22898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec0ec848-5fac-4f6a-ba8a-daed864d309d+22:22901:x1876178898180864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789263910.894488:0:22898:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263910.894501:0:22898:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd9bfa23a00/0xce1582440fb1fb01 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1fafa expref: -99 pid: 22898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263910.894523:0:22898:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd9bfa23a00/0xce1582440fb1fb01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1fafa expref: 23 pid: 22898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263910.894534:0:22898:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd9bfa23a00/0xce1582440fb1fb01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1fafa expref: 23 pid: 22898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263910.894541:0:22898:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bfa23a00, rc 0) 00000100:00100000:2.0:1789263910.894578:0:22898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec0ec848-5fac-4f6a-ba8a-daed864d309d+23:22901:x1876178898180864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263910.894583:0:22898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789263910.894616:0:22901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882436a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22901:1876178898180864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789263910.894634:0:22901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd8841a3200/0xce1582440fb1fafa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1fb01 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263910.894643:0:22901:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd8841a3200/0xce1582440fb1fafa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1fb01 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263910.894691:0:22901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882436a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22901:1876178898180992:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789263910.894720:0:22901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263910.894756:0:22901:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd884041240 going to sleep for 11 seconds 00000100:00100000:0.0:1789263910.894774:0:22896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898180992 00000100:00100000:0.0:1789263910.894780:0:22896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898180992 00000100:00100000:0.0:1789263910.894812:0:22896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789263910.894820:0:22896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+23:22901:x1876178898180992:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789263910.894834:0:22896:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789263910.894858:0:22896:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789263910.894862:0:22896:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:0.0:1789263910.894967:0:22896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+23:22901:x1876178898180992:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 149us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263910.894976:0:22896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789263910.894994:0:22901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882436a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22901:1876178898180992:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789263910.895037:0:22901:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789263910.895044:0:22901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd8841a3200/0xce1582440fb1fafa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1fb01 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263910.895052:0:22901:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd8841a3200/0xce1582440fb1fafa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1fb01 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789263910.895061:0:22901:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789263910.895063:0:22901:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9dd9ac8fd000 from 14 10000000:01000000:1.0:1789263910.895071:0:22901:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789263910.895111:0:22901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd8841a3000/0xce1582440fb1fb08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263910.895117:0:22901:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd8841a3000/0xce1582440fb1fb08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263910.895122:0:22901:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd8841a3000/0xce1582440fb1fb08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263910.895132:0:22901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882436a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22901:1876178898181120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789263910.895155:0:22901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263910.895179:0:22901:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd884041240 going to sleep for 11 seconds 00000100:00100000:0.0:1789263910.895190:0:22898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898181120 00000100:00100000:0.0:1789263910.895195:0:22898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898181120 00000100:00100000:0.0:1789263910.895223:0:22898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789263910.895230:0:22898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98738ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec0ec848-5fac-4f6a-ba8a-daed864d309d+23:22901:x1876178898181120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789263910.895237:0:22898:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263910.895245:0:22898:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd9abf3aa00/0xce1582440fb1fb0f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1fb08 expref: -99 pid: 22898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.895270:0:22898:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd9abf3aa00/0xce1582440fb1fb0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1fb08 expref: 24 pid: 22898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.895278:0:22898:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd9abf3aa00/0xce1582440fb1fb0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1fb08 expref: 24 pid: 22898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263910.895285:0:22898:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9abf3aa00, rc 0) 00000100:00100000:0.0:1789263910.895319:0:22898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98738ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec0ec848-5fac-4f6a-ba8a-daed864d309d+24:22901:x1876178898181120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263910.895327:0:22901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882436a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22901:1876178898181120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789263910.895328:0:22898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00010000:00010000:1.0:1789263910.895339:0:22901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd8841a3000/0xce1582440fb1fb08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1fb0f expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263910.895348:0:22901:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd8841a3000/0xce1582440fb1fb08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1fb0f expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263910.895392:0:22901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882436a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22901:1876178898181248:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789263910.895419:0:22901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263910.895440:0:22901:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd884041240 going to sleep for 11 seconds 00000100:00100000:0.0:1789263910.895484:0:22896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898181248 00000100:00100000:0.0:1789263910.895489:0:22896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898181248 00000100:00100000:0.0:1789263910.895518:0:22896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789263910.895526:0:22896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98738e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+24:22901:x1876178898181248:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789263910.895536:0:22896:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789263910.895551:0:22896:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789263910.895555:0:22896:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:0.0:1789263910.895614:0:22896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98738e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+24:22901:x1876178898181248:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 91us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263910.895619:0:22896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789263910.895697:0:22901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882436a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22901:1876178898181248:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789263910.895755:0:22901:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789263910.895762:0:22901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd8841a3000/0xce1582440fb1fb08 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1fb0f expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263910.895771:0:22901:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd8841a3000/0xce1582440fb1fb08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1fb0f expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263910.957304:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882434000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898181376:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789263910.957365:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263910.957421:0:24414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898181376 00000100:00100000:1.0:1789263910.957430:0:24414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898181376 00000100:00100000:1.0:1789263910.957475:0:24414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789263910.957481:0:24414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1876178898181376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789263910.957500:0:24414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1789263910.957555:0:24414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1876178898181376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263910.957560:0:24414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789263910.957603:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882434000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898181376:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1789263911.021620:0:23664:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789263911.278165:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789263911.832775:0:25582:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg320-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000020:00000004:3.0:1789263912.187706:0:25634:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789263912.187914:0:25634:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789263912.302160:0:24436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789263912.543541:0:25684:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789263912.543690:0:25684:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789263912.684267:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263912.685734:0:22898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888706560 00000100:00100000:2.0:1789263912.685745:0:22898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888706560 00000100:00100000:2.0:1789263912.685790:0:22898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 106 00000100:00100000:2.0:1789263912.685798:0:22898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98738cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2396:x1876178888706560:12345-192.168.203.20@tcp:250:mount.lustre.0 00010000:00080000:2.0:1789263912.685826:0:22898:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 71777701-7db4-46a4-b468-7d1ca0b29a68@192.168.203.20@tcp t0 exp 0000000000000000 cur 354 last 0 00000020:00000080:2.0:1789263912.685852:0:22898:0:(genops.c:1385:class_connect()) connect: client 71777701-7db4-46a4-b468-7d1ca0b29a68, cookie 0xce1582440fb1fb16 00000100:00080000:2.0:1789263912.685986:0:22898:0:(import.c:65:import_set_state_nolock()) ffff9dd882898800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789263912.686057:0:22898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98738cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71777701-7db4-46a4-b468-7d1ca0b29a68+5:2396:x1876178888706560:12345-192.168.203.20@tcp:250:mount.lustre.0 Request processed in 258us (1798us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263912.686065:0:22898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 106 00000100:00100000:3.0:1789263912.687246:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263912.687297:0:22899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888706688 00000100:00100000:1.0:1789263912.687304:0:22899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888706688 00000100:00100000:1.0:1789263912.687344:0:22899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 107 00000100:00100000:1.0:1789263912.687353:0:22899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98738e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71777701-7db4-46a4-b468-7d1ca0b29a68+5:18224:x1876178888706688:12345-192.168.203.20@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789263912.687364:0:22899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263912.687378:0:22899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd8841a2000/0xce1582440fb1fb1d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b612752c1d12322 expref: -99 pid: 22899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263912.687400:0:22899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd8841a2000/0xce1582440fb1fb1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12322 expref: 6 pid: 22899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263912.687411:0:22899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd8841a2000/0xce1582440fb1fb1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12322 expref: 6 pid: 22899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263912.687420:0:22899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd8841a2000, rc 0) 00000100:00100000:1.0:1789263912.687463:0:22899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98738e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71777701-7db4-46a4-b468-7d1ca0b29a68+6:18224:x1876178888706688:12345-192.168.203.20@tcp:101:mount.lustre.0 Request processed in 110us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263912.687470:0:22899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 107 00000100:00100000:0.0:1789263912.688688:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263912.688769:0:22898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888706816 00000100:00100000:2.0:1789263912.688775:0:22898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888706816 00000100:00100000:2.0:1789263912.688846:0:22898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 108 00000100:00100000:2.0:1789263912.688855:0:22898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98738fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71777701-7db4-46a4-b468-7d1ca0b29a68+6:18224:x1876178888706816:12345-192.168.203.20@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789263912.688942:0:22898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98738fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71777701-7db4-46a4-b468-7d1ca0b29a68+6:18224:x1876178888706816:12345-192.168.203.20@tcp:501:mount.lustre.0 Request processed in 87us (255us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789263912.688950:0:22898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 108 00000100:00100000:3.0:1789263912.690099:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263912.690785:0:22899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888706944 00000100:00100000:1.0:1789263912.690793:0:22899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888706944 00000100:00100000:1.0:1789263912.690836:0:22899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 109 00000100:00100000:1.0:1789263912.690845:0:22899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98738c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71777701-7db4-46a4-b468-7d1ca0b29a68+6:18224:x1876178888706944:12345-192.168.203.20@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789263912.690856:0:22899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263912.690872:0:22899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd8841a2400/0xce1582440fb1fb24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b612752c1d12329 expref: -99 pid: 22899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263912.690911:0:22899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd8841a2400/0xce1582440fb1fb24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12329 expref: 7 pid: 22899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263912.690923:0:22899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd8841a2400/0xce1582440fb1fb24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12329 expref: 7 pid: 22899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263912.690931:0:22899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd8841a2400, rc 0) 00000100:00100000:1.0:1789263912.690972:0:22899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98738c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71777701-7db4-46a4-b468-7d1ca0b29a68+7:18224:x1876178888706944:12345-192.168.203.20@tcp:101:mount.lustre.0 Request processed in 128us (874us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263912.690980:0:22899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 109 00000100:00100000:3.0:1789263912.692873:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263912.693201:0:22898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888707072 00000100:00100000:2.0:1789263912.693208:0:22898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888707072 00000100:00100000:2.0:1789263912.693235:0:22898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 110 00000100:00100000:2.0:1789263912.693241:0:22898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98738e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71777701-7db4-46a4-b468-7d1ca0b29a68+7:18224:x1876178888707072:12345-192.168.203.20@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789263912.693335:0:22898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98738e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71777701-7db4-46a4-b468-7d1ca0b29a68+8:18224:x1876178888707072:12345-192.168.203.20@tcp:501:mount.lustre.0 Request processed in 94us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263912.693347:0:22898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 110 00000100:00100000:0.0:1789263912.694420:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263912.694493:0:22899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888707200 00000100:00100000:1.0:1789263912.694497:0:22899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888707200 00000100:00100000:1.0:1789263912.694543:0:22899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 111 00000100:00100000:1.0:1789263912.694548:0:22899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98738c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71777701-7db4-46a4-b468-7d1ca0b29a68+8:18224:x1876178888707200:12345-192.168.203.20@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789263912.694655:0:22899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98738c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71777701-7db4-46a4-b468-7d1ca0b29a68+8:18224:x1876178888707200:12345-192.168.203.20@tcp:503:mount.lustre.0 Request processed in 105us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263912.694662:0:22899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 111 00000100:00100000:3.0:1789263912.696451:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263912.696486:0:22898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888707328 00000100:00100000:2.0:1789263912.696493:0:22898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888707328 00000100:00100000:2.0:1789263912.696531:0:22898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 112 00000100:00100000:2.0:1789263912.696538:0:22898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98738c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71777701-7db4-46a4-b468-7d1ca0b29a68+8:18242:x1876178888707328:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789263912.696639:0:22898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98738c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71777701-7db4-46a4-b468-7d1ca0b29a68+8:18242:x1876178888707328:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 100us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263912.696646:0:22898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 112 00000100:00100000:3.0:1789263912.720164:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263912.720297:0:22899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888707456 00000100:00100000:1.0:1789263912.720306:0:22899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888707456 00000100:00100000:1.0:1789263912.720364:0:22899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 113 00000100:00100000:1.0:1789263912.720375:0:22899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98738f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71777701-7db4-46a4-b468-7d1ca0b29a68+8:18242:x1876178888707456:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789263912.720521:0:22899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98738f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71777701-7db4-46a4-b468-7d1ca0b29a68+8:18242:x1876178888707456:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 147us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263912.720529:0:22899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 113 00000100:00100000:0.0:1789263912.725228:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263912.725377:0:22898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888707584 00000100:00100000:2.0:1789263912.725388:0:22898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888707584 00000100:00100000:2.0:1789263912.725449:0:22898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 114 00000100:00100000:2.0:1789263912.725459:0:22898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98738d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71777701-7db4-46a4-b468-7d1ca0b29a68+8:18242:x1876178888707584:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789263912.725601:0:22898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98738d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71777701-7db4-46a4-b468-7d1ca0b29a68+8:18242:x1876178888707584:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 143us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263912.725609:0:22898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 114 00000100:00100000:3.0:1789263912.726579:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263912.726695:0:22899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888707712 00000100:00100000:1.0:1789263912.726706:0:22899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888707712 00000100:00100000:1.0:1789263912.726753:0:22899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 115 00000100:00100000:1.0:1789263912.726759:0:22899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98738f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71777701-7db4-46a4-b468-7d1ca0b29a68+8:18224:x1876178888707712:12345-192.168.203.20@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789263912.726768:0:22899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263912.726781:0:22899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd8841a2200/0xce1582440fb1fb2b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b612752c1d1235a expref: -99 pid: 22899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263912.726801:0:22899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd8841a2200/0xce1582440fb1fb2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1235a expref: 9 pid: 22899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263912.726808:0:22899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd8841a2200/0xce1582440fb1fb2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1235a expref: 9 pid: 22899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263912.726815:0:22899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd8841a2200, rc 0) 00000100:00100000:1.0:1789263912.726848:0:22899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98738f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71777701-7db4-46a4-b468-7d1ca0b29a68+9:18224:x1876178888707712:12345-192.168.203.20@tcp:101:mount.lustre.0 Request processed in 90us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263912.726852:0:22899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 115 00000100:00100000:3.0:1789263912.729151:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263912.732860:0:22898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888707840 00000100:00100000:2.0:1789263912.732875:0:22898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888707840 00000100:00100000:2.0:1789263912.732944:0:22898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 116 00000100:00100000:2.0:1789263912.732954:0:22898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98738f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71777701-7db4-46a4-b468-7d1ca0b29a68+9:18224:x1876178888707840:12345-192.168.203.20@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789263912.732979:0:22898:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789263912.733002:0:22898:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789263912.733005:0:22898:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789263912.733008:0:22898:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789263912.733011:0:22898:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1789263912.733013:0:22898:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:0.0:1789263912.734944:0:22898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98738f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71777701-7db4-46a4-b468-7d1ca0b29a68+9:18224:x1876178888707840:12345-192.168.203.20@tcp:256:mount.lustre.0 Request processed in 1985us (5793us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263912.734966:0:22898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 116 00000100:00100000:3.0:1789263912.740478:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263912.740543:0:22896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888707968 00000100:00100000:0.0:1789263912.740554:0:22896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888707968 00000100:00100000:0.0:1789263912.740661:0:22896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 117 00000100:00100000:0.0:1789263912.740673:0:22896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98738d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71777701-7db4-46a4-b468-7d1ca0b29a68+9:18224:x1876178888707968:12345-192.168.203.20@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789263912.740691:0:22896:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263912.740707:0:22896:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd9abf3be00/0xce1582440fb1fb32 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b612752c1d12361 expref: -99 pid: 22896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263912.740802:0:22896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd9abf3be00/0xce1582440fb1fb32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12361 expref: 10 pid: 22896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263912.740813:0:22896:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd9abf3be00/0xce1582440fb1fb32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12361 expref: 10 pid: 22896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263912.740823:0:22896:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9abf3be00, rc 0) 00000100:00100000:0.0:1789263912.740962:0:22896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98738d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71777701-7db4-46a4-b468-7d1ca0b29a68+10:18224:x1876178888707968:12345-192.168.203.20@tcp:101:mount.lustre.0 Request processed in 290us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263912.740995:0:22896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 117 00000100:00100000:3.0:1789263912.742474:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263912.742534:0:22898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888708096 00000100:00100000:0.0:1789263912.742540:0:22898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888708096 00000100:00100000:0.0:1789263912.742609:0:22898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 118 00000100:00100000:0.0:1789263912.742615:0:22898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98738dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71777701-7db4-46a4-b468-7d1ca0b29a68+10:18224:x1876178888708096:12345-192.168.203.20@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789263912.742724:0:22898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98738dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71777701-7db4-46a4-b468-7d1ca0b29a68+10:18224:x1876178888708096:12345-192.168.203.20@tcp:501:mount.lustre.0 Request processed in 98us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263912.742732:0:22898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 118 00000100:00100000:2.0:1789263912.743534:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263912.743601:0:22896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888708224 00000100:00100000:0.0:1789263912.743606:0:22896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888708224 00000100:00100000:0.0:1789263912.743670:0:22896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 119 00000100:00100000:0.0:1789263912.743676:0:22896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71777701-7db4-46a4-b468-7d1ca0b29a68+10:18224:x1876178888708224:12345-192.168.203.20@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789263912.743766:0:22896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71777701-7db4-46a4-b468-7d1ca0b29a68+10:18224:x1876178888708224:12345-192.168.203.20@tcp:503:mount.lustre.0 Request processed in 85us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263912.743773:0:22896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 119 00000100:00100000:0.0:1789263912.745407:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263912.745447:0:22898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888708352 00000100:00100000:2.0:1789263912.745453:0:22898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888708352 00000100:00100000:2.0:1789263912.745494:0:22898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 120 00000100:00100000:2.0:1789263912.745502:0:22898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71777701-7db4-46a4-b468-7d1ca0b29a68+10:18248:x1876178888708352:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789263912.745612:0:22898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71777701-7db4-46a4-b468-7d1ca0b29a68+10:18248:x1876178888708352:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 110us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263912.745620:0:22898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 120 00000100:00100000:3.0:1789263912.750194:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263912.750372:0:22896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888708480 00000100:00100000:0.0:1789263912.750381:0:22896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888708480 00000100:00100000:0.0:1789263912.750440:0:22896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 121 00000100:00100000:0.0:1789263912.750450:0:22896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883e42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71777701-7db4-46a4-b468-7d1ca0b29a68+10:18248:x1876178888708480:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789263912.750597:0:22896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883e42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71777701-7db4-46a4-b468-7d1ca0b29a68+10:18248:x1876178888708480:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 147us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263912.750605:0:22896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 121 00000100:00100000:0.0:1789263912.756319:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263912.756364:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263912.756424:0:22903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888708608 00000100:00100000:3.0:1789263912.756432:0:22903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888708608 00000100:00100000:3.0:1789263912.756467:0:22903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888708864 00000100:00100000:3.0:1789263912.756468:0:22903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888708864 00000100:00100000:3.0:1789263912.756484:0:22903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 7 00000100:00100000:3.0:1789263912.756490:0:22903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd884acdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2396:x1876178888708608:12345-192.168.203.20@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789263912.756513:0:22903:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d@192.168.203.20@tcp t0 exp 0000000000000000 cur 355 last 0 00000020:00000080:3.0:1789263912.756555:0:22903:0:(genops.c:1385:class_connect()) connect: client a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d, cookie 0xce1582440fb1fb39 00000004:00100000:3.0:1789263912.756577:0:22903:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789263912.756736:0:22903:0:(import.c:65:import_set_state_nolock()) ffff9dd9be5d3800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789263912.756797:0:22903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd884acdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+6:2396:x1876178888708608:12345-192.168.203.20@tcp:38:mount.lustre.0 Request processed in 305us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263912.756803:0:22903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 7 00000100:00100000:3.0:1789263912.756816:0:22903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 8 00000100:00100000:3.0:1789263912.756819:0:22903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd884aced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2396:x1876178888708864:12345-192.168.203.20@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789263912.756884:0:22903:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d@192.168.203.20@tcp t0 exp 0000000000000000 cur 355 last 0 00000020:00000080:3.0:1789263912.756907:0:22903:0:(genops.c:1385:class_connect()) connect: client a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d, cookie 0xce1582440fb1fb40 00000004:00100000:3.0:1789263912.756916:0:22903:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789263912.757018:0:22903:0:(import.c:65:import_set_state_nolock()) ffff9dd9be5d4000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789263912.757043:0:22903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd884aced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+6:2396:x1876178888708864:12345-192.168.203.20@tcp:38:mount.lustre.0 Request processed in 221us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263912.757055:0:22903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 8 00000100:00100000:3.0:1789263912.762287:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263912.762378:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263912.762654:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263912.762672:0:22903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888708736 00000100:00100000:0.0:1789263912.762680:0:22903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888708736 00000100:00100000:2.0:1789263912.762730:0:22938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888709120 00000100:00100000:2.0:1789263912.762737:0:22938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888709120 00000100:00100000:2.0:1789263912.762795:0:22938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 9 00000100:00100000:0.0:1789263912.762804:0:22903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 10 00000100:00100000:2.0:1789263912.762810:0:22938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88431c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+7:18224:x1876178888709120:12345-192.168.203.20@tcp:41:mount.lustre.0 00000100:00100000:0.0:1789263912.762819:0:22903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88431fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+7:0:x1876178888708736:12345-192.168.203.20@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789263912.762849:0:22938:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446297600 avail 1300058112 00000004:00000024:0.0:1789263912.762851:0:22903:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446297600 avail 1300058112 00000100:00100000:0.0:1789263912.762954:0:22903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88431fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+7:0:x1876178888708736:12345-192.168.203.20@tcp:41:mount.lustre.0 Request processed in 139us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263912.762962:0:22903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 10 00000100:00080000:1.0:1789263912.763280:0:22900:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789263912.763293:0:22905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888708992 00000100:00100000:1.0:1789263912.763297:0:22905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888708992 00000100:00100000:1.0:1789263912.763326:0:22905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 11 00000100:00100000:1.0:1789263912.763333:0:22905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88431f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+6:0:x1876178888708992:12345-192.168.203.20@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789263912.763350:0:22905:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789263912.764399:0:22938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88431c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+6:18224:x1876178888709120:12345-192.168.203.20@tcp:41:mount.lustre.0 Request processed in 1582us (2008us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263912.764410:0:22938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 9 00000100:00080000:0.0:1789263912.764698:0:22900:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789263912.764787:0:22905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88431f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+6:0:x1876178888708992:12345-192.168.203.20@tcp:41:mount.lustre.0 Request processed in 1453us (2131us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263912.764796:0:22905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 11 00000100:00100000:0.0:1789263912.766665:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263912.766779:0:22938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888709248 00000100:00100000:2.0:1789263912.766788:0:22938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888709248 00000100:00100000:2.0:1789263912.766846:0:22938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 12 00000100:00100000:2.0:1789263912.766855:0:22938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd884ace680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+6:18224:x1876178888709248:12345-192.168.203.20@tcp:40:mount.lustre.0 00000100:00100000:2.0:1789263912.766927:0:22938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd884ace680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+6:18224:x1876178888709248:12345-192.168.203.20@tcp:40:mount.lustre.0 Request processed in 73us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263912.766934:0:22938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 12 00000100:00100000:2.0:1789263912.769896:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263912.769919:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263912.769974:0:24409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888709376 00000100:00100000:1.0:1789263912.769983:0:24409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888709376 00000100:00100000:3.0:1789263912.770021:0:24595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888709504 00000100:00100000:3.0:1789263912.770025:0:24595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888709504 00000100:00100000:1.0:1789263912.770049:0:24409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 16 00000100:00100000:1.0:1789263912.770057:0:24409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2396:x1876178888709376:12345-192.168.203.20@tcp:8:mount.lustre.0 00000100:00100000:3.0:1789263912.770064:0:24595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 17 00000100:00100000:3.0:1789263912.770068:0:24595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2396:x1876178888709504:12345-192.168.203.20@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789263912.770113:0:24595:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d@192.168.203.20@tcp t0 exp 0000000000000000 cur 355 last 0 00010000:00080000:1.0:1789263912.770113:0:24409:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d@192.168.203.20@tcp t0 exp 0000000000000000 cur 355 last 0 00000020:00000080:3.0:1789263912.770144:0:24595:0:(genops.c:1385:class_connect()) connect: client a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d, cookie 0xce1582440fb1fb47 00000020:00000080:1.0:1789263912.770149:0:24409:0:(genops.c:1385:class_connect()) connect: client a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d, cookie 0xce1582440fb1fb4e 00002000:00100000:3.0:1789263912.770155:0:24595:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d/ffff9dd9be5d1800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789263912.770155:0:24409:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d/ffff9dd884a76800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789263912.770171:0:24595:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00100000:1.0:1789263912.770171:0:24409:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789263912.770316:0:24409:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789263912.770345:0:24409:0:(import.c:65:import_set_state_nolock()) ffff9dd884a73000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789263912.770415:0:24409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+6:2396:x1876178888709376:12345-192.168.203.20@tcp:8:mount.lustre.0 Request processed in 358us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263912.770423:0:24409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 16 00002000:00080000:3.0:1789263912.770748:0:24595:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789263912.770770:0:24595:0:(import.c:65:import_set_state_nolock()) ffff9dd9be5d6000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789263912.770798:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263912.770803:0:24595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+6:2396:x1876178888709504:12345-192.168.203.20@tcp:8:mount.lustre.0 Request processed in 734us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263912.770811:0:24595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 17 00000100:00100000:1.0:1789263912.770890:0:22915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888709632 00000100:00100000:1.0:1789263912.770895:0:22915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888709632 00000100:00100000:1.0:1789263912.770930:0:22915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 3 00000100:00100000:1.0:1789263912.770938:0:22915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd884acf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+6:18224:x1876178888709632:12345-192.168.203.20@tcp:900:mount.lustre.0 00000100:00100000:1.0:1789263912.771026:0:22915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd884acf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+6:18224:x1876178888709632:12345-192.168.203.20@tcp:900:mount.lustre.0 Request processed in 88us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263912.771033:0:22915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 3 00000100:00100000:0.0:1789263912.775241:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263912.775398:0:22906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888709760 00000100:00100000:1.0:1789263912.775408:0:22906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888709760 00000100:00100000:1.0:1789263912.775464:0:22906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 0 00000100:00100000:1.0:1789263912.775475:0:22906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd884acc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+6:18224:x1876178888709760:12345-192.168.203.20@tcp:33:mount.lustre.0 00000004:00080000:1.0:1789263912.778783:0:22906:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3213us 00000004:00200000:3.0:1789263912.783860:0:22906:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1789263912.783991:0:22906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd884acc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+6:18224:x1876178888709760:12345-192.168.203.20@tcp:33:mount.lustre.0 Request processed in 8513us (8753us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263912.784013:0:22906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 0 00000100:00100000:0.0:1789263912.863660:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263912.863749:0:22903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888709888 00000100:00100000:2.0:1789263912.863771:0:22903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888709888 00000100:00100000:2.0:1789263912.863822:0:22903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 13 00000100:00100000:2.0:1789263912.863838:0:22903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd884acd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+6:18271:x1876178888709888:12345-192.168.203.20@tcp:101:mkdir.0 00010000:00010000:2.0:1789263912.863858:0:22903:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263912.863883:0:22903:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22a00/0xce1582440fb1fb55 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d12392 expref: -99 pid: 22903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263912.863941:0:22903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23600/0xce1582440fb1fb5c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263912.863961:0:22903:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23600/0xce1582440fb1fb5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263912.863976:0:22903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23600/0xce1582440fb1fb5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22903 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789263912.864024:0:22903:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789263912.864028:0:22903:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789263912.864068:0:22903:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23600/0xce1582440fb1fb5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263912.864146:0:22903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa22a00/0xce1582440fb1fb55 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12392 expref: 8 pid: 22903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263912.864164:0:22903:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23600/0xce1582440fb1fb5c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12392 expref: 7 pid: 22903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263912.864171:0:22903:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd9c0a5f400) 00010000:00010000:2.0:1789263912.864173:0:22903:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789263912.864176:0:22903:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bfa23600, rc 0) 00000100:00100000:2.0:1789263912.864233:0:22903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd884acd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+7:18271:x1876178888709888:12345-192.168.203.20@tcp:101:mkdir.0 Request processed in 403us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263912.864240:0:22903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 13 00010000:00010000:1.0:1789263913.325909:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789263914.323054:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263914.323131:0:22938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888710016 00000100:00100000:2.0:1789263914.323141:0:22938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888710016 00000100:00100000:2.0:1789263914.323267:0:22938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 14 00000100:00100000:2.0:1789263914.323279:0:22938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd884acea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+7:18323:x1876178888710016:12345-192.168.203.20@tcp:41:lfs.0 00000100:00080000:0.0:1789263914.323287:0:22900:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:2.0:1789263914.323600:0:22938:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446297600 avail 1300058112 00000100:00100000:2.0:1789263914.323710:0:22938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd884acea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+7:18323:x1876178888710016:12345-192.168.203.20@tcp:41:lfs.0 Request processed in 424us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263914.323719:0:22938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 14 00000100:00100000:0.0:1789263914.325721:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263914.325789:0:22905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888710144 00000100:00100000:1.0:1789263914.325797:0:22905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888710144 00000100:00080000:0.0:1789263914.325846:0:22900:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789263914.325864:0:22905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 15 00000100:00100000:1.0:1789263914.325873:0:22905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd884acc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+6:18323:x1876178888710144:12345-192.168.203.20@tcp:41:lfs.0 00000004:00000024:1.0:1789263914.325901:0:22905:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789263914.325981:0:22905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd884acc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+6:18323:x1876178888710144:12345-192.168.203.20@tcp:41:lfs.0 Request processed in 98us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263914.325990:0:22905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 15 00000100:00100000:0.0:1789263914.327644:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263914.327726:0:24413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888710272 00000100:00100000:3.0:1789263914.327750:0:24413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888710272 00000100:00080000:0.0:1789263914.327808:0:22900:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789263914.327843:0:24413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 5 00000100:00100000:3.0:1789263914.327864:0:24413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd884acc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+6:18323:x1876178888710272:12345-192.168.203.20@tcp:13:lfs.0 00002000:00000024:3.0:1789263914.327903:0:24413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1789263914.328042:0:24413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd884acc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+6:18323:x1876178888710272:12345-192.168.203.20@tcp:13:lfs.0 Request processed in 180us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263914.328066:0:24413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 5 00000100:00100000:0.0:1789263914.329941:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263914.330014:0:24414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888710400 00000100:00100000:1.0:1789263914.330023:0:24414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888710400 00000100:00080000:0.0:1789263914.330100:0:22900:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789263914.330106:0:24414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 6 00000100:00100000:1.0:1789263914.330117:0:24414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd884acfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+6:18323:x1876178888710400:12345-192.168.203.20@tcp:13:lfs.0 00002000:00000024:1.0:1789263914.330138:0:24414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789263914.330200:0:24414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd884acfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+6:18323:x1876178888710400:12345-192.168.203.20@tcp:13:lfs.0 Request processed in 85us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263914.330208:0:24414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 6 00010000:00010000:1.0:1789263914.349512:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789263914.397585:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263914.397662:0:22898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888710528 00000100:00100000:2.0:1789263914.397672:0:22898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888710528 00000100:00100000:2.0:1789263914.397738:0:22898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 122 00000100:00100000:2.0:1789263914.397748:0:22898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882aad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71777701-7db4-46a4-b468-7d1ca0b29a68+10:18356:x1876178888710528:12345-192.168.203.20@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789263914.397763:0:22898:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263914.397779:0:22898:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd9bfa22a00/0xce1582440fb1fb63 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b612752c1d12399 expref: -99 pid: 22898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263914.397806:0:22898:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd9bfa22a00/0xce1582440fb1fb63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12399 expref: 11 pid: 22898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263914.397817:0:22898:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd9bfa22a00/0xce1582440fb1fb63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12399 expref: 11 pid: 22898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263914.397833:0:22898:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9bfa22a00, rc 0) 00000100:00100000:2.0:1789263914.397892:0:22898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882aad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71777701-7db4-46a4-b468-7d1ca0b29a68+11:18356:x1876178888710528:12345-192.168.203.20@tcp:101:mount.lustre.0 Request processed in 145us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263914.397912:0:22898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 122 00000100:00100000:0.0:1789263914.399517:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263914.399600:0:22899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888710656 00000100:00100000:1.0:1789263914.399607:0:22899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888710656 00000100:00100000:1.0:1789263914.399653:0:22899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 123 00000100:00100000:1.0:1789263914.399663:0:22899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882aad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71777701-7db4-46a4-b468-7d1ca0b29a68+11:18356:x1876178888710656:12345-192.168.203.20@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789263914.399824:0:22899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882aad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71777701-7db4-46a4-b468-7d1ca0b29a68+11:18356:x1876178888710656:12345-192.168.203.20@tcp:501:mount.lustre.0 Request processed in 163us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263914.399832:0:22899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 123 00000100:00100000:0.0:1789263914.400556:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263914.400660:0:22898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888710784 00000100:00100000:2.0:1789263914.400666:0:22898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888710784 00000100:00100000:2.0:1789263914.400698:0:22898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 124 00000100:00100000:2.0:1789263914.400717:0:22898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882aae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71777701-7db4-46a4-b468-7d1ca0b29a68+11:18356:x1876178888710784:12345-192.168.203.20@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789263914.400792:0:22898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882aae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71777701-7db4-46a4-b468-7d1ca0b29a68+11:18356:x1876178888710784:12345-192.168.203.20@tcp:503:mount.lustre.0 Request processed in 77us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263914.400797:0:22898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 124 00000100:00100000:0.0:1789263914.401905:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263914.402001:0:22899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888710912 00000100:00100000:1.0:1789263914.402019:0:22899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888710912 00000100:00100000:1.0:1789263914.402063:0:22899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 125 00000100:00100000:1.0:1789263914.402072:0:22899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882aae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71777701-7db4-46a4-b468-7d1ca0b29a68+11:18362:x1876178888710912:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789263914.402216:0:22899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882aae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71777701-7db4-46a4-b468-7d1ca0b29a68+11:18362:x1876178888710912:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 145us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263914.402224:0:22899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 125 00000100:00100000:0.0:1789263914.411399:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263914.411494:0:22898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888711040 00000100:00100000:2.0:1789263914.411502:0:22898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888711040 00000100:00100000:2.0:1789263914.411555:0:22898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 126 00000100:00100000:2.0:1789263914.411562:0:22898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882aac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71777701-7db4-46a4-b468-7d1ca0b29a68+11:18362:x1876178888711040:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789263914.411725:0:22898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882aac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71777701-7db4-46a4-b468-7d1ca0b29a68+11:18362:x1876178888711040:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 162us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263914.411733:0:22898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 126 00000100:00100000:0.0:1789263914.416051:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263914.416122:0:22899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888711168 00000100:00100000:1.0:1789263914.416133:0:22899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888711168 00000100:00100000:1.0:1789263914.416194:0:22899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 127 00000100:00100000:1.0:1789263914.416203:0:22899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882aafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71777701-7db4-46a4-b468-7d1ca0b29a68+11:18362:x1876178888711168:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789263914.416334:0:22899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882aafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71777701-7db4-46a4-b468-7d1ca0b29a68+11:18362:x1876178888711168:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 131us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263914.416343:0:22899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 127 00000100:00100000:3.0:1789263914.417535:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263914.418789:0:22896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888711296 00000100:00100000:0.0:1789263914.418800:0:22896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888711296 00000100:00100000:0.0:1789263914.418851:0:22896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 128 00000100:00100000:0.0:1789263914.418860:0:22896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9ab807450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71777701-7db4-46a4-b468-7d1ca0b29a68+11:18356:x1876178888711296:12345-192.168.203.20@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789263914.418874:0:22896:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263914.418890:0:22896:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd9abf3b000/0xce1582440fb1fb6a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b612752c1d123ca expref: -99 pid: 22896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263914.418918:0:22896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd9abf3b000/0xce1582440fb1fb6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d123ca expref: 12 pid: 22896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263914.418955:0:22896:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd9abf3b000/0xce1582440fb1fb6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d123ca expref: 12 pid: 22896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263914.418964:0:22896:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9abf3b000, rc 0) 00000100:00100000:0.0:1789263914.419012:0:22896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9ab807450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71777701-7db4-46a4-b468-7d1ca0b29a68+12:18356:x1876178888711296:12345-192.168.203.20@tcp:101:mount.lustre.0 Request processed in 154us (1482us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263914.419020:0:22896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 128 00000100:00100000:0.0:1789263914.420837:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263914.420893:0:22899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888711424 00000100:00100000:1.0:1789263914.420900:0:22899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888711424 00000100:00100000:1.0:1789263914.420955:0:22899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 129 00000100:00100000:1.0:1789263914.420963:0:22899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9ab805850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71777701-7db4-46a4-b468-7d1ca0b29a68+12:18356:x1876178888711424:12345-192.168.203.20@tcp:256:mount.lustre.0 20000000:01000000:1.0:1789263914.420982:0:22899:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789263914.421000:0:22899:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789263914.421005:0:22899:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789263914.421008:0:22899:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789263914.421011:0:22899:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1789263914.421013:0:22899:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:1.0:1789263914.421910:0:22899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9ab805850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71777701-7db4-46a4-b468-7d1ca0b29a68+12:18356:x1876178888711424:12345-192.168.203.20@tcp:256:mount.lustre.0 Request processed in 945us (1072us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263914.421920:0:22899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 129 00000100:00100000:3.0:1789263914.423415:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263914.423479:0:22896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888711552 00000100:00100000:0.0:1789263914.423486:0:22896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888711552 00000100:00100000:0.0:1789263914.423542:0:22896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 130 00000100:00100000:0.0:1789263914.423572:0:22896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9ab807050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71777701-7db4-46a4-b468-7d1ca0b29a68+12:18356:x1876178888711552:12345-192.168.203.20@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789263914.423586:0:22896:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263914.423601:0:22896:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd9abf3a600/0xce1582440fb1fb71 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b612752c1d123d1 expref: -99 pid: 22896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263914.423650:0:22896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd9abf3a600/0xce1582440fb1fb71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d123d1 expref: 13 pid: 22896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263914.423672:0:22896:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd9abf3a600/0xce1582440fb1fb71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d123d1 expref: 13 pid: 22896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263914.423682:0:22896:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9abf3a600, rc 0) 00000100:00100000:0.0:1789263914.423752:0:22896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9ab807050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71777701-7db4-46a4-b468-7d1ca0b29a68+13:18356:x1876178888711552:12345-192.168.203.20@tcp:101:mount.lustre.0 Request processed in 201us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263914.423759:0:22896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 130 00000100:00100000:0.0:1789263914.424512:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263914.424560:0:22899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888711680 00000100:00100000:1.0:1789263914.424571:0:22899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888711680 00000100:00100000:1.0:1789263914.424616:0:22899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 131 00000100:00100000:1.0:1789263914.424624:0:22899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9ab805450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71777701-7db4-46a4-b468-7d1ca0b29a68+13:18356:x1876178888711680:12345-192.168.203.20@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789263914.424747:0:22899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9ab805450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71777701-7db4-46a4-b468-7d1ca0b29a68+13:18356:x1876178888711680:12345-192.168.203.20@tcp:501:mount.lustre.0 Request processed in 125us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263914.424759:0:22899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 131 00000100:00100000:2.0:1789263914.425481:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263914.425533:0:22896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888711808 00000100:00100000:0.0:1789263914.425539:0:22896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888711808 00000100:00100000:0.0:1789263914.425578:0:22896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 132 00000100:00100000:0.0:1789263914.425586:0:22896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9ab804c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71777701-7db4-46a4-b468-7d1ca0b29a68+13:18356:x1876178888711808:12345-192.168.203.20@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789263914.425679:0:22896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9ab804c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71777701-7db4-46a4-b468-7d1ca0b29a68+13:18356:x1876178888711808:12345-192.168.203.20@tcp:503:mount.lustre.0 Request processed in 92us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263914.425687:0:22896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 132 00000100:00100000:3.0:1789263914.426905:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263914.426942:0:22899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888711936 00000100:00100000:1.0:1789263914.426946:0:22899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888711936 00000100:00100000:1.0:1789263914.426975:0:22899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 133 00000100:00100000:1.0:1789263914.426991:0:22899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9ab804850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71777701-7db4-46a4-b468-7d1ca0b29a68+13:18364:x1876178888711936:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789263914.427114:0:22899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9ab804850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71777701-7db4-46a4-b468-7d1ca0b29a68+13:18364:x1876178888711936:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 130us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263914.427121:0:22899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 133 00000100:00100000:1.0:1789263914.428038:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263914.428093:0:22898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888712064 00000100:00100000:2.0:1789263914.428097:0:22898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888712064 00000100:00100000:2.0:1789263914.428139:0:22898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 134 00000100:00100000:2.0:1789263914.428147:0:22898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9ab807850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71777701-7db4-46a4-b468-7d1ca0b29a68+13:18364:x1876178888712064:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789263914.428234:0:22898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9ab807850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71777701-7db4-46a4-b468-7d1ca0b29a68+13:18364:x1876178888712064:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 87us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263914.428245:0:22898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 134 00000100:00100000:2.0:1789263914.429459:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263914.429506:0:22904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888712192 00000100:00100000:1.0:1789263914.429518:0:22904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888712192 00000100:00100000:1.0:1789263914.429550:0:22904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 16 00000100:00100000:1.0:1789263914.429556:0:22904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2396:x1876178888712192:12345-192.168.203.20@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789263914.429576:0:22904:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 348595dd-7686-4b9f-85ef-acc7d3e74d64@192.168.203.20@tcp t0 exp 0000000000000000 cur 356 last 0 00000020:00000080:1.0:1789263914.429608:0:22904:0:(genops.c:1385:class_connect()) connect: client 348595dd-7686-4b9f-85ef-acc7d3e74d64, cookie 0xce1582440fb1fb78 00000004:00100000:1.0:1789263914.429625:0:22904:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1789263914.429668:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00080000:1.0:1789263914.429699:0:22904:0:(import.c:65:import_set_state_nolock()) ffff9dd883ae1000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789263914.429731:0:22905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888712448 00000100:00100000:2.0:1789263914.429737:0:22905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888712448 00000100:00100000:1.0:1789263914.429753:0:22904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:348595dd-7686-4b9f-85ef-acc7d3e74d64+6:2396:x1876178888712192:12345-192.168.203.20@tcp:38:mount.lustre.0 Request processed in 197us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263914.429759:0:22904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 16 00000100:00100000:2.0:1789263914.429783:0:22905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 17 00000100:00100000:2.0:1789263914.429790:0:22905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2396:x1876178888712448:12345-192.168.203.20@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789263914.429815:0:22905:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 348595dd-7686-4b9f-85ef-acc7d3e74d64@192.168.203.20@tcp t0 exp 0000000000000000 cur 356 last 0 00000020:00000080:2.0:1789263914.429847:0:22905:0:(genops.c:1385:class_connect()) connect: client 348595dd-7686-4b9f-85ef-acc7d3e74d64, cookie 0xce1582440fb1fb7f 00000004:00100000:2.0:1789263914.429857:0:22905:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789263914.429931:0:22905:0:(import.c:65:import_set_state_nolock()) ffff9dd9bf759800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789263914.429988:0:22905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:348595dd-7686-4b9f-85ef-acc7d3e74d64+6:2396:x1876178888712448:12345-192.168.203.20@tcp:38:mount.lustre.0 Request processed in 196us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263914.429996:0:22905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 17 00000100:00100000:0.0:1789263914.430895:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263914.430922:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263914.430954:0:22938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888712320 00000100:00100000:2.0:1789263914.430959:0:22938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888712320 00000100:00100000:2.0:1789263914.431004:0:22938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888712704 00000100:00100000:2.0:1789263914.431008:0:22938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888712704 00000100:00100000:2.0:1789263914.431029:0:22938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 18 00000100:00100000:2.0:1789263914.431036:0:22938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:348595dd-7686-4b9f-85ef-acc7d3e74d64+7:0:x1876178888712320:12345-192.168.203.20@tcp:41:mount.lustre.0 00000100:00080000:0.0:1789263914.431055:0:22900:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:2.0:1789263914.431108:0:22938:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446297600 avail 1300058112 00000100:00100000:1.0:1789263914.431115:0:22903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 19 00000100:00100000:1.0:1789263914.431135:0:22903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:348595dd-7686-4b9f-85ef-acc7d3e74d64+7:18356:x1876178888712704:12345-192.168.203.20@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789263914.431151:0:22903:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446297600 avail 1300058112 00000100:00100000:2.0:1789263914.431308:0:22938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:348595dd-7686-4b9f-85ef-acc7d3e74d64+7:0:x1876178888712320:12345-192.168.203.20@tcp:41:mount.lustre.0 Request processed in 270us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263914.431310:0:22903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:348595dd-7686-4b9f-85ef-acc7d3e74d64+7:18356:x1876178888712704:12345-192.168.203.20@tcp:41:mount.lustre.0 Request processed in 183us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263914.431324:0:22938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 18 00000100:00100000:1.0:1789263914.431333:0:22903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 19 00000100:00100000:0.0:1789263914.432242:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263914.432264:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263914.432310:0:22905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888712576 00000100:00100000:2.0:1789263914.432315:0:22905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888712576 00000100:00100000:3.0:1789263914.432351:0:22904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888712832 00000100:00100000:3.0:1789263914.432356:0:22904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888712832 00000100:00080000:0.0:1789263914.432358:0:22900:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789263914.432364:0:22905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 20 00000100:00100000:2.0:1789263914.432375:0:22905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:348595dd-7686-4b9f-85ef-acc7d3e74d64+6:0:x1876178888712576:12345-192.168.203.20@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789263914.432396:0:22905:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789263914.432397:0:22938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 21 00000100:00100000:1.0:1789263914.432410:0:22938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfaac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:348595dd-7686-4b9f-85ef-acc7d3e74d64+6:18356:x1876178888712832:12345-192.168.203.20@tcp:40:mount.lustre.0 00000100:00100000:2.0:1789263914.432451:0:22905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:348595dd-7686-4b9f-85ef-acc7d3e74d64+6:0:x1876178888712576:12345-192.168.203.20@tcp:41:mount.lustre.0 Request processed in 77us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263914.432452:0:22938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfaac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:348595dd-7686-4b9f-85ef-acc7d3e74d64+6:18356:x1876178888712832:12345-192.168.203.20@tcp:40:mount.lustre.0 Request processed in 45us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263914.432464:0:22938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 21 00000100:00100000:2.0:1789263914.432471:0:22905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 20 00000100:00100000:3.0:1789263914.433530:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263914.433611:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263914.433612:0:25398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888712960 00000100:00100000:1.0:1789263914.433619:0:25398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888712960 00000100:00100000:1.0:1789263914.433650:0:25398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888713088 00000100:00100000:1.0:1789263914.433655:0:25398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888713088 00000100:00100000:3.0:1789263914.433661:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263914.433683:0:25398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 18 00000100:00100000:1.0:1789263914.433691:0:25398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88431d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2396:x1876178888712960:12345-192.168.203.20@tcp:8:mount.lustre.0 00000100:00100000:0.0:1789263914.433698:0:24411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 19 00000100:00100000:0.0:1789263914.433722:0:24411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88431df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2396:x1876178888713088:12345-192.168.203.20@tcp:8:mount.lustre.0 00000100:00100000:3.0:1789263914.433730:0:22914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888713216 00010000:00080000:1.0:1789263914.433731:0:25398:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 348595dd-7686-4b9f-85ef-acc7d3e74d64@192.168.203.20@tcp t0 exp 0000000000000000 cur 356 last 0 00000100:00100000:3.0:1789263914.433738:0:22914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888713216 00010000:00080000:0.0:1789263914.433743:0:24411:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 348595dd-7686-4b9f-85ef-acc7d3e74d64@192.168.203.20@tcp t0 exp 0000000000000000 cur 356 last 0 00000020:00000080:0.0:1789263914.433771:0:24411:0:(genops.c:1385:class_connect()) connect: client 348595dd-7686-4b9f-85ef-acc7d3e74d64, cookie 0xce1582440fb1fb8d 00000100:00100000:3.0:1789263914.433783:0:22914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 4 00002000:00100000:0.0:1789263914.433790:0:24411:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 348595dd-7686-4b9f-85ef-acc7d3e74d64/ffff9dd882969000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:3.0:1789263914.433792:0:22914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88431ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:348595dd-7686-4b9f-85ef-acc7d3e74d64+6:18356:x1876178888713216:12345-192.168.203.20@tcp:900:mount.lustre.0 00002000:00100000:0.0:1789263914.433805:0:24411:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000020:00000080:1.0:1789263914.433822:0:25398:0:(genops.c:1385:class_connect()) connect: client 348595dd-7686-4b9f-85ef-acc7d3e74d64, cookie 0xce1582440fb1fb86 00002000:00100000:1.0:1789263914.433831:0:25398:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 348595dd-7686-4b9f-85ef-acc7d3e74d64/ffff9dd9ab89a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789263914.433846:0:25398:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1789263914.433862:0:22914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88431ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:348595dd-7686-4b9f-85ef-acc7d3e74d64+6:18356:x1876178888713216:12345-192.168.203.20@tcp:900:mount.lustre.0 Request processed in 71us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263914.433871:0:22914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 4 00002000:00080000:1.0:1789263914.433890:0:25398:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789263914.433915:0:25398:0:(import.c:65:import_set_state_nolock()) ffff9dd9ab89b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789263914.433945:0:25398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88431d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:348595dd-7686-4b9f-85ef-acc7d3e74d64+6:2396:x1876178888712960:12345-192.168.203.20@tcp:8:mount.lustre.0 Request processed in 254us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263914.433962:0:25398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 18 00002000:00080000:0.0:1789263914.433966:0:24411:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789263914.433987:0:24411:0:(import.c:65:import_set_state_nolock()) ffff9dd88296f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789263914.434036:0:24411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88431df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:348595dd-7686-4b9f-85ef-acc7d3e74d64+6:2396:x1876178888713088:12345-192.168.203.20@tcp:8:mount.lustre.0 Request processed in 317us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263914.434043:0:24411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 19 00000100:00100000:3.0:1789263914.435635:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263914.435721:0:22907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888713344 00000100:00100000:2.0:1789263914.435728:0:22907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888713344 00000100:00100000:2.0:1789263914.435788:0:22907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 1 00000100:00100000:2.0:1789263914.435798:0:22907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88431c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:348595dd-7686-4b9f-85ef-acc7d3e74d64+6:18356:x1876178888713344:12345-192.168.203.20@tcp:33:mount.lustre.0 00000004:00200000:2.0:1789263914.435875:0:22907:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1789263914.435920:0:22907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88431c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:348595dd-7686-4b9f-85ef-acc7d3e74d64+6:18356:x1876178888713344:12345-192.168.203.20@tcp:33:mount.lustre.0 Request processed in 125us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263914.435924:0:22907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 1 00000100:00100000:1.0:1789263914.516823:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263914.517767:0:22903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888713472 00000100:00100000:0.0:1789263914.517777:0:22903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888713472 00000100:00100000:0.0:1789263914.517883:0:22903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 22 00000100:00100000:0.0:1789263914.517896:0:22903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882434000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:348595dd-7686-4b9f-85ef-acc7d3e74d64+6:18387:x1876178888713472:12345-192.168.203.20@tcp:101:mkdir.0 00010000:00010000:0.0:1789263914.517915:0:22903:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263914.517935:0:22903:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3b200/0xce1582440fb1fb94 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d12402 expref: -99 pid: 22903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263914.517998:0:22903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3b400/0xce1582440fb1fb9b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263914.518014:0:22903:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3b400/0xce1582440fb1fb9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263914.518025:0:22903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3b400/0xce1582440fb1fb9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22903 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789263914.518069:0:22903:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789263914.518073:0:22903:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789263914.518125:0:22903:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3b400/0xce1582440fb1fb9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263914.518149:0:22903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3b200/0xce1582440fb1fb94 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12402 expref: 8 pid: 22903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263914.518170:0:22903:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3b400/0xce1582440fb1fb9b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12402 expref: 7 pid: 22903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263914.518179:0:22903:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd9c0a5f400) 00010000:00010000:0.0:1789263914.518182:0:22903:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789263914.518197:0:22903:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9abf3b400, rc 0) 00000100:00100000:0.0:1789263914.518257:0:22903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882434000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:348595dd-7686-4b9f-85ef-acc7d3e74d64+7:18387:x1876178888713472:12345-192.168.203.20@tcp:101:mkdir.0 Request processed in 363us (1439us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263914.518264:0:22903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 22 00000100:00100000:2.0:1789263915.053205:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898181504:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789263915.053299:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263915.053376:0:22908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898181504 00000100:00100000:2.0:1789263915.053383:0:22908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898181504 00000100:00100000:2.0:1789263915.053426:0:22908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789263915.053433:0:22908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1876178898181504:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789263915.053464:0:22908:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789263915.053511:0:22908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1876178898181504:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263915.053518:0:22908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789263915.053571:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898181504:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789263915.054242:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789263915.054252:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898181632:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789263915.054284:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263915.054312:0:22927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898181632 00000100:00100000:0.0:1789263915.054316:0:22927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898181632 00000100:00100000:0.0:1789263915.054341:0:22927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789263915.054348:0:22927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1876178898181632:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789263915.054367:0:22927:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446297600 avail 1300058112 00000100:00100000:0.0:1789263915.054399:0:22927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1876178898181632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 51us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263915.054406:0:22927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789263915.054435:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898181632:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789263915.373252:0:24436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789263915.717336:0:25781:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1789263916.077278:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88431ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898181888:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789263916.077278:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882436a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898181760:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789263916.077303:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882435500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876178898182144:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789263916.077376:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263916.077386:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec0ec848-5fac-4f6a-ba8a-daed864d309d:3618:1876178898182016:0@lo:400:kworker.0 00000100:00100000:0.0:1789263916.077418:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88431d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898182400:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789263916.077428:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263916.077450:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263916.077469:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898182528:0@lo:400:kworker.0 00000100:00100000:0.0:1789263916.077489:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898182912:0@lo:400:kworker.0 00000100:00100000:1.0:1789263916.077499:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263916.077522:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898183040:0@lo:400:kworker.0 00000100:00100000:0.0:1789263916.077530:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263916.077553:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263916.077560:0:22909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898182912 00000100:00100000:0.0:1789263916.077564:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3621:1876178898183424:0@lo:400:kworker.0 00000100:00100000:2.0:1789263916.077569:0:22909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898182912 00000100:00100000:0.0:1789263916.077598:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263916.077613:0:22909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789263916.077624:0:22909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1876178898182912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263916.077630:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1789263916.077652:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1876178898182784:0@lo:400:kworker.0 00000100:00100000:0.0:1789263916.077688:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263916.077711:0:22909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1876178898182912:12345-0@lo:400:kworker.0 Request processed in 88us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263916.077720:0:22909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789263916.077729:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1876178898183296:0@lo:400:kworker.0 00000100:00100000:0.0:1789263916.077753:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263916.077765:0:22905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898183424 00000100:00100000:2.0:1789263916.077771:0:22905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898183424 00000100:00100000:0.0:1789263916.077772:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3621:1876178898183808:0@lo:400:kworker.0 00000100:00100000:0.0:1789263916.077807:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263916.077817:0:22905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898182784 00000100:00100000:2.0:1789263916.077821:0:22905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898182784 00000100:00100000:2.0:1789263916.077836:0:22905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898183296 00000100:00100000:2.0:1789263916.077840:0:22905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898183296 00000100:00100000:0.0:1789263916.077840:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898182912:0@lo:400:kworker.0 00000100:00100000:2.0:1789263916.077857:0:22905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898183808 00000100:00100000:2.0:1789263916.077861:0:22905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898183808 00000100:00100000:2.0:1789263916.077883:0:22905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789263916.077896:0:22905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1876178898183424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263916.077897:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263916.077898:0:24414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898181760 00000100:00100000:0.0:1789263916.077905:0:24414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898181760 00000100:00100000:3.0:1789263916.077922:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898182272:0@lo:400:kworker.0 00000100:00100000:0.0:1789263916.077948:0:24414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898182400 00000100:00100000:2.0:1789263916.077952:0:22905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1876178898183424:12345-0@lo:400:kworker.0 Request processed in 60us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263916.077953:0:24414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898182400 00000100:00100000:3.0:1789263916.077962:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263916.077968:0:22905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789263916.077974:0:24414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898181888 00000100:00100000:0.0:1789263916.077978:0:24414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898181888 00000100:00100000:2.0:1789263916.077988:0:22905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789263916.077998:0:22905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1876178898182784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263916.078004:0:24414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789263916.078014:0:24414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1876178898181760:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789263916.078032:0:22905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1876178898182784:12345-0@lo:400:kworker.0 Request processed in 36us (344us total) trans 0 rc 0/0 00002000:00000024:0.0:1789263916.078040:0:24414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1789263916.078042:0:22905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789263916.078060:0:22905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789263916.078101:0:24414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1876178898181760:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263916.078113:0:22905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1876178898183296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263916.078113:0:24414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789263916.078134:0:24414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789263916.078143:0:24414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3621:x1876178898182400:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789263916.078152:0:22905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1876178898183296:12345-0@lo:400:kworker.0 Request processed in 83us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263916.078159:0:22904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00002000:00000024:0.0:1789263916.078161:0:24414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789263916.078171:0:22905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789263916.078176:0:22904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1876178898183808:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789263916.078198:0:22900:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789263916.078201:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1876178898183552:0@lo:400:kworker.0 00000100:00100000:0.0:1789263916.078210:0:24414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3621:x1876178898182400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (759us total) trans 0 rc 0/0 00000100:00080000:2.0:1789263916.078211:0:22900:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789263916.078217:0:22900:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789263916.078220:0:22900:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789263916.078221:0:24414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789263916.078250:0:24414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789263916.078256:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1876178898182784:0@lo:400:kworker.0 00000100:00100000:0.0:1789263916.078259:0:24414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88431e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898181888:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789263916.078273:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1876178898183296:0@lo:400:kworker.0 00002000:00000024:0.0:1789263916.078286:0:24414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00010000:00080000:2.0:1789263916.078293:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd98ff7ed80 x1876178898183808/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789263916.078303:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3621:1876178898183808:0@lo:400:kworker.0 00000100:00100000:2.0:1789263916.078329:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3621:1876178898183424:0@lo:400:kworker.0 00000100:00100000:2.0:1789263916.078346:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882436a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898181760:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789263916.078359:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88431d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898182400:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789263916.078450:0:22904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1876178898183808:12345-0@lo:400:kworker.0 Request processed in 280us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263916.078457:0:22904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789263916.078481:0:22908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898182272 00000100:00100000:3.0:1789263916.078486:0:22908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898182272 00000100:00100000:1.0:1789263916.078493:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263916.078510:0:24414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88431e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898181888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 252us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263916.078520:0:22908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789263916.078521:0:24414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789263916.078525:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789263916.078532:0:22908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883b6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1876178898182272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789263916.078537:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898183168:0@lo:400:kworker.0 00000100:00100000:0.0:1789263916.078554:0:22899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898182016 00000100:00100000:0.0:1789263916.078560:0:22899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898182016 00000100:00100000:3.0:1789263916.078579:0:22908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883b6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1876178898182272:12345-0@lo:400:kworker.0 Request processed in 48us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263916.078585:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263916.078590:0:22908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789263916.078612:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1876178898183680:0@lo:400:kworker.0 00000100:00100000:3.0:1789263916.078613:0:24595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898182528 00000100:00100000:3.0:1789263916.078618:0:24595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898182528 00000100:00100000:1.0:1789263916.078716:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263916.079028:0:22899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789263916.079039:0:22899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9ab804450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+24:3618:x1876178898182016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263916.079043:0:24595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898183040 00000100:00100000:3.0:1789263916.079047:0:24595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898183040 00000100:00100000:3.0:1789263916.079093:0:24595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898183168 00000100:00100000:3.0:1789263916.079096:0:24595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898183168 00000100:00100000:1.0:1789263916.079102:0:24409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789263916.079110:0:24412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789263916.079118:0:24409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882435180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1876178898182528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263916.079118:0:22899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9ab804450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+24:3618:x1876178898182016:12345-0@lo:400:kworker.0 Request processed in 78us (1686us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263916.079124:0:24412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882434700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1876178898183040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263916.079127:0:24595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789263916.079138:0:24595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882436a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1876178898183168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263916.079139:0:22899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789263916.079177:0:24409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882435180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1876178898182528:12345-0@lo:400:kworker.0 Request processed in 64us (1675us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263916.079186:0:24409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789263916.079194:0:24595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882436a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1876178898183168:12345-0@lo:400:kworker.0 Request processed in 56us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263916.079194:0:24412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882434700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1876178898183040:12345-0@lo:400:kworker.0 Request processed in 72us (1637us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263916.079194:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263916.079207:0:24595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789263916.079213:0:24412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789263916.079220:0:22938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898183552 00000100:00100000:1.0:1789263916.079226:0:22938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898183552 00000100:00100000:0.0:1789263916.079230:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd99f9a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876178898182656:0@lo:400:kworker.0 00000100:00080000:3.0:1789263916.079235:0:22900:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789263916.079248:0:22900:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789263916.079264:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263916.079271:0:24413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898182144 00000100:00100000:3.0:1789263916.079276:0:24413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898182144 00000100:00100000:3.0:1789263916.079307:0:24413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789263916.079312:0:24413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1876178898182144:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789263916.079317:0:22903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898183680 00002000:00000024:3.0:1789263916.079322:0:24413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1789263916.079323:0:22903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898183680 00000100:00100000:1.0:1789263916.079405:0:22938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789263916.079422:0:22938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882437b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876178898183552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263916.079431:0:22903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789263916.079441:0:22903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1876178898183680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263916.079745:0:24413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1876178898182144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 431us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263916.079753:0:22938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882437b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876178898183552:12345-0@lo:400:kworker.0 Request processed in 332us (1260us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263916.079755:0:24413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789263916.079766:0:22938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1789263916.079792:0:22900:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789263916.079800:0:24409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898182656 00000100:00100000:1.0:1789263916.079804:0:24409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898182656 00000100:00100000:3.0:1789263916.079830:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882435500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876178898182144:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789263916.079836:0:24409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789263916.079846:0:24409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3619:x1876178898182656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263916.079869:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88431ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898181888:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789263916.079884:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876178898182272:0@lo:400:kworker.0 00000100:00100000:1.0:1789263916.079891:0:24409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3619:x1876178898182656:12345-0@lo:400:kworker.0 Request processed in 46us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263916.079899:0:24409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789263916.079917:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876178898182656:0@lo:400:kworker.0 00000100:00100000:1.0:1789263916.079940:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898183168:0@lo:400:kworker.0 00000100:00100000:1.0:1789263916.079955:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec0ec848-5fac-4f6a-ba8a-daed864d309d:3618:1876178898182016:0@lo:400:kworker.0 00000100:00100000:1.0:1789263916.079982:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd99f9a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898182528:0@lo:400:kworker.0 00000100:00100000:1.0:1789263916.079992:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898183040:0@lo:400:kworker.0 00010000:00080000:1.0:1789263916.080003:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd98ff7c380 x1876178898183552/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789263916.080014:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1876178898183552:0@lo:400:kworker.0 00000100:00100000:0.0:1789263916.080811:0:22903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1876178898183680:12345-0@lo:400:kworker.0 Request processed in 1368us (2091us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263916.080821:0:22903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789263916.080847:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1876178898183680:0@lo:400:kworker.0 00010000:00010000:1.0:1789263916.397264:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789263916.591856:0:25224:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 348595dd-7686-4b9f-85ef-acc7d3e74d64 00000001:00100000:1.0:1789263916.591871:0:25224:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d 00000001:00080000:1.0:1789263916.591879:0:25224:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00010000:00010000:2.0:1789263917.422491:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789263917.484609:0:25928:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff068bd410 20000000:00000080:2.0:1789263917.484628:0:25928:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9dd881f36800 uarg=0000000000000000 20000000:01000000:2.0:1789263917.484669:0:25928:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789263917.484692:0:25928:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789263917.484697:0:25928:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1789263917.485498:0:25929:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:2.0:1789263917.485668:0:25928:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789263917.493919:0:25928:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789263917.493948:0:25928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dd981683600/0xce1582440fb1fba2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263917.493984:0:25928:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd987f50c00/0xce1582440fb1f7ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1f7f8 expref: 23 pid: 22898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263917.493992:0:25928:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd8841a3400/0xce1582440fb1f80d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1f806 expref: 23 pid: 22896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263917.494005:0:25928:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd8841a2800/0xce1582440fb1f84c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1f845 expref: 23 pid: 22896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263917.494012:0:25928:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd9bfa22400/0xce1582440fb1f9c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1f9bf expref: 23 pid: 22899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263917.494022:0:25928:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd9abf3be00/0xce1582440fb1fb32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12361 expref: 12 pid: 22896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263917.494029:0:25928:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd9abf3a600/0xce1582440fb1fb71 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d123d1 expref: 12 pid: 22896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263917.494043:0:25928:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dd981683600/0xce1582440fb1fba2 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263917.494374:0:25928:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd9abf3a600/0xce1582440fb1fb71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d123d1 expref: 12 pid: 22896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263917.494395:0:25928:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dd9abf3a600/0xce1582440fb1fb71 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d123d1 expref: 12 pid: 22896 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263917.494410:0:25928:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25928:1876178898183936:192.168.203.20@tcp:104: 00010000:00010000:2.0:1789263917.494530:0:25928:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd9abf3be00/0xce1582440fb1fb32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12361 expref: 12 pid: 22896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263917.494554:0:25928:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dd9abf3be00/0xce1582440fb1fb32 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12361 expref: 12 pid: 22896 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263917.494564:0:25928:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25928:1876178898184064:192.168.203.20@tcp:104: 00010000:00010000:2.0:1789263917.494596:0:25928:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd9bfa22400/0xce1582440fb1f9c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce1582440fb1f9bf expref: 23 pid: 22899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263917.494604:0:25928:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dd9bfa22400/0xce1582440fb1f9c6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce1582440fb1f9bf expref: 23 pid: 22899 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263917.494612:0:25928:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25928:1876178898184192:0@lo:104: 00000100:00100000:2.0:1789263917.494647:0:25928:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789263917.494706:0:25928:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd8841a2800/0xce1582440fb1f84c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce1582440fb1f845 expref: 23 pid: 22896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263917.494714:0:25928:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dd8841a2800/0xce1582440fb1f84c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce1582440fb1f845 expref: 23 pid: 22896 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263917.494730:0:25928:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25928:1876178898184320:0@lo:104: 00000100:00100000:2.0:1789263917.494759:0:25928:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789263917.494802:0:25928:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd8841a3400/0xce1582440fb1f80d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce1582440fb1f806 expref: 23 pid: 22896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263917.494818:0:25928:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dd8841a3400/0xce1582440fb1f80d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce1582440fb1f806 expref: 23 pid: 22896 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263917.494828:0:25928:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25928:1876178898184448:0@lo:104: 00000100:00100000:2.0:1789263917.494858:0:25928:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263917.494892:0:24058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898184192 00000100:00100000:2.0:1789263917.494898:0:24058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898184192 00000100:00100000:2.0:1789263917.494933:0:24058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898184320 00000100:00100000:2.0:1789263917.494936:0:24058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898184320 00000100:00100000:2.0:1789263917.494947:0:24058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898184448 00000100:00100000:2.0:1789263917.494950:0:24058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898184448 00000100:00100000:2.0:1789263917.494970:0:24058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789263917.494978:0:24058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+5:25928:x1876178898184192:12345-0@lo:104: 00010000:00010000:2.0:1789263917.494995:0:24058:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff9dd9abf3a400/0xce1582440fb1f9bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1f9c6 expref: -99 pid: 25223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263917.495047:0:24058:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789263917.495059:0:24058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+5:25928:x1876178898184192:12345-0@lo:104: Request processed in 76us (406us total) trans 0 rc 0/0 00010000:00010000:0.0:1789263917.495235:0:24436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789263917.495242:0:24436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd9abf3a400/0xce1582440fb1f9bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1f9c6 expref: -99 pid: 25223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263917.495267:0:24436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9abf3a400 already unused, calling callback (ffffffffc12b1c20) 10000000:00010000:0.0:1789263917.495272:0:24436:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd9abf3a400/0xce1582440fb1f9bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xce1582440fb1f9c6 expref: -99 pid: 25223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263917.495287:0:24436:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd9abf3a400/0xce1582440fb1f9bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xce1582440fb1f9c6 expref: -99 pid: 25223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789263917.495294:0:24436:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd9abf3a400/0xce1582440fb1f9bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xce1582440fb1f9c6 expref: -99 pid: 25223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789263917.495300:0:24436:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789263917.495338:0:24436:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff9dd9abf3a400/0xce1582440fb1f9bf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1f9c6 expref: -99 pid: 25223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263917.495352:0:24436:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789263917.495382:0:24436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd9abf3a400/0xce1582440fb1f9bf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1f9c6 expref: -99 pid: 25223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263917.495479:0:24436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd9abf3a400/0xce1582440fb1f9bf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1f9c6 expref: -99 pid: 25223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263917.495495:0:24436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263917.495497:0:24436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263917.495498:0:24436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789263917.495523:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec0ec848-5fac-4f6a-ba8a-daed864d309d:3621:1876178898184576:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789263917.495559:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263917.495619:0:22888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789263917.495627:0:22888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec0ec848-5fac-4f6a-ba8a-daed864d309d+5:25928:x1876178898184320:12345-0@lo:104: 00010000:00010000:0.0:1789263917.495643:0:22888:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff9dd987f51400/0xce1582440fb1f845 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1f84c expref: -99 pid: 24405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263917.495674:0:22888:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789263917.495747:0:22891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898184576 00000100:00100000:1.0:1789263917.495752:0:22891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898184576 00010000:00010000:1.0:1789263917.495778:0:22891:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd9bfa22400/0xce1582440fb1f9c6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1f9bf expref: 24 pid: 22899 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263917.495805:0:22891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789263917.495812:0:22891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+24:3621:x1876178898184576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789263917.495822:0:22891:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789263917.495826:0:22891:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd9bfa22400/0xce1582440fb1f9c6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1f9bf expref: 24 pid: 22899 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263917.495840:0:22891:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd9bfa22400/0xce1582440fb1f9c6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce1582440fb1f9bf expref: 24 pid: 22899 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263917.495854:0:22891:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789263917.495892:0:22891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+24:3621:x1876178898184576:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263917.495899:0:22891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:1.0:1789263917.495918:0:22892:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263917.495923:0:22892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd987f51400/0xce1582440fb1f845 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1f84c expref: -99 pid: 24405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263917.495930:0:22892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd987f51400 already unused, calling callback (ffffffffc12b1c20) 10000000:00010000:1.0:1789263917.495933:0:22892:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd987f51400/0xce1582440fb1f845 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xce1582440fb1f84c expref: -99 pid: 24405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263917.495940:0:22892:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd987f51400/0xce1582440fb1f845 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xce1582440fb1f84c expref: -99 pid: 24405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789263917.495965:0:22892:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd987f51400/0xce1582440fb1f845 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xce1582440fb1f84c expref: -99 pid: 24405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789263917.495970:0:22892:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789263917.495999:0:22892:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff9dd987f51400/0xce1582440fb1f845 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1f84c expref: -99 pid: 24405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263917.496005:0:22892:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789263917.496027:0:22892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd987f51400/0xce1582440fb1f845 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1f84c expref: -99 pid: 24405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263917.496034:0:22892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd987f51400/0xce1582440fb1f845 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1f84c expref: -99 pid: 24405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263917.496051:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263917.496053:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263917.496055:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789263917.496069:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88297dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec0ec848-5fac-4f6a-ba8a-daed864d309d:3618:1876178898184704:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789263917.496121:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263917.496163:0:22889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898184704 00000100:00100000:1.0:1789263917.496166:0:22889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898184704 00010000:00010000:1.0:1789263917.496185:0:22889:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd8841a2800/0xce1582440fb1f84c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1f845 expref: 24 pid: 22896 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263917.496205:0:22889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789263917.496211:0:22889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+24:3618:x1876178898184704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789263917.496226:0:22889:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789263917.496230:0:22889:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd8841a2800/0xce1582440fb1f84c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1f845 expref: 24 pid: 22896 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263917.496250:0:22889:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd8841a2800/0xce1582440fb1f84c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce1582440fb1f845 expref: 24 pid: 22896 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263917.496262:0:22889:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789263917.496297:0:22889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+24:3618:x1876178898184704:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263917.496303:0:22889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789263917.496341:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88297dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec0ec848-5fac-4f6a-ba8a-daed864d309d:3618:1876178898184704:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789263917.496364:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec0ec848-5fac-4f6a-ba8a-daed864d309d:3621:1876178898184576:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789263917.496424:0:22888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec0ec848-5fac-4f6a-ba8a-daed864d309d+5:25928:x1876178898184320:12345-0@lo:104: Request processed in 55us (927us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263917.496431:0:22888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789263917.496446:0:22888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789263917.496453:0:22888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec0ec848-5fac-4f6a-ba8a-daed864d309d+4:25928:x1876178898184448:12345-0@lo:104: 00010000:00010000:0.0:1789263917.496460:0:22888:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff9dd987f50a00/0xce1582440fb1f806 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1f80d expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263917.496500:0:22888:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789263917.496505:0:22888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec0ec848-5fac-4f6a-ba8a-daed864d309d+4:25928:x1876178898184448:12345-0@lo:104: Request processed in 54us (1647us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263917.496510:0:22888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1789263917.496596:0:22893:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789263917.496601:0:22893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd987f50a00/0xce1582440fb1f806 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1f80d expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263917.496608:0:22893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd987f50a00 already unused, calling callback (ffffffffc12b1c20) 10000000:00010000:1.0:1789263917.496612:0:22893:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd987f50a00/0xce1582440fb1f806 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xce1582440fb1f80d expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263917.496619:0:22893:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd987f50a00/0xce1582440fb1f806 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xce1582440fb1f80d expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789263917.496626:0:22893:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd987f50a00/0xce1582440fb1f806 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xce1582440fb1f80d expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789263917.496630:0:22893:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1789263917.496705:0:24058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:2.0:1789263917.496743:0:25928:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd987f50c00/0xce1582440fb1f7ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce1582440fb1f7f8 expref: 23 pid: 22898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263917.496753:0:25928:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dd987f50c00/0xce1582440fb1f7ff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce1582440fb1f7f8 expref: 23 pid: 22898 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263917.496761:0:25928:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25928:1876178898184832:0@lo:104: 00000100:00100000:2.0:1789263917.496786:0:25928:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263917.496804:0:25928:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd8826849c0 going to sleep for 11 seconds 00010000:00010000:2.0:1789263917.496817:0:25928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd9bfa22400/0xce1582440fb1f9c6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce1582440fb1f9bf expref: 23 pid: 22899 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263917.496826:0:25928:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25928:1876178898184192:0@lo:104: 00010000:00010000:2.0:1789263917.496835:0:25928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd8841a2800/0xce1582440fb1f84c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce1582440fb1f845 expref: 22 pid: 22896 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263917.496857:0:25928:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25928:1876178898184320:0@lo:104: 00000100:00100000:2.0:1789263917.496882:0:25928:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25928:1876178898184448:0@lo:104: 00010000:00010000:1.0:1789263917.496950:0:22893:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff9dd987f50a00/0xce1582440fb1f806 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1f80d expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263917.496956:0:22893:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789263917.497213:0:22893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd987f50a00/0xce1582440fb1f806 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1f80d expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263917.497223:0:22893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd987f50a00/0xce1582440fb1f806 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1f80d expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263917.497243:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263917.497245:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789263917.497247:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789263917.497269:0:22887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898184832 00000100:00100000:1.0:1789263917.497274:0:22887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898184832 00000100:00100000:1.0:1789263917.497310:0:22887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789263917.497317:0:22887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+3:25928:x1876178898184832:12345-0@lo:104: 00010000:00010000:1.0:1789263917.497326:0:22887:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff9dd987f50e00/0xce1582440fb1f7f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1f7ff expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263917.497378:0:22887:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789263917.497384:0:22887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+3:25928:x1876178898184832:12345-0@lo:104: Request processed in 68us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263917.497397:0:22887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789263917.497413:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789263917.497428:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88297dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec0ec848-5fac-4f6a-ba8a-daed864d309d:3618:1876178898184960:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789263917.497458:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263917.497491:0:22890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898184960 00000100:00100000:1.0:1789263917.497495:0:22890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898184960 00010000:00010000:1.0:1789263917.497511:0:22890:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd8841a3400/0xce1582440fb1f80d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1f806 expref: 22 pid: 22896 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263917.497537:0:22890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789263917.497543:0:22890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec0ec848-5fac-4f6a-ba8a-daed864d309d+22:3618:x1876178898184960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789263917.497557:0:22890:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789263917.497561:0:22890:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd8841a3400/0xce1582440fb1f80d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1f806 expref: 22 pid: 22896 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263917.497577:0:22890:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd8841a3400/0xce1582440fb1f80d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce1582440fb1f806 expref: 22 pid: 22896 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263917.497587:0:22890:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd8841a3400/0xce1582440fb1f80d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce1582440fb1f806 expref: 22 pid: 22896 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263917.497602:0:22890:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789263917.497637:0:22890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec0ec848-5fac-4f6a-ba8a-daed864d309d+21:3618:x1876178898184960:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263917.497643:0:22890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789263917.497676:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88297dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec0ec848-5fac-4f6a-ba8a-daed864d309d:3618:1876178898184960:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789263917.497903:0:25928:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25928:1876178898184832:0@lo:104: 00010000:00010000:0.0:1789263917.498046:0:24436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789263917.498052:0:24436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff9dd987f50e00/0xce1582440fb1f7f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xce1582440fb1f7ff expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263917.498100:0:24436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd987f50e00 already unused, calling callback (ffffffffc12b1c20) 10000000:00010000:0.0:1789263917.498103:0:24436:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff9dd987f50e00/0xce1582440fb1f7f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xce1582440fb1f7ff expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263917.498111:0:24436:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff9dd987f50e00/0xce1582440fb1f7f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xce1582440fb1f7ff expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789263917.498123:0:24436:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff9dd987f50e00/0xce1582440fb1f7f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xce1582440fb1f7ff expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789263917.498135:0:24436:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789263917.498168:0:24436:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff9dd987f50e00/0xce1582440fb1f7f8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1f7ff expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263917.498174:0:24436:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789263917.498196:0:24436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff9dd987f50e00/0xce1582440fb1f7f8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1f7ff expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263917.498204:0:24436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff9dd987f50e00/0xce1582440fb1f7f8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce1582440fb1f7ff expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263917.498223:0:24436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263917.498225:0:24436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263917.498227:0:24436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789263917.498236:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec0ec848-5fac-4f6a-ba8a-daed864d309d:3620:1876178898185088:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789263917.498269:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263917.498332:0:25241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898185088 00000100:00100000:0.0:1789263917.498337:0:25241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898185088 00010000:00010000:0.0:1789263917.498360:0:25241:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd987f50c00/0xce1582440fb1f7ff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1f7f8 expref: 21 pid: 22898 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263917.498380:0:25241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789263917.498386:0:25241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa93480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ec0ec848-5fac-4f6a-ba8a-daed864d309d+21:3620:x1876178898185088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789263917.498394:0:25241:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789263917.498398:0:25241:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd987f50c00/0xce1582440fb1f7ff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce1582440fb1f7f8 expref: 21 pid: 22898 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263917.498405:0:25241:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd987f50c00/0xce1582440fb1f7ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce1582440fb1f7f8 expref: 21 pid: 22898 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263917.498430:0:25241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd987f50c00/0xce1582440fb1f7ff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce1582440fb1f7f8 expref: 21 pid: 22898 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263917.498438:0:25241:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789263917.498471:0:25241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa93480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ec0ec848-5fac-4f6a-ba8a-daed864d309d+20:3620:x1876178898185088:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263917.498477:0:25241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789263917.498509:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec0ec848-5fac-4f6a-ba8a-daed864d309d:3620:1876178898185088:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789263917.501447:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263917.501477:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263917.501636:0:25928:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25928:1876178898183936:192.168.203.20@tcp:104: 00000100:00100000:2.0:1789263917.501656:0:25928:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25928:1876178898184064:192.168.203.20@tcp:104: 00010000:00010000:2.0:1789263917.501695:0:25928:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dd981683600/0xce1582440fb1fba2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263917.501806:0:22890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888713600 00000100:00100000:0.0:1789263917.501813:0:22890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888713600 00010000:00010000:0.0:1789263917.501842:0:22890:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd9abf3a600/0xce1582440fb1fb71 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d123d1 expref: 13 pid: 22896 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263917.501890:0:22890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888713728 00000100:00100000:0.0:1789263917.501894:0:22890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888713728 00010000:00010000:0.0:1789263917.501913:0:22890:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd9abf3be00/0xce1582440fb1fb32 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12361 expref: 14 pid: 22896 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263917.501942:0:22890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 13 00000100:00100000:0.0:1789263917.501951:0:22890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98fe87850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:71777701-7db4-46a4-b468-7d1ca0b29a68+14:2397:x1876178888713600:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789263917.501969:0:22890:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789263917.501974:0:22890:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd9abf3a600/0xce1582440fb1fb71 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d123d1 expref: 14 pid: 22896 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263917.501991:0:22890:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd9abf3a600/0xce1582440fb1fb71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d123d1 expref: 14 pid: 22896 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263917.502008:0:22890:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd9abf3a600/0xce1582440fb1fb71 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d123d1 expref: 14 pid: 22896 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263917.502045:0:22890:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789263917.502133:0:22890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98fe87850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:71777701-7db4-46a4-b468-7d1ca0b29a68+13:2397:x1876178888713600:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 176us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263917.502141:0:22890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 13 00000100:00100000:0.0:1789263917.502180:0:22890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 14 00000100:00100000:0.0:1789263917.502186:0:22890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:71777701-7db4-46a4-b468-7d1ca0b29a68+12:2397:x1876178888713728:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789263917.502193:0:22890:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789263917.502197:0:22890:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd9abf3be00/0xce1582440fb1fb32 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12361 expref: 12 pid: 22896 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263917.502215:0:22890:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd9abf3be00/0xce1582440fb1fb32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12361 expref: 12 pid: 22896 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263917.502225:0:22890:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd9abf3be00/0xce1582440fb1fb32 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12361 expref: 12 pid: 22896 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263917.502240:0:22890:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dd981683600/0xce1582440fb1fba2 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263917.502248:0:22890:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd981683600/0xce1582440fb1fba2 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263917.502261:0:22890:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd981683600/0xce1582440fb1fba2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263917.502274:0:22890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd981683600/0xce1582440fb1fba2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263917.502290:0:22890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dd981683600/0xce1582440fb1fba2 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263917.502301:0:22890:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dd981683600/0xce1582440fb1fba2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263917.502307:0:22890:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981683600 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:0.0:1789263917.502310:0:22890:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dd981683600/0xce1582440fb1fba2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263917.502317:0:22890:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dd981683600/0xce1582440fb1fba2 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263917.502334:0:22890:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dd981683600/0xce1582440fb1fba2 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263917.502342:0:22890:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789263917.502366:0:22890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:71777701-7db4-46a4-b468-7d1ca0b29a68+11:2397:x1876178888713728:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 180us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263917.502373:0:22890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 14 00010000:00010000:2.0:1789263917.502540:0:25928:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dd981683600/0xce1582440fb1fba2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263917.502549:0:25928:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dd981683600/0xce1582440fb1fba2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263917.502556:0:25928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd981683600/0xce1582440fb1fba2 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789263917.550967:0:22941:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789263917.550979:0:22941:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789263917.551187:0:22941:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 1 00000040:00080000:1.0:1789263917.551238:0:22941:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789263917.551418:0:22941:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00010000:00010000:1.0:1789263918.445725:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789263918.547525:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263918.547623:0:22938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888713856 00000100:00100000:1.0:1789263918.547633:0:22938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888713856 00000100:00100000:1.0:1789263918.547816:0:22938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 23 00000100:00100000:1.0:1789263918.547828:0:22938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883b6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+7:18854:x1876178888713856:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789263918.547847:0:22938:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263918.547879:0:22938:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3400/0xce1582440fb1fba9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d12409 expref: -99 pid: 22938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.547940:0:22938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1fbb0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.547954:0:22938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1fbb0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.547967:0:22938:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1fbb0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.547982:0:22938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2c00/0xce1582440fb1fbb7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.547989:0:22938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2c00/0xce1582440fb1fbb7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.547996:0:22938:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2c00/0xce1582440fb1fbb7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.548127:0:22938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3c00/0xce1582440fb1fbbe lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.548136:0:22938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3c00/0xce1582440fb1fbbe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.549442:0:22938:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3c00/0xce1582440fb1fbbe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789263918.549494:0:22938:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789263918.549498:0:22938:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789263918.549537:0:22938:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3c00/0xce1582440fb1fbbe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.549556:0:22938:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1fbb0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.549563:0:22938:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1fbb0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.549570:0:22938:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1fbb0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.549576:0:22938:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd8841a2e00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263918.549580:0:22938:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1fbb0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.549588:0:22938:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1fbb0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.549600:0:22938:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd9c0a5f400) 00010000:00010000:1.0:1789263918.549603:0:22938:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263918.549607:0:22938:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1fbb0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.549613:0:22938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1fbb0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.549627:0:22938:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2c00/0xce1582440fb1fbb7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.549634:0:22938:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2c00/0xce1582440fb1fbb7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.549640:0:22938:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2c00/0xce1582440fb1fbb7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.549651:0:22938:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd8841a2c00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263918.549655:0:22938:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2c00/0xce1582440fb1fbb7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.549661:0:22938:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2c00/0xce1582440fb1fbb7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.549669:0:22938:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9dd883dd9d00) 00010000:00010000:1.0:1789263918.549684:0:22938:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263918.549687:0:22938:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2c00/0xce1582440fb1fbb7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.549693:0:22938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2c00/0xce1582440fb1fbb7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.549726:0:22938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3400/0xce1582440fb1fba9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12409 expref: 9 pid: 22938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.549740:0:22938:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3c00/0xce1582440fb1fbbe lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12409 expref: 8 pid: 22938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.549748:0:22938:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9dd883dd9300) 00010000:00010000:1.0:1789263918.549750:0:22938:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789263918.549753:0:22938:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd8841a3c00, rc 0) 00000100:00100000:1.0:1789263918.549806:0:22938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883b6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+8:18854:x1876178888713856:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 1981us (2289us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263918.549813:0:22938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 23 00000100:00080000:3.0:1789263918.550478:0:22900:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789263918.558524:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263918.558714:0:22914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888713984 00000100:00100000:3.0:1789263918.558724:0:22914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888713984 00000100:00100000:3.0:1789263918.558785:0:22914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 5 00000100:00100000:3.0:1789263918.558807:0:22914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+8:18854:x1876178888713984:12345-192.168.203.20@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1789263918.558891:0:22914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+8:18854:x1876178888713984:12345-192.168.203.20@tcp:900:lhsmtool_posix.0 Request processed in 88us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263918.558899:0:22914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 5 00000100:00100000:0.0:1789263918.570478:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263918.570568:0:22905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888714240 00000100:00100000:3.0:1789263918.570578:0:22905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888714240 00000100:00100000:3.0:1789263918.570642:0:22905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 24 00000100:00100000:3.0:1789263918.570652:0:22905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+8:18854:x1876178888714240:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789263918.570681:0:22905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263918.570702:0:22905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432c00/0xce1582440fb1fbc5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d12410 expref: -99 pid: 22905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263918.570769:0:22905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432a00/0xce1582440fb1fbcc lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263918.570782:0:22905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432a00/0xce1582440fb1fbcc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263918.570794:0:22905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432a00/0xce1582440fb1fbcc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263918.570806:0:22905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432600/0xce1582440fb1fbd3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263918.570812:0:22905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432600/0xce1582440fb1fbd3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263918.570818:0:22905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432600/0xce1582440fb1fbd3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263918.570916:0:22905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433000/0xce1582440fb1fbda lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263918.570924:0:22905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433000/0xce1582440fb1fbda lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263918.570930:0:22905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433000/0xce1582440fb1fbda lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789263918.570948:0:22905:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00000001:00080000:2.0:1789263918.572800:0:22884:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901889 is committed 00000001:00100000:2.0:1789263918.572815:0:22884:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 348595dd-7686-4b9f-85ef-acc7d3e74d64 00000001:00100000:2.0:1789263918.572820:0:22884:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d 00010000:00010000:3.0:1789263918.573136:0:22905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432a00/0xce1582440fb1fbcc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263918.573147:0:22905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432a00/0xce1582440fb1fbcc lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263918.573154:0:22905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432a00/0xce1582440fb1fbcc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263918.573159:0:22905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd990432a00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263918.573163:0:22905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432a00/0xce1582440fb1fbcc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263918.573169:0:22905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432a00/0xce1582440fb1fbcc lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263918.573183:0:22905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9dd883dd9300) 00010000:00010000:3.0:1789263918.573186:0:22905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789263918.573191:0:22905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432a00/0xce1582440fb1fbcc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263918.573197:0:22905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432a00/0xce1582440fb1fbcc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263918.573210:0:22905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432600/0xce1582440fb1fbd3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263918.573216:0:22905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432600/0xce1582440fb1fbd3 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263918.573234:0:22905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432600/0xce1582440fb1fbd3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263918.573239:0:22905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd990432600 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263918.573242:0:22905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432600/0xce1582440fb1fbd3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263918.573249:0:22905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432600/0xce1582440fb1fbd3 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263918.573257:0:22905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9dd9bb596000) 00010000:00010000:3.0:1789263918.573259:0:22905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789263918.573262:0:22905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432600/0xce1582440fb1fbd3 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263918.573267:0:22905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432600/0xce1582440fb1fbd3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263918.574141:0:22905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432c00/0xce1582440fb1fbc5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12410 expref: 9 pid: 22905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263918.574158:0:22905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990433000/0xce1582440fb1fbda lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12410 expref: 8 pid: 22905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263918.574167:0:22905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9dd9bb596d00) 00010000:00010000:3.0:1789263918.574169:0:22905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789263918.574172:0:22905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd990433000, rc 0) 00000100:00100000:3.0:1789263918.574241:0:22905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+8:18854:x1876178888714240:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 3590us (3772us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1789263918.574259:0:22905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 24 00000100:00100000:0.0:1789263918.584443:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263918.584801:0:22904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888714368 00000100:00100000:2.0:1789263918.584811:0:22904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888714368 00000100:00100000:2.0:1789263918.584902:0:22904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 25 00000100:00100000:2.0:1789263918.584913:0:22904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+8:18854:x1876178888714368:12345-192.168.203.20@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789263918.585061:0:22904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+8:18854:x1876178888714368:12345-192.168.203.20@tcp:59:lhsmtool_posix.0 Request processed in 149us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263918.585994:0:22904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 25 00000100:00100000:1.0:1789263918.590309:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263918.590457:0:22903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888714496 00000100:00100000:0.0:1789263918.590465:0:22903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888714496 00000100:00100000:0.0:1789263918.590573:0:22903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 26 00000100:00100000:0.0:1789263918.590583:0:22903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+6:18854:x1876178888714496:12345-192.168.203.20@tcp:59:lhsmtool_posix.0 00000004:00080000:0.0:1789263918.591128:0:22903:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 510us 00000100:00080000:3.0:1789263918.594304:0:22900:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789263918.600629:0:22903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+6:18854:x1876178888714496:12345-192.168.203.20@tcp:59:lhsmtool_posix.0 Request processed in 10039us (10318us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263918.600642:0:22903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 26 00000100:00100000:0.0:1789263918.603471:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263918.603789:0:22938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888714624 00000100:00100000:1.0:1789263918.603798:0:22938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888714624 00000100:00100000:1.0:1789263918.603837:0:22938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 27 00000100:00100000:1.0:1789263918.603843:0:22938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+8:18860:x1876178888714624:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:1.0:1789263918.603860:0:22938:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263918.603876:0:22938:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1fbe8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d12417 expref: -99 pid: 22938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.603922:0:22938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3a00/0xce1582440fb1fbef lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.603932:0:22938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3a00/0xce1582440fb1fbef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.603940:0:22938:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3a00/0xce1582440fb1fbef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.603979:0:22938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2c00/0xce1582440fb1fbf6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.603984:0:22938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2c00/0xce1582440fb1fbf6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.603989:0:22938:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2c00/0xce1582440fb1fbf6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.604018:0:22938:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3a00/0xce1582440fb1fbef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.604022:0:22938:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3a00/0xce1582440fb1fbef lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.604044:0:22938:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3a00/0xce1582440fb1fbef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.604048:0:22938:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd8841a3a00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263918.604051:0:22938:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3a00/0xce1582440fb1fbef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.604056:0:22938:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3a00/0xce1582440fb1fbef lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.604064:0:22938:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd9c0a5f400) 00010000:00010000:1.0:1789263918.604066:0:22938:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263918.604070:0:22938:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3a00/0xce1582440fb1fbef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.604091:0:22938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a3a00/0xce1582440fb1fbef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.604101:0:22938:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2c00/0xce1582440fb1fbf6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.604106:0:22938:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2c00/0xce1582440fb1fbf6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.604109:0:22938:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2c00/0xce1582440fb1fbf6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.604112:0:22938:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd8841a2c00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263918.604114:0:22938:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2c00/0xce1582440fb1fbf6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.604127:0:22938:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2c00/0xce1582440fb1fbf6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.604137:0:22938:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9dd883dd9d00) 00010000:00010000:1.0:1789263918.604139:0:22938:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263918.604141:0:22938:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2c00/0xce1582440fb1fbf6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.604145:0:22938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2c00/0xce1582440fb1fbf6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.604167:0:22938:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1fbe8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12417 expref: 9 pid: 22938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.604173:0:22938:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd9c0a5f400) 00010000:00010000:1.0:1789263918.604175:0:22938:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263918.604177:0:22938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1fbe8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12417 expref: 9 pid: 22938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.604183:0:22938:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd8841a2e00, rc 0) 00000100:00100000:1.0:1789263918.605865:0:22938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+8:18860:x1876178888714624:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 2016us (2396us total) trans 0 rc 301/301 00000100:00100000:1.0:1789263918.605873:0:22938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 27 00000100:00100000:1.0:1789263918.611201:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263918.611342:0:22912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888714752 00000100:00100000:3.0:1789263918.611366:0:22912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888714752 00000100:00100000:3.0:1789263918.611423:0:22912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 0 00000100:00100000:3.0:1789263918.611435:0:22912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+8:18860:x1876178888714752:12345-192.168.203.20@tcp:700:lfs.0 00000100:00100000:3.0:1789263918.611520:0:22912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+8:18860:x1876178888714752:12345-192.168.203.20@tcp:700:lfs.0 Request processed in 88us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263918.611529:0:22912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 0 00000100:00100000:0.0:1789263918.614408:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263918.614512:0:22905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888715008 00000100:00100000:2.0:1789263918.614519:0:22905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888715008 00000100:00100000:2.0:1789263918.614576:0:22905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 28 00000100:00100000:2.0:1789263918.614584:0:22905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+8:18860:x1876178888715008:12345-192.168.203.20@tcp:36:lfs.0 00010000:00010000:2.0:1789263918.614640:0:22905:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789263918.614670:0:22905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9bfa23600/0xce1582440fb1fb5c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12392 expref: 8 pid: 22903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263918.614712:0:22905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd9c0a5f400) 00010000:00010000:2.0:1789263918.614717:0:22905:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789263918.614782:0:22905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683600/0xce1582440fb1fbfd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263918.614796:0:22905:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3b400/0xce1582440fb1fb9b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12402 expref: 5 pid: 22903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263918.614805:0:22905:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683600/0xce1582440fb1fbfd lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263918.614834:0:22905:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3b400/0xce1582440fb1fb9b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12402 expref: 5 pid: 22903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263918.614846:0:22905:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3b400/0xce1582440fb1fb9b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12402 expref: 5 pid: 22903 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263918.614871:0:22905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22905:1876178898185216:192.168.203.20@tcp:104: 00000100:00100000:2.0:1789263918.614948:0:22905:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd8826849c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789263918.617132:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263918.617299:0:22905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22905:1876178898185216:192.168.203.20@tcp:104: 00010000:00010000:2.0:1789263918.617322:0:22905:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683600/0xce1582440fb1fbfd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263918.617387:0:22889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888715136 00000100:00100000:1.0:1789263918.617394:0:22889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888715136 00010000:00010000:1.0:1789263918.617493:0:22889:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3b400/0xce1582440fb1fb9b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12402 expref: 6 pid: 22903 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263918.617551:0:22889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 15 00000100:00100000:1.0:1789263918.617560:0:22889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa91180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:348595dd-7686-4b9f-85ef-acc7d3e74d64+6:2397:x1876178888715136:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789263918.617573:0:22889:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789263918.617579:0:22889:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3b400/0xce1582440fb1fb9b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12402 expref: 6 pid: 22903 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.617591:0:22889:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3b400/0xce1582440fb1fb9b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12402 expref: 6 pid: 22903 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.617611:0:22889:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3b400/0xce1582440fb1fb9b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12402 expref: 6 pid: 22903 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.617625:0:22889:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd9c0a5f400) 00010000:00010000:1.0:1789263918.617630:0:22889:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683600/0xce1582440fb1fbfd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.617639:0:22889:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683600/0xce1582440fb1fbfd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.617644:0:22889:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683600/0xce1582440fb1fbfd lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.617663:0:22889:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789263918.617688:0:22905:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683600/0xce1582440fb1fbfd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263918.617695:0:22905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683600/0xce1582440fb1fbfd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263918.617715:0:22905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683000/0xce1582440fb1fc04 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263918.617721:0:22889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa91180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:348595dd-7686-4b9f-85ef-acc7d3e74d64+5:2397:x1876178888715136:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 163us (595us total) trans 0 rc 0/0 00010000:00010000:2.0:1789263918.617724:0:22905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683000/0xce1582440fb1fc04 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263918.617731:0:22905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683000/0xce1582440fb1fc04 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263918.617734:0:22889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 15 00000100:00080000:3.0:1789263918.617811:0:22900:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789263918.619866:0:22905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683800/0xce1582440fb1fc0b lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263918.619883:0:22905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683800/0xce1582440fb1fc0b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263918.619893:0:22905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683800/0xce1582440fb1fc0b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789263918.619923:0:22905:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a307a976 reply state 000000007e5eb15d transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683800/0xce1582440fb1fc0b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263918.619936:0:22905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683800/0xce1582440fb1fc0b lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263918.619943:0:22905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9dd9b79de400) 00010000:00010000:2.0:1789263918.619946:0:22905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789263918.619949:0:22905:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789263918.619955:0:22905:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789263918.619962:0:22905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683600/0xce1582440fb1fbfd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263918.619969:0:22905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683600/0xce1582440fb1fbfd lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263918.619976:0:22905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683600/0xce1582440fb1fbfd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263918.619982:0:22905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981683600 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263918.619986:0:22905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683600/0xce1582440fb1fbfd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263918.619994:0:22905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683600/0xce1582440fb1fbfd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263918.620004:0:22905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd9c0a5f400) 00010000:00010000:2.0:1789263918.620006:0:22905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789263918.620010:0:22905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683600/0xce1582440fb1fbfd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263918.620028:0:22905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683600/0xce1582440fb1fbfd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789263918.620046:0:22905:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a307a976 reply state 000000007e5eb15d transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683000/0xce1582440fb1fc04 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263918.620056:0:22905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683000/0xce1582440fb1fc04 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263918.620062:0:22905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9dd9b79dea00) 00010000:00010000:2.0:1789263918.620064:0:22905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789263918.620066:0:22905:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1789263918.620264:0:22905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+9:18860:x1876178888715008:12345-192.168.203.20@tcp:36:lfs.0 Request processed in 5677us (5865us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1789263918.620272:0:22905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 28 00000001:00100000:0.0:1789263918.646195:0:24406:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 348595dd-7686-4b9f-85ef-acc7d3e74d64 00000001:00100000:0.0:1789263918.646208:0:24406:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d 00000001:00100000:1.0:1789263918.646825:0:23638:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 348595dd-7686-4b9f-85ef-acc7d3e74d64 00000001:00100000:1.0:1789263918.646841:0:23638:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d 00000100:00100000:0.0:1789263918.695393:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263918.695522:0:22904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888715264 00000100:00100000:2.0:1789263918.695532:0:22904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888715264 00000100:00100000:2.0:1789263918.695587:0:22904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 29 00000100:00100000:2.0:1789263918.695597:0:22904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+9:18868:x1876178888715264:12345-192.168.203.20@tcp:101:lctl.0 00010000:00010000:2.0:1789263918.695619:0:22904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263918.695639:0:22904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683600/0xce1582440fb1fc12 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d1241e expref: -99 pid: 22904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263918.695707:0:22904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981682200/0xce1582440fb1fc19 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263918.695720:0:22904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981682200/0xce1582440fb1fc19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263918.695746:0:22904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981682200/0xce1582440fb1fc19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789263918.695783:0:22904:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789263918.695787:0:22904:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789263918.695832:0:22904:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981682200/0xce1582440fb1fc19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263918.695854:0:22904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683600/0xce1582440fb1fc12 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1241e expref: 11 pid: 22904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263918.695871:0:22904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981682200/0xce1582440fb1fc19 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1241e expref: 10 pid: 22904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263918.695881:0:22904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd9b79dec00) 00010000:00010000:2.0:1789263918.695883:0:22904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789263918.695887:0:22904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981682200, rc 0) 00000100:00100000:2.0:1789263918.695943:0:22904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+10:18868:x1876178888715264:12345-192.168.203.20@tcp:101:lctl.0 Request processed in 347us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263918.695950:0:22904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 29 10000000:01000000:2.0:1789263918.701289:0:22901:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789263918.701296:0:22901:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dd9abedd000 from 13 10000000:01000000:2.0:1789263918.701301:0:22901:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789263918.701345:0:22901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd981683600/0xce1582440fb1fc20 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263918.701426:0:22901:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd981683600/0xce1582440fb1fc20 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263918.701449:0:22901:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd981683600/0xce1582440fb1fc20 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263918.701471:0:22901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22901:1876178898185344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789263918.701656:0:22901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263918.701706:0:22901:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd882684900 going to sleep for 11 seconds 00000100:00100000:0.0:1789263918.701911:0:22896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898185344 00000100:00100000:0.0:1789263918.701919:0:22896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898185344 00000100:00100000:0.0:1789263918.701991:0:22896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789263918.702001:0:22896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9ab807c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+20:22901:x1876178898185344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789263918.702014:0:22896:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263918.702027:0:22896:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd9abf3ba00/0xce1582440fb1fc27 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1fc20 expref: -99 pid: 22896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263918.702049:0:22896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd9abf3ba00/0xce1582440fb1fc27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1fc20 expref: 21 pid: 22896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263918.702069:0:22896:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd9abf3ba00/0xce1582440fb1fc27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1fc20 expref: 21 pid: 22896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263918.702202:0:22896:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9abf3ba00, rc 0) 00000100:00100000:0.0:1789263918.702255:0:22896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9ab807c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+21:22901:x1876178898185344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 256us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263918.702262:0:22896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789263918.702400:0:22901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22901:1876178898185344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789263918.702414:0:22901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd981683600/0xce1582440fb1fc20 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1fc27 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263918.702422:0:22901:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd981683600/0xce1582440fb1fc20 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1fc27 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263918.702495:0:22901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd883b6d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22901:1876178898185472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789263918.702521:0:22901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263918.702546:0:22901:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd98b2480c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789263918.702649:0:22899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898185472 00000100:00100000:0.0:1789263918.702654:0:22899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898185472 00000100:00100000:0.0:1789263918.702692:0:22899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789263918.702699:0:22899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9ab806450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+21:22901:x1876178898185472:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789263918.702917:0:22899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9ab806450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+21:22901:x1876178898185472:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 218us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263918.702924:0:22899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789263918.703034:0:22901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd883b6d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22901:1876178898185472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789263918.703192:0:22901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88297d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22901:1876178898185600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789263918.703232:0:22901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263918.703248:0:22901:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9862b6c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789263918.703308:0:22898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898185600 00000100:00100000:2.0:1789263918.703313:0:22898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898185600 00000100:00100000:2.0:1789263918.703341:0:22898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789263918.703347:0:22898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9ab806050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec0ec848-5fac-4f6a-ba8a-daed864d309d+21:22901:x1876178898185600:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789263918.703537:0:22898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9ab806050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec0ec848-5fac-4f6a-ba8a-daed864d309d+21:22901:x1876178898185600:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 189us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263918.703543:0:22898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789263918.703614:0:22901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88297d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22901:1876178898185600:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789263918.707429:0:25943:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1789263918.707860:0:22901:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1789263918.707880:0:22901:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789263918.707890:0:22901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd981683600/0xce1582440fb1fc20 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1fc27 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.707901:0:22901:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd981683600/0xce1582440fb1fc20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1fc27 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789263918.707910:0:22901:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789263918.707913:0:22901:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dd9abd9e000 from 13 10000000:01000000:1.0:1789263918.707915:0:22901:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789263918.707946:0:22901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd8841a3a00/0xce1582440fb1fc2e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.707954:0:22901:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd8841a3a00/0xce1582440fb1fc2e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.707965:0:22901:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd8841a3a00/0xce1582440fb1fc2e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263918.707986:0:22901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88297d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22901:1876178898185728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789263918.708044:0:22901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263918.708416:0:22896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898185728 00000100:00100000:3.0:1789263918.708423:0:22896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898185728 00000100:00100000:3.0:1789263918.708471:0:22896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789263918.708481:0:22896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9ab805c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+21:22901:x1876178898185728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789263918.708493:0:22896:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263918.708510:0:22896:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd990432c00/0xce1582440fb1fc35 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1fc2e expref: -99 pid: 22896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263918.708531:0:22896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd990432c00/0xce1582440fb1fc35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1fc2e expref: 22 pid: 22896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263918.708542:0:22896:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd990432c00/0xce1582440fb1fc35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1fc2e expref: 22 pid: 22896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263918.708550:0:22896:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd990432c00, rc 0) 00000100:00100000:3.0:1789263918.708585:0:22896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9ab805c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+22:22901:x1876178898185728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263918.708592:0:22896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789263918.708872:0:22901:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9862b6c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789263918.708893:0:22901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88297d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22901:1876178898185728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789263918.708907:0:22901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd8841a3a00/0xce1582440fb1fc2e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1fc35 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.708915:0:22901:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd8841a3a00/0xce1582440fb1fc2e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1fc35 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263918.708967:0:22901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88297d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22901:1876178898185856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789263918.708994:0:22901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263918.709013:0:22901:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9862b6c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789263918.709155:0:22899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898185856 00000100:00100000:0.0:1789263918.709159:0:22899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898185856 00000100:00100000:0.0:1789263918.709181:0:22899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789263918.709187:0:22899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9ab804050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+22:22901:x1876178898185856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789263918.709331:0:22899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9ab804050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+22:22901:x1876178898185856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 143us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263918.709338:0:22899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789263918.709560:0:22901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88297d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22901:1876178898185856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789263918.709587:0:22901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88297d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22901:1876178898185984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789263918.709625:0:22901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263918.709650:0:22901:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9862b6c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789263918.709709:0:22898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898185984 00000100:00100000:2.0:1789263918.709714:0:22898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898185984 00000100:00100000:2.0:1789263918.709752:0:22898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789263918.709759:0:22898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9ab805050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec0ec848-5fac-4f6a-ba8a-daed864d309d+22:22901:x1876178898185984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789263918.709848:0:22898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9ab805050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec0ec848-5fac-4f6a-ba8a-daed864d309d+22:22901:x1876178898185984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 90us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263918.709855:0:22898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789263918.710013:0:22901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88297d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22901:1876178898185984:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789263918.711643:0:25944:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1789263918.717313:0:22901:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1789263918.717368:0:22901:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789263918.717382:0:22901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd8841a3a00/0xce1582440fb1fc2e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1fc35 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.717394:0:22901:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd8841a3a00/0xce1582440fb1fc2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1fc35 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789263918.717406:0:22901:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789263918.717409:0:22901:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dd883f8c000 from 13 10000000:01000000:1.0:1789263918.717412:0:22901:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789263918.717463:0:22901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd8841a3400/0xce1582440fb1fc3c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.717471:0:22901:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd8841a3400/0xce1582440fb1fc3c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.717482:0:22901:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd8841a3400/0xce1582440fb1fc3c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263918.717506:0:22901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88297d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22901:1876178898186112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789263918.717569:0:22901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263918.717601:0:22901:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9862b6c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789263918.717768:0:22898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898186112 00000100:00100000:2.0:1789263918.717775:0:22898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898186112 00000100:00100000:2.0:1789263918.717831:0:22898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789263918.717840:0:22898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec0ec848-5fac-4f6a-ba8a-daed864d309d+22:22901:x1876178898186112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789263918.717853:0:22898:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263918.717869:0:22898:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd981683c00/0xce1582440fb1fc43 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1fc3c expref: -99 pid: 22898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263918.717891:0:22898:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd981683c00/0xce1582440fb1fc43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1fc3c expref: 23 pid: 22898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263918.717901:0:22898:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd981683c00/0xce1582440fb1fc43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1fc3c expref: 23 pid: 22898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263918.717910:0:22898:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981683c00, rc 0) 00000100:00100000:2.0:1789263918.717957:0:22898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec0ec848-5fac-4f6a-ba8a-daed864d309d+23:22901:x1876178898186112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263918.717964:0:22898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789263918.720001:0:22901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88297d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22901:1876178898186112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789263918.720022:0:22901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd8841a3400/0xce1582440fb1fc3c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1fc43 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.720034:0:22901:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd8841a3400/0xce1582440fb1fc3c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1fc43 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263918.720282:0:22901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88297d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22901:1876178898186240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789263918.720323:0:22901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263918.720399:0:22901:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9862b6c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789263918.720663:0:22896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898186240 00000100:00100000:0.0:1789263918.720669:0:22896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898186240 00000100:00100000:0.0:1789263918.720762:0:22896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789263918.720772:0:22896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+23:22901:x1876178898186240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789263918.720931:0:22896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+23:22901:x1876178898186240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 161us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263918.720938:0:22896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789263918.721172:0:22901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88297d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22901:1876178898186240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789263918.721200:0:22901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88297d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22901:1876178898186368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789263918.721241:0:22901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263918.721266:0:22901:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9862b6c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789263918.721504:0:22899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898186368 00000100:00100000:2.0:1789263918.721509:0:22899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898186368 00000100:00100000:2.0:1789263918.721538:0:22899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789263918.721546:0:22899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+23:22901:x1876178898186368:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789263918.721626:0:22899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+23:22901:x1876178898186368:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 81us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263918.721633:0:22899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789263918.721718:0:22901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88297d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22901:1876178898186368:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789263918.722963:0:25945:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1789263918.723198:0:22901:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1789263918.723217:0:22901:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789263918.723226:0:22901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd8841a3400/0xce1582440fb1fc3c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1fc43 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263918.723236:0:22901:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd8841a3400/0xce1582440fb1fc3c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1fc43 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789263918.723246:0:22901:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789263918.723253:0:22901:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dd9ac8fd000 from 13 10000000:01000000:2.0:1789263918.723255:0:22901:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789263918.723279:0:22901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd981682600/0xce1582440fb1fc4a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263918.723286:0:22901:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff9dd981682600/0xce1582440fb1fc4a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263918.723295:0:22901:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff9dd981682600/0xce1582440fb1fc4a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263918.723311:0:22901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22901:1876178898186496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789263918.723347:0:22901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263918.723514:0:22901:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd882684000 going to sleep for 11 seconds 00000100:00100000:1.0:1789263918.723585:0:22899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898186496 00000100:00100000:1.0:1789263918.723591:0:22899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898186496 00000100:00100000:1.0:1789263918.723618:0:22899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789263918.723625:0:22899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+23:22901:x1876178898186496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789263918.723635:0:22899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263918.723646:0:22899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd8841a2800/0xce1582440fb1fc51 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xce1582440fb1fc4a expref: -99 pid: 22899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.723666:0:22899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd8841a2800/0xce1582440fb1fc51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce1582440fb1fc4a expref: 24 pid: 22899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.723685:0:22899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd8841a2800/0xce1582440fb1fc51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce1582440fb1fc4a expref: 24 pid: 22899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.723693:0:22899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd8841a2800, rc 0) 00000100:00100000:1.0:1789263918.723725:0:22899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+24:22901:x1876178898186496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263918.723731:0:22899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789263918.723904:0:22901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22901:1876178898186496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789263918.723915:0:22901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff9dd981682600/0xce1582440fb1fc4a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1fc51 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263918.723924:0:22901:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff9dd981682600/0xce1582440fb1fc4a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xce1582440fb1fc51 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263918.723966:0:22901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22901:1876178898186624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789263918.723990:0:22901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263918.724008:0:22901:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd882684000 going to sleep for 11 seconds 00000100:00100000:1.0:1789263918.724055:0:22899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898186624 00000100:00100000:1.0:1789263918.724059:0:22899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898186624 00000100:00100000:1.0:1789263918.724113:0:22899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789263918.724119:0:22899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+24:22901:x1876178898186624:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789263918.724210:0:22899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec0ec848-5fac-4f6a-ba8a-daed864d309d+24:22901:x1876178898186624:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 91us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263918.724216:0:22899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789263918.724324:0:22901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22901:1876178898186624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789263918.724349:0:22901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22901:1876178898186752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789263918.724396:0:22901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263918.724421:0:22901:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd882684000 going to sleep for 11 seconds 00000100:00100000:1.0:1789263918.724529:0:22898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898186752 00000100:00100000:1.0:1789263918.724533:0:22898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898186752 00000100:00100000:1.0:1789263918.724567:0:22898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789263918.724573:0:22898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec0ec848-5fac-4f6a-ba8a-daed864d309d+24:22901:x1876178898186752:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789263918.724642:0:22898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec0ec848-5fac-4f6a-ba8a-daed864d309d+24:22901:x1876178898186752:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 68us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263918.724649:0:22898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789263918.724731:0:22901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec0ec848-5fac-4f6a-ba8a-daed864d309d:22901:1876178898186752:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789263918.725997:0:25946:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1789263918.726339:0:22901:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1789263918.726451:0:22901:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789263918.726459:0:22901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff9dd981682600/0xce1582440fb1fc4a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1fc51 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.726470:0:22901:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff9dd981682600/0xce1582440fb1fc4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xce1582440fb1fc51 expref: -99 pid: 22901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263918.729093:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263918.729127:0:22903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888715392 00000100:00100000:0.0:1789263918.729136:0:22903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888715392 00000100:00100000:0.0:1789263918.729177:0:22903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 30 00000100:00100000:0.0:1789263918.729183:0:22903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:348595dd-7686-4b9f-85ef-acc7d3e74d64+5:18869:x1876178888715392:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:0.0:1789263918.729198:0:22903:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263918.729213:0:22903:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3b800/0xce1582440fb1fc58 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d12425 expref: -99 pid: 22903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263918.729270:0:22903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a800/0xce1582440fb1fc5f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263918.729280:0:22903:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a800/0xce1582440fb1fc5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263918.729289:0:22903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a800/0xce1582440fb1fc5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22903 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789263918.729318:0:22903:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789263918.729320:0:22903:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789263918.729336:0:22903:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a800/0xce1582440fb1fc5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263918.729368:0:22903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3b800/0xce1582440fb1fc58 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12425 expref: 7 pid: 22903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263918.729383:0:22903:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a800/0xce1582440fb1fc5f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12425 expref: 6 pid: 22903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263918.729391:0:22903:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd9b79dec00) 00010000:00010000:0.0:1789263918.729393:0:22903:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789263918.729397:0:22903:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9abf3a800, rc 0) 00000100:00100000:0.0:1789263918.729447:0:22903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:348595dd-7686-4b9f-85ef-acc7d3e74d64+6:18869:x1876178888715392:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 263us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263918.729454:0:22903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 30 00000100:00100000:0.0:1789263918.731026:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263918.731119:0:22904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888715520 00000100:00100000:2.0:1789263918.731126:0:22904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888715520 00000100:00100000:2.0:1789263918.731157:0:22904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 31 00000100:00100000:2.0:1789263918.731165:0:22904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:348595dd-7686-4b9f-85ef-acc7d3e74d64+6:18869:x1876178888715520:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:2.0:1789263918.731177:0:22904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263918.731189:0:22904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683200/0xce1582440fb1fc66 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d1242c expref: -99 pid: 22904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263918.731229:0:22904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981682000/0xce1582440fb1fc6d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263918.731239:0:22904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981682000/0xce1582440fb1fc6d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263918.731249:0:22904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981682000/0xce1582440fb1fc6d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263918.731259:0:22904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683e00/0xce1582440fb1fc74 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263918.731266:0:22904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683e00/0xce1582440fb1fc74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263918.731273:0:22904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683e00/0xce1582440fb1fc74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263918.731336:0:22904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683a00/0xce1582440fb1fc7b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263918.731373:0:22904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683a00/0xce1582440fb1fc7b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263918.731381:0:22904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683a00/0xce1582440fb1fc7b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789263918.731409:0:22904:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789263918.731413:0:22904:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789263918.731427:0:22904:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683a00/0xce1582440fb1fc7b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263918.731438:0:22904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981682000/0xce1582440fb1fc6d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263918.731444:0:22904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981682000/0xce1582440fb1fc6d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263918.731450:0:22904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981682000/0xce1582440fb1fc6d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263918.731456:0:22904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981682000 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263918.731460:0:22904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981682000/0xce1582440fb1fc6d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263918.731468:0:22904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981682000/0xce1582440fb1fc6d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263918.731479:0:22904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd9b79dec00) 00010000:00010000:2.0:1789263918.731483:0:22904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789263918.731486:0:22904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981682000/0xce1582440fb1fc6d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263918.731501:0:22904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981682000/0xce1582440fb1fc6d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263918.731513:0:22904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683e00/0xce1582440fb1fc74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263918.731519:0:22904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683e00/0xce1582440fb1fc74 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263918.731524:0:22904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683e00/0xce1582440fb1fc74 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263918.731528:0:22904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981683e00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:2.0:1789263918.731531:0:22904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683e00/0xce1582440fb1fc74 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263918.731537:0:22904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683e00/0xce1582440fb1fc74 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263918.731544:0:22904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9dd9b79dea00) 00010000:00010000:2.0:1789263918.731547:0:22904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789263918.731550:0:22904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683e00/0xce1582440fb1fc74 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263918.731556:0:22904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683e00/0xce1582440fb1fc74 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263918.731577:0:22904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683200/0xce1582440fb1fc66 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1242c expref: 8 pid: 22904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263918.731602:0:22904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683a00/0xce1582440fb1fc7b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1242c expref: 7 pid: 22904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263918.731609:0:22904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9dd9b79de400) 00010000:00010000:2.0:1789263918.731611:0:22904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789263918.731614:0:22904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981683a00, rc 0) 00000100:00100000:2.0:1789263918.731657:0:22904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:348595dd-7686-4b9f-85ef-acc7d3e74d64+7:18869:x1876178888715520:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 493us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263918.731664:0:22904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 31 00000100:00100000:1.0:1789263918.741477:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263918.741640:0:22914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888715648 00000100:00100000:3.0:1789263918.741650:0:22914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888715648 00000100:00100000:3.0:1789263918.741723:0:22914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 6 00000100:00100000:3.0:1789263918.741734:0:22914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:348595dd-7686-4b9f-85ef-acc7d3e74d64+5:18869:x1876178888715648:12345-192.168.203.20@tcp:900:lfs.0 00000100:00100000:3.0:1789263918.741815:0:22914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:348595dd-7686-4b9f-85ef-acc7d3e74d64+5:18869:x1876178888715648:12345-192.168.203.20@tcp:900:lfs.0 Request processed in 82us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263918.741824:0:22914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 6 00000100:00080000:0.0:1789263918.742257:0:22900:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789263918.744241:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263918.744330:0:22903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888715904 00000100:00100000:0.0:1789263918.744338:0:22903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888715904 00000100:00100000:0.0:1789263918.744379:0:22903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 32 00000100:00100000:0.0:1789263918.744386:0:22903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:348595dd-7686-4b9f-85ef-acc7d3e74d64+7:18869:x1876178888715904:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:0.0:1789263918.744400:0:22903:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263918.744414:0:22903:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3b800/0xce1582440fb1fc82 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d12433 expref: -99 pid: 22903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789263918.744496:0:22903:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789263918.744571:0:22903:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3b800/0xce1582440fb1fc82 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12433 expref: 9 pid: 22903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263918.744582:0:22903:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd9b79dec00) 00010000:00010000:0.0:1789263918.744584:0:22903:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789263918.744587:0:22903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3b800/0xce1582440fb1fc82 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12433 expref: 9 pid: 22903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263918.744595:0:22903:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9abf3b800, rc 0) 00000100:00100000:0.0:1789263918.744636:0:22903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:348595dd-7686-4b9f-85ef-acc7d3e74d64+8:18869:x1876178888715904:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 251us (401us total) trans 12884901891 rc 301/301 00000100:00100000:0.0:1789263918.744641:0:22903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 32 00000100:00100000:1.0:1789263918.746290:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263918.746643:0:22938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888716160 00000100:00100000:2.0:1789263918.746652:0:22938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888716160 00000100:00100000:2.0:1789263918.746709:0:22938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 33 00000100:00100000:2.0:1789263918.746719:0:22938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88297ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:348595dd-7686-4b9f-85ef-acc7d3e74d64+8:18869:x1876178888716160:12345-192.168.203.20@tcp:36:lfs.0 00010000:00010000:2.0:1789263918.746756:0:22938:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789263918.746775:0:22938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683a00/0xce1582440fb1fc7b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1242c expref: 8 pid: 22904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263918.746799:0:22938:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9dd9b79de400) 00010000:00010000:2.0:1789263918.746803:0:22938:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789263918.746820:0:22938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683200/0xce1582440fb1fc90 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263918.746832:0:22938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683200/0xce1582440fb1fc90 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263918.746840:0:22938:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683200/0xce1582440fb1fc90 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789263918.747012:0:22938:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fff9ae57 reply state 00000000b4784cf5 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683200/0xce1582440fb1fc90 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263918.747024:0:22938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683200/0xce1582440fb1fc90 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263918.747031:0:22938:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9dd9b79de400) 00010000:00010000:2.0:1789263918.747034:0:22938:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:2.0:1789263918.747036:0:22938:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789263918.747042:0:22938:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1789263918.747138:0:22938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88297ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:348595dd-7686-4b9f-85ef-acc7d3e74d64+9:18869:x1876178888716160:12345-192.168.203.20@tcp:36:lfs.0 Request processed in 420us (851us total) trans 12884901892 rc 0/0 00000100:00100000:2.0:1789263918.747146:0:22938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 33 00000100:00100000:1.0:1789263918.748918:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263918.748966:0:22906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888716416 00000100:00100000:3.0:1789263918.748974:0:22906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888716416 00000100:00100000:3.0:1789263918.749049:0:22906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 2 00000100:00100000:3.0:1789263918.749059:0:22906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:348595dd-7686-4b9f-85ef-acc7d3e74d64+9:18869:x1876178888716416:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:3.0:1789263918.749275:0:22906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:348595dd-7686-4b9f-85ef-acc7d3e74d64+10:18869:x1876178888716416:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 216us (377us total) trans 12884901893 rc 0/0 00000100:00100000:3.0:1789263918.749282:0:22906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 2 00000100:00100000:0.0:1789263918.750853:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263918.750989:0:22905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888716672 00000100:00100000:3.0:1789263918.751006:0:22905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888716672 00000100:00100000:3.0:1789263918.751385:0:22905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 34 00000100:00100000:3.0:1789263918.751395:0:22905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882a6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:348595dd-7686-4b9f-85ef-acc7d3e74d64+10:18869:x1876178888716672:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:3.0:1789263918.751411:0:22905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263918.751428:0:22905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432600/0xce1582440fb1fc97 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d1243a expref: -99 pid: 22905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263918.751483:0:22905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432a00/0xce1582440fb1fc9e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263918.751497:0:22905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432a00/0xce1582440fb1fc9e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263918.751508:0:22905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432a00/0xce1582440fb1fc9e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263918.751518:0:22905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432800/0xce1582440fb1fca5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263918.751525:0:22905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432800/0xce1582440fb1fca5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263918.751532:0:22905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432800/0xce1582440fb1fca5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789263918.751612:0:22905:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789263918.752389:0:22905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432a00/0xce1582440fb1fc9e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263918.752399:0:22905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432a00/0xce1582440fb1fc9e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263918.752417:0:22905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432a00/0xce1582440fb1fc9e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263918.752423:0:22905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd990432a00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263918.752428:0:22905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432a00/0xce1582440fb1fc9e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263918.752436:0:22905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432a00/0xce1582440fb1fc9e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263918.752448:0:22905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd9b79dec00) 00010000:00010000:3.0:1789263918.752451:0:22905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789263918.752456:0:22905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432a00/0xce1582440fb1fc9e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263918.752462:0:22905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432a00/0xce1582440fb1fc9e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263918.752475:0:22905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432800/0xce1582440fb1fca5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263918.752481:0:22905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432800/0xce1582440fb1fca5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263918.752488:0:22905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432800/0xce1582440fb1fca5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263918.752493:0:22905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd990432800 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:3.0:1789263918.752496:0:22905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432800/0xce1582440fb1fca5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263918.752512:0:22905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432800/0xce1582440fb1fca5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263918.752521:0:22905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9dd9b79dea00) 00010000:00010000:3.0:1789263918.752523:0:22905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789263918.752526:0:22905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432800/0xce1582440fb1fca5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263918.752532:0:22905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432800/0xce1582440fb1fca5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263918.752561:0:22905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432600/0xce1582440fb1fc97 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1243a expref: 12 pid: 22905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263918.752572:0:22905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd9b79dec00) 00010000:00010000:3.0:1789263918.752574:0:22905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789263918.752577:0:22905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432600/0xce1582440fb1fc97 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1243a expref: 12 pid: 22905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263918.752586:0:22905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd990432600, rc 0) 00000100:00100000:3.0:1789263918.752637:0:22905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882a6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:348595dd-7686-4b9f-85ef-acc7d3e74d64+11:18869:x1876178888716672:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 1243us (1785us total) trans 12884901894 rc 301/301 00000100:00100000:3.0:1789263918.752648:0:22905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 34 00000100:00100000:1.0:1789263918.754979:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263918.756304:0:22938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888716800 00000100:00100000:2.0:1789263918.756314:0:22938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888716800 00000100:00100000:1.0:1789263918.756416:0:22904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 35 00000100:00100000:1.0:1789263918.756444:0:22904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:348595dd-7686-4b9f-85ef-acc7d3e74d64+11:18869:x1876178888716800:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:1.0:1789263918.756467:0:22904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263918.756515:0:22904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1fcb3 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d12441 expref: -99 pid: 22904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.756615:0:22904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2c00/0xce1582440fb1fcba lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.756841:0:22904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2c00/0xce1582440fb1fcba lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.756891:0:22904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2c00/0xce1582440fb1fcba lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789263918.756932:0:22904:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789263918.756947:0:22904:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789263918.756978:0:22904:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2c00/0xce1582440fb1fcba lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.757549:0:22904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1fcb3 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12441 expref: 13 pid: 22904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.757582:0:22904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2c00/0xce1582440fb1fcba lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12441 expref: 12 pid: 22904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.757865:0:22904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9dd9b79de400) 00010000:00010000:1.0:1789263918.757869:0:22904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789263918.757914:0:22904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd8841a2c00, rc 0) 00000100:00100000:1.0:1789263918.758684:0:22904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:348595dd-7686-4b9f-85ef-acc7d3e74d64+12:18869:x1876178888716800:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 2242us (3694us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263918.758693:0:22904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 35 00000100:00100000:1.0:1789263918.764155:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263918.764307:0:22907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888716928 00000100:00100000:2.0:1789263918.764317:0:22907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888716928 00000100:00100000:2.0:1789263918.764378:0:22907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 3 00000100:00100000:2.0:1789263918.764388:0:22907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:348595dd-7686-4b9f-85ef-acc7d3e74d64+12:18869:x1876178888716928:12345-192.168.203.20@tcp:37:lfs.0 00000100:00100000:0.0:1789263918.769572:0:22907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:348595dd-7686-4b9f-85ef-acc7d3e74d64+12:18869:x1876178888716928:12345-192.168.203.20@tcp:37:lfs.0 Request processed in 5176us (5414us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263918.769590:0:22907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 3 00000100:00100000:1.0:1789263918.772193:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263918.772372:0:22906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888717184 00000100:00100000:3.0:1789263918.772388:0:22906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888717184 00000100:00100000:3.0:1789263918.772440:0:22906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 4 00000100:00100000:3.0:1789263918.772449:0:22906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9a7084050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:348595dd-7686-4b9f-85ef-acc7d3e74d64+12:18869:x1876178888717184:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:3.0:1789263918.772750:0:22906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9a7084050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:348595dd-7686-4b9f-85ef-acc7d3e74d64+13:18869:x1876178888717184:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 300us (565us total) trans 12884901895 rc 0/0 00000100:00100000:3.0:1789263918.772757:0:22906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 4 00000100:00100000:1.0:1789263918.819506:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263918.819739:0:22903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888717312 00000100:00100000:0.0:1789263918.819748:0:22903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888717312 00000100:00100000:0.0:1789263918.820811:0:22903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 36 00000100:00100000:0.0:1789263918.820843:0:22903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+10:18875:x1876178888717312:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:0.0:1789263918.820867:0:22903:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263918.820890:0:22903:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3bc00/0xce1582440fb1fcc1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d12448 expref: -99 pid: 22903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263918.820955:0:22903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a200/0xce1582440fb1fcc8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263918.820970:0:22903:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a200/0xce1582440fb1fcc8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263918.820983:0:22903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a200/0xce1582440fb1fcc8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263918.820996:0:22903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3ac00/0xce1582440fb1fccf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263918.821003:0:22903:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3ac00/0xce1582440fb1fccf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263918.821010:0:22903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3ac00/0xce1582440fb1fccf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263918.821115:0:22903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3b800/0xce1582440fb1fcd6 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263918.821267:0:22903:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3b800/0xce1582440fb1fcd6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263918.821278:0:22903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3b800/0xce1582440fb1fcd6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22903 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789263918.821319:0:22903:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789263918.821323:0:22903:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789263918.821358:0:22903:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3b800/0xce1582440fb1fcd6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263918.821370:0:22903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a200/0xce1582440fb1fcc8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263918.821377:0:22903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a200/0xce1582440fb1fcc8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263918.821384:0:22903:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a200/0xce1582440fb1fcc8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263918.821391:0:22903:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9abf3a200 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:0.0:1789263918.821395:0:22903:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a200/0xce1582440fb1fcc8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263918.821403:0:22903:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a200/0xce1582440fb1fcc8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263918.821415:0:22903:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd9b79dec00) 00010000:00010000:0.0:1789263918.821418:0:22903:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789263918.821422:0:22903:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a200/0xce1582440fb1fcc8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263918.821429:0:22903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a200/0xce1582440fb1fcc8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263918.821441:0:22903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3ac00/0xce1582440fb1fccf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263918.821458:0:22903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3ac00/0xce1582440fb1fccf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263918.821465:0:22903:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3ac00/0xce1582440fb1fccf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263918.821470:0:22903:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9abf3ac00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:0.0:1789263918.821473:0:22903:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3ac00/0xce1582440fb1fccf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263918.821480:0:22903:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3ac00/0xce1582440fb1fccf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263918.821488:0:22903:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9dd9b79dea00) 00010000:00010000:0.0:1789263918.821491:0:22903:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789263918.821494:0:22903:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3ac00/0xce1582440fb1fccf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263918.821500:0:22903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3ac00/0xce1582440fb1fccf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263918.821524:0:22903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3bc00/0xce1582440fb1fcc1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12448 expref: 12 pid: 22903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263918.821536:0:22903:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3b800/0xce1582440fb1fcd6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12448 expref: 11 pid: 22903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263918.821544:0:22903:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9dd9b79de400) 00010000:00010000:0.0:1789263918.821546:0:22903:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789263918.821554:0:22903:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9abf3b800, rc 0) 00000100:00100000:0.0:1789263918.821624:0:22903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+11:18875:x1876178888717312:12345-192.168.203.20@tcp:101:bash.0 Request processed in 785us (2129us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263918.821631:0:22903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 36 00000100:00100000:0.0:1789263918.823590:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263918.823749:0:22914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888717440 00000100:00100000:3.0:1789263918.823758:0:22914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888717440 00000100:00100000:3.0:1789263918.823809:0:22914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 7 00000100:00100000:3.0:1789263918.823818:0:22914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882a6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+5:18875:x1876178888717440:12345-192.168.203.20@tcp:900:bash.0 00000100:00100000:3.0:1789263918.823887:0:22914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882a6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+5:18875:x1876178888717440:12345-192.168.203.20@tcp:900:bash.0 Request processed in 69us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263918.823895:0:22914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 7 00000100:00100000:1.0:1789263918.826779:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263918.826929:0:22904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888717696 00000100:00100000:2.0:1789263918.826939:0:22904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888717696 00000100:00100000:2.0:1789263918.827040:0:22904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 37 00000100:00100000:2.0:1789263918.827050:0:22904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+11:18875:x1876178888717696:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:2.0:1789263918.827210:0:22904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263918.827231:0:22904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683a00/0xce1582440fb1fcdd lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d1244f expref: -99 pid: 22904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263918.827327:0:22904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683e00/0xce1582440fb1fce4 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263918.827367:0:22904:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2c00/0xce1582440fb1fcba lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12441 expref: 12 pid: 22904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263918.827378:0:22904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683e00/0xce1582440fb1fce4 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263918.827410:0:22904:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2c00/0xce1582440fb1fcba lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12441 expref: 12 pid: 22904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263918.827424:0:22904:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2c00/0xce1582440fb1fcba lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12441 expref: 12 pid: 22904 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263918.827438:0:22904:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd98ff7ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22904:1876178898186880:192.168.203.20@tcp:104: 00000100:00100000:2.0:1789263918.827568:0:22904:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd882684180 going to sleep for 11 seconds 00000100:00100000:1.0:1789263918.830784:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263918.830907:0:22904:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd98ff7ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22904:1876178898186880:192.168.203.20@tcp:104: 00010000:00010000:2.0:1789263918.830933:0:22904:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683e00/0xce1582440fb1fce4 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263918.831344:0:25241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888717824 00000100:00100000:0.0:1789263918.831351:0:25241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888717824 00010000:00010000:0.0:1789263918.831588:0:25241:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2c00/0xce1582440fb1fcba lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12441 expref: 13 pid: 22904 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263918.831665:0:25241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 16 00000100:00100000:0.0:1789263918.831685:0:25241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:348595dd-7686-4b9f-85ef-acc7d3e74d64+13:2397:x1876178888717824:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789263918.831700:0:25241:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789263918.831707:0:25241:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2c00/0xce1582440fb1fcba lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12441 expref: 13 pid: 22904 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263918.831719:0:25241:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2c00/0xce1582440fb1fcba lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12441 expref: 13 pid: 22904 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263918.831742:0:25241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2c00/0xce1582440fb1fcba lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12441 expref: 13 pid: 22904 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263918.831757:0:25241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9dd9b79de400) 00010000:00010000:0.0:1789263918.831763:0:25241:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683e00/0xce1582440fb1fce4 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263918.831773:0:25241:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683e00/0xce1582440fb1fce4 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263918.831803:0:25241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683e00/0xce1582440fb1fce4 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263918.831833:0:25241:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789263918.831889:0:25241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:348595dd-7686-4b9f-85ef-acc7d3e74d64+12:2397:x1876178888717824:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 215us (1112us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263918.831896:0:25241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 16 00010000:00010000:1.0:1789263918.832071:0:22904:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683e00/0xce1582440fb1fce4 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.832229:0:22904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683e00/0xce1582440fb1fce4 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.832292:0:22904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1fceb lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.832302:0:22904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1fceb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.832311:0:22904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1fceb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.832857:0:22904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1fcf2 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.832866:0:22904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1fcf2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.832873:0:22904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1fcf2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789263918.832883:0:22904:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789263918.832906:0:22904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683e00/0xce1582440fb1fce4 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.832913:0:22904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683e00/0xce1582440fb1fce4 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.832920:0:22904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683e00/0xce1582440fb1fce4 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.832938:0:22904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981683e00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263918.832942:0:22904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683e00/0xce1582440fb1fce4 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.832951:0:22904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683e00/0xce1582440fb1fce4 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.832960:0:22904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9dd9b79de400) 00010000:00010000:1.0:1789263918.832963:0:22904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263918.832967:0:22904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683e00/0xce1582440fb1fce4 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.832973:0:22904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683e00/0xce1582440fb1fce4 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789263918.832984:0:22904:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000161b5a3e reply state 0000000086a4b613 transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1fceb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.832994:0:22904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1fceb lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.833001:0:22904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9dd883dd9400) 00010000:00010000:1.0:1789263918.833004:0:22904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789263918.833007:0:22904:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789263918.833038:0:22904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683a00/0xce1582440fb1fcdd lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1244f expref: 14 pid: 22904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.833052:0:22904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1fcf2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1244f expref: 13 pid: 22904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.833369:0:22904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dd883dd9d00) 00010000:00010000:1.0:1789263918.833372:0:22904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1789263918.833375:0:22904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd8841a2a00, rc 0) 00000100:00100000:1.0:1789263918.833422:0:22904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+14:18875:x1876178888717696:12345-192.168.203.20@tcp:101:bash.0 Request processed in 6373us (6649us total) trans 12884901896 rc 0/0 00000100:00100000:1.0:1789263918.833429:0:22904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 37 00000100:00100000:1.0:1789263918.845308:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263918.845384:0:22905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888717952 00000100:00100000:2.0:1789263918.845394:0:22905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888717952 00000100:00100000:2.0:1789263918.845455:0:22905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 38 00000100:00100000:2.0:1789263918.845465:0:22905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+14:18875:x1876178888717952:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:2.0:1789263918.845487:0:22905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263918.845516:0:22905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683400/0xce1582440fb1fd00 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d12456 expref: -99 pid: 22905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263918.845593:0:22905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683a00/0xce1582440fb1fd07 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263918.845604:0:22905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683a00/0xce1582440fb1fd07 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263918.845612:0:22905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683a00/0xce1582440fb1fd07 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789263918.845649:0:22905:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789263918.845652:0:22905:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789263918.845666:0:22905:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683a00/0xce1582440fb1fd07 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263918.845757:0:22905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683a00/0xce1582440fb1fd07 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263918.845783:0:22905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683400/0xce1582440fb1fd00 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12456 expref: 16 pid: 22905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263918.845800:0:22905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683a00/0xce1582440fb1fd07 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12456 expref: 15 pid: 22905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263918.845809:0:22905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dd883dd9d00) 00010000:00010000:2.0:1789263918.845812:0:22905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789263918.845815:0:22905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981683a00, rc 0) 00000100:00100000:2.0:1789263918.845869:0:22905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+15:18875:x1876178888717952:12345-192.168.203.20@tcp:101:bash.0 Request processed in 405us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263918.845874:0:22905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 38 00000100:00100000:2.0:1789263918.847826:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263918.847930:0:22907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888718208 00000100:00100000:0.0:1789263918.847938:0:22907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888718208 00000100:00100000:0.0:1789263918.847984:0:22907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 5 00000100:00100000:0.0:1789263918.847993:0:22907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+15:18875:x1876178888718208:12345-192.168.203.20@tcp:35:bash.0 00000100:00100000:0.0:1789263918.848720:0:22907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+16:18875:x1876178888718208:12345-192.168.203.20@tcp:35:bash.0 Request processed in 721us (889us total) trans 12884901897 rc 0/0 00000100:00100000:0.0:1789263918.848729:0:22907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 5 00000100:00100000:3.0:1789263918.907938:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263918.908171:0:22898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888718336 00000100:00100000:1.0:1789263918.908184:0:22898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888718336 00000100:00100000:1.0:1789263918.908242:0:22898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 148 00000100:00100000:1.0:1789263918.908252:0:22898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71777701-7db4-46a4-b468-7d1ca0b29a68+11:18239:x1876178888718336:12345-192.168.203.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789263918.908269:0:22898:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263918.908285:0:22898:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd8841a2c00/0xce1582440fb1fd0e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b612752c1d1245d expref: -99 pid: 22898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.908312:0:22898:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd8841a2c00/0xce1582440fb1fd0e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1245d expref: 12 pid: 22898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.908322:0:22898:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd8841a2c00/0xce1582440fb1fd0e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1245d expref: 12 pid: 22898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.908331:0:22898:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd8841a2c00, rc 0) 00000100:00100000:1.0:1789263918.908399:0:22898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71777701-7db4-46a4-b468-7d1ca0b29a68+12:18239:x1876178888718336:12345-192.168.203.20@tcp:101:ll_cfg_requeue.0 Request processed in 148us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263918.908406:0:22898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 148 00000100:00100000:1.0:1789263918.911494:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263918.911610:0:22896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888718464 00000100:00100000:0.0:1789263918.911620:0:22896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888718464 00000100:00100000:0.0:1789263918.911701:0:22896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 149 00000100:00100000:0.0:1789263918.911712:0:22896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71777701-7db4-46a4-b468-7d1ca0b29a68+12:18239:x1876178888718464:12345-192.168.203.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789263918.911844:0:22896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71777701-7db4-46a4-b468-7d1ca0b29a68+12:18239:x1876178888718464:12345-192.168.203.20@tcp:501:ll_cfg_requeue.0 Request processed in 133us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263918.911853:0:22896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 149 00000100:00100000:0.0:1789263918.914222:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263918.915945:0:22899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888718592 00000100:00100000:2.0:1789263918.915959:0:22899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888718592 00000100:00100000:2.0:1789263918.916025:0:22899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 150 00000100:00100000:2.0:1789263918.916035:0:22899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71777701-7db4-46a4-b468-7d1ca0b29a68+12:18239:x1876178888718592:12345-192.168.203.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789263918.916226:0:22899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71777701-7db4-46a4-b468-7d1ca0b29a68+12:18239:x1876178888718592:12345-192.168.203.20@tcp:503:ll_cfg_requeue.0 Request processed in 192us (2020us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263918.916234:0:22899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 150 00000100:00100000:3.0:1789263918.925222:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263918.925382:0:22898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888718720 00000100:00100000:1.0:1789263918.925392:0:22898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888718720 00000100:00100000:1.0:1789263918.925449:0:22898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 151 00000100:00100000:1.0:1789263918.925459:0:22898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71777701-7db4-46a4-b468-7d1ca0b29a68+12:18239:x1876178888718720:12345-192.168.203.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789263918.925475:0:22898:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263918.925490:0:22898:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd883e72c00/0xce1582440fb1fd15 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b612752c1d12464 expref: -99 pid: 22898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.925517:0:22898:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd883e72c00/0xce1582440fb1fd15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12464 expref: 13 pid: 22898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.925528:0:22898:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd883e72c00/0xce1582440fb1fd15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12464 expref: 13 pid: 22898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.925537:0:22898:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd883e72c00, rc 0) 00000100:00100000:1.0:1789263918.925594:0:22898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71777701-7db4-46a4-b468-7d1ca0b29a68+13:18239:x1876178888718720:12345-192.168.203.20@tcp:101:ll_cfg_requeue.0 Request processed in 137us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263918.925601:0:22898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 151 00000100:00100000:1.0:1789263918.928206:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263918.929216:0:22899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888718848 00000100:00100000:2.0:1789263918.929226:0:22899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888718848 00000100:00100000:2.0:1789263918.929309:0:22899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 152 00000100:00100000:2.0:1789263918.929319:0:22899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71777701-7db4-46a4-b468-7d1ca0b29a68+13:18239:x1876178888718848:12345-192.168.203.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789263918.929400:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263918.929564:0:22899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71777701-7db4-46a4-b468-7d1ca0b29a68+13:18239:x1876178888718848:12345-192.168.203.20@tcp:501:ll_cfg_requeue.0 Request processed in 246us (1363us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263918.929572:0:22899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 152 00000100:00100000:0.0:1789263918.930346:0:22938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888719104 00000100:00100000:0.0:1789263918.930550:0:22938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888719104 00000100:00100000:0.0:1789263918.930638:0:22938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 39 00000100:00100000:0.0:1789263918.930647:0:22938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883b6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+16:18885:x1876178888719104:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:0.0:1789263918.930693:0:22938:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263918.930711:0:22938:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a200/0xce1582440fb1fd1c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d1246b expref: -99 pid: 22938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789263918.930788:0:22938:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789263918.930871:0:22938:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a200/0xce1582440fb1fd1c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1246b expref: 18 pid: 22938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263918.930885:0:22938:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd9b79dec00) 00010000:00010000:0.0:1789263918.930888:0:22938:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789263918.930893:0:22938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a200/0xce1582440fb1fd1c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1246b expref: 18 pid: 22938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263918.930904:0:22938:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9abf3a200, rc 0) 00000100:00100000:0.0:1789263918.930942:0:22938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883b6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+17:18885:x1876178888719104:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 296us (1542us total) trans 12884901898 rc 301/301 00000100:00100000:0.0:1789263918.930948:0:22938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 39 00000100:00100000:3.0:1789263918.932590:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263918.932666:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263918.932749:0:22906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888719488 00000100:00100000:1.0:1789263918.932757:0:22906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888719488 00000100:00100000:1.0:1789263918.932803:0:22906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 6 00000100:00100000:1.0:1789263918.932812:0:22906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883b6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+17:18885:x1876178888719488:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:1.0:1789263918.932959:0:22906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883b6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+18:18885:x1876178888719488:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 148us (293us total) trans 12884901899 rc 0/0 00000100:00100000:1.0:1789263918.932967:0:22906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 6 00000100:00100000:0.0:1789263918.934038:0:22896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888719232 00000100:00100000:0.0:1789263918.934043:0:22896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888719232 00000100:00100000:0.0:1789263918.934230:0:22896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 153 00000100:00100000:0.0:1789263918.934240:0:22896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71777701-7db4-46a4-b468-7d1ca0b29a68+13:18239:x1876178888719232:12345-192.168.203.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789263918.934420:0:22896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71777701-7db4-46a4-b468-7d1ca0b29a68+13:18239:x1876178888719232:12345-192.168.203.20@tcp:503:ll_cfg_requeue.0 Request processed in 181us (1832us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263918.934428:0:22896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 153 00000100:00100000:3.0:1789263918.971377:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263918.971534:0:22903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888719744 00000100:00100000:0.0:1789263918.971542:0:22903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888719744 00000100:00100000:0.0:1789263918.971602:0:22903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 40 00000100:00100000:0.0:1789263918.971610:0:22903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd884acc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+18:18890:x1876178888719744:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:0.0:1789263918.971628:0:22903:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263918.971645:0:22903:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a200/0xce1582440fb1fd2a lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d12472 expref: -99 pid: 22903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263918.971750:0:22903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3ae00/0xce1582440fb1fd31 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263918.971764:0:22903:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3ae00/0xce1582440fb1fd31 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263918.971774:0:22903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3ae00/0xce1582440fb1fd31 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22903 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789263918.971792:0:22903:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789263918.971889:0:22903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a200/0xce1582440fb1fd2a lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12472 expref: 21 pid: 22903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263918.971907:0:22903:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3ae00/0xce1582440fb1fd31 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12472 expref: 20 pid: 22903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263918.971915:0:22903:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dd883dd9d00) 00010000:00010000:0.0:1789263918.971918:0:22903:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789263918.971921:0:22903:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9abf3ae00, rc 0) 00000100:00100000:0.0:1789263918.972064:0:22903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd884acc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+20:18890:x1876178888719744:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 453us (696us total) trans 12884901900 rc 0/0 00000100:00100000:0.0:1789263918.972072:0:22903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 40 00000100:00100000:2.0:1789263918.977883:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263918.978825:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263918.979101:0:22904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888719872 00000100:00100000:1.0:1789263918.979122:0:22904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888719872 00000100:00100000:1.0:1789263918.979276:0:22904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 41 00000100:00100000:0.0:1789263918.979284:0:23658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888720000 00000100:00100000:1.0:1789263918.979287:0:22904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+20:18890:x1876178888719872:12345-192.168.203.20@tcp:54:lfs.0 00000100:00100000:0.0:1789263918.979295:0:23658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888720000 00010000:00010000:1.0:1789263918.979363:0:22904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72600/0xce1582440fb1fd3f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.979379:0:22904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72600/0xce1582440fb1fd3f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.979391:0:22904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72600/0xce1582440fb1fd3f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263918.979407:0:23658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 0 00000100:00100000:0.0:1789263918.979415:0:23658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882435500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+21:2397:x1876178888720000:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789263918.979425:0:22904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72600/0xce1582440fb1fd3f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263918.979425:0:23658:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789263918.979431:0:22904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72600/0xce1582440fb1fd3f lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.979437:0:22904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72600/0xce1582440fb1fd3f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263918.979762:0:23658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3ae00/0xce1582440fb1fd31 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12472 expref: 21 pid: 22903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263918.979778:0:23658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dd883dd9d00) 00010000:00010000:0.0:1789263918.979839:0:23658:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789263918.979940:0:23658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882435500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+20:2397:x1876178888720000:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 525us (1116us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263918.979948:0:23658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 0 00010000:00010000:1.0:1789263918.980010:0:22904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883e72600 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263918.980016:0:22904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72600/0xce1582440fb1fd3f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.980025:0:22904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72600/0xce1582440fb1fd3f lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.980035:0:22904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dd883dd9d00) 00010000:00010000:1.0:1789263918.980038:0:22904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789263918.980042:0:22904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72600/0xce1582440fb1fd3f lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263918.980068:0:22904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72600/0xce1582440fb1fd3f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263918.980123:0:22904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+19:18890:x1876178888719872:12345-192.168.203.20@tcp:54:lfs.0 Request processed in 838us (2249us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263918.980130:0:22904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 41 00000100:00100000:2.0:1789263918.982474:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263918.982684:0:22906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888720256 00000100:00100000:1.0:1789263918.982692:0:22906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888720256 00000100:00100000:1.0:1789263918.982775:0:22906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 7 00000100:00100000:1.0:1789263918.982785:0:22906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+19:18890:x1876178888720256:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:1.0:1789263918.982993:0:22906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+20:18890:x1876178888720256:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 209us (525us total) trans 12884901901 rc 0/0 00000100:00100000:1.0:1789263918.983001:0:22906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 7 00000040:00080000:2.0:1789263919.214897:0:23664:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789263919.243285:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263919.243374:0:22903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888720512 00000100:00100000:0.0:1789263919.243383:0:22903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888720512 00000100:00100000:0.0:1789263919.243440:0:22903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 42 00000100:00100000:0.0:1789263919.243451:0:22903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+20:18921:x1876178888720512:12345-192.168.203.20@tcp:101:cat.0 00010000:00010000:0.0:1789263919.243505:0:22903:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263919.243526:0:22903:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3ae00/0xce1582440fb1fd46 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d12479 expref: -99 pid: 22903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.243700:0:22903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a200/0xce1582440fb1fd4d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.243724:0:22903:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a200/0xce1582440fb1fd4d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.243737:0:22903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a200/0xce1582440fb1fd4d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22903 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789263919.243772:0:22903:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789263919.243898:0:22903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3ae00/0xce1582440fb1fd46 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12479 expref: 23 pid: 22903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.243921:0:22903:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a200/0xce1582440fb1fd4d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12479 expref: 22 pid: 22903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.243930:0:22903:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dd883dd9d00) 00010000:00010000:0.0:1789263919.243932:0:22903:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789263919.243936:0:22903:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9abf3a200, rc 0) 00000100:00100000:0.0:1789263919.244395:0:22903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+22:18921:x1876178888720512:12345-192.168.203.20@tcp:101:cat.0 Request processed in 944us (1116us total) trans 12884901902 rc 0/0 00000100:00100000:0.0:1789263919.244402:0:22903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 42 00000100:00100000:3.0:1789263919.247228:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263919.247305:0:22889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888720640 00000100:00100000:1.0:1789263919.247313:0:22889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888720640 00000100:00100000:1.0:1789263919.247402:0:22889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 1 00000100:00100000:1.0:1789263919.247412:0:22889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989affb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+22:2399:x1876178888720640:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789263919.247443:0:22889:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789263919.247463:0:22889:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a200/0xce1582440fb1fd4d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12479 expref: 22 pid: 22903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.247491:0:22889:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dd883dd9d00) 00010000:00010000:1.0:1789263919.247497:0:22889:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789263919.247565:0:22889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989affb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+21:2399:x1876178888720640:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 154us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263919.247612:0:22889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 1 00000100:00100000:3.0:1789263919.247953:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263919.248218:0:22907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888720896 00000100:00100000:2.0:1789263919.248223:0:22907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888720896 00000100:00100000:2.0:1789263919.248268:0:22907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 8 00000100:00100000:2.0:1789263919.248277:0:22907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989afc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+21:18921:x1876178888720896:12345-192.168.203.20@tcp:35:cat.0 00000100:00100000:2.0:1789263919.248529:0:22907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989afc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+22:18921:x1876178888720896:12345-192.168.203.20@tcp:35:cat.0 Request processed in 253us (576us total) trans 12884901903 rc 0/0 00000100:00100000:2.0:1789263919.248537:0:22907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 8 00000100:00100000:2.0:1789263919.342940:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263919.343061:0:22938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888721152 00000100:00100000:0.0:1789263919.343070:0:22938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888721152 00000100:00100000:0.0:1789263919.343189:0:22938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 43 00000100:00100000:0.0:1789263919.343199:0:22938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+22:18927:x1876178888721152:12345-192.168.203.20@tcp:101:dd.0 00010000:00010000:0.0:1789263919.343223:0:22938:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263919.343269:0:22938:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3ae00/0xce1582440fb1fd5b lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d12480 expref: -99 pid: 22938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.343474:0:22938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3b200/0xce1582440fb1fd62 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.343502:0:22938:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1fcf2 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1244f expref: 23 pid: 22904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.343555:0:22938:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683a00/0xce1582440fb1fd07 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12456 expref: 23 pid: 22905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.343565:0:22938:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3b200/0xce1582440fb1fd62 lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.343921:0:22938:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683a00/0xce1582440fb1fd07 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12456 expref: 23 pid: 22905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.343949:0:22938:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683a00/0xce1582440fb1fd07 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12456 expref: 23 pid: 22905 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263919.343965:0:22938:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882a6ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:22938:1876178898187008:192.168.203.20@tcp:104: 00010000:00010000:0.0:1789263919.344196:0:22938:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1fcf2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1244f expref: 23 pid: 22904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.344206:0:22938:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1fcf2 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1244f expref: 23 pid: 22904 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263919.344216:0:22938:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882a6f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:22938:1876178898187136:192.168.203.20@tcp:104: 00000100:00100000:0.0:1789263919.344271:0:22938:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9abd42600 going to sleep for 11 seconds 00000100:00100000:0.0:1789263919.346163:0:22938:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882a6ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:22938:1876178898187008:192.168.203.20@tcp:104: 00000100:00100000:0.0:1789263919.346179:0:22938:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882a6f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:22938:1876178898187136:192.168.203.20@tcp:104: 00010000:00010000:0.0:1789263919.346201:0:22938:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3b200/0xce1582440fb1fd62 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263919.346960:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263919.347169:0:25241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888721280 00000100:00100000:0.0:1789263919.347177:0:25241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888721280 00010000:00010000:0.0:1789263919.347209:0:25241:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683a00/0xce1582440fb1fd07 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12456 expref: 24 pid: 22905 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263919.347442:0:25241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 17 00000100:00100000:0.0:1789263919.347453:0:25241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+24:2398:x1876178888721280:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789263919.347466:0:25241:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789263919.347473:0:25241:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683a00/0xce1582440fb1fd07 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12456 expref: 24 pid: 22905 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.347486:0:25241:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683a00/0xce1582440fb1fd07 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12456 expref: 24 pid: 22905 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.347508:0:25241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683a00/0xce1582440fb1fd07 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12456 expref: 24 pid: 22905 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.347523:0:25241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dd883dd9d00) 00010000:00010000:0.0:1789263919.347529:0:25241:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3b200/0xce1582440fb1fd62 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.347536:0:25241:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3b200/0xce1582440fb1fd62 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.347543:0:25241:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789263919.347593:0:25241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+23:2398:x1876178888721280:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 142us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263919.347611:0:25241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 17 00000100:00100000:3.0:1789263919.349882:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263919.349984:0:23658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888721408 00000100:00100000:0.0:1789263919.349993:0:23658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888721408 00010000:00010000:0.0:1789263919.350024:0:23658:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1fcf2 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1244f expref: 23 pid: 22904 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263919.350065:0:23658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 18 00000100:00100000:0.0:1789263919.350096:0:23658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98fe87450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+23:2400:x1876178888721408:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789263919.350110:0:23658:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789263919.350117:0:23658:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1fcf2 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1244f expref: 23 pid: 22904 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.350130:0:23658:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1fcf2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1244f expref: 23 pid: 22904 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.350149:0:23658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2a00/0xce1582440fb1fcf2 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1244f expref: 23 pid: 22904 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.350164:0:23658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dd883dd9d00) 00010000:00010000:0.0:1789263919.350169:0:23658:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3b200/0xce1582440fb1fd62 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.350178:0:23658:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3b200/0xce1582440fb1fd62 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.350185:0:23658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3b200/0xce1582440fb1fd62 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.350229:0:23658:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789263919.350282:0:22938:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3b200/0xce1582440fb1fd62 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263919.350282:0:23658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98fe87450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+22:2400:x1876178888721408:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 205us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263919.350296:0:23658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 18 00010000:00010000:2.0:1789263919.350297:0:22938:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3b200/0xce1582440fb1fd62 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789263919.350319:0:22938:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789263919.350455:0:22938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3ae00/0xce1582440fb1fd5b lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12480 expref: 23 pid: 22938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263919.350470:0:22938:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3b200/0xce1582440fb1fd62 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12480 expref: 22 pid: 22938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263919.350478:0:22938:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dd883dd9d00) 00010000:00010000:2.0:1789263919.350481:0:22938:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789263919.350484:0:22938:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9abf3b200, rc 0) 00000100:00100000:2.0:1789263919.350508:0:22938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+22:18927:x1876178888721152:12345-192.168.203.20@tcp:101:dd.0 Request processed in 7312us (7577us total) trans 12884901904 rc 0/0 00000100:00100000:2.0:1789263919.350515:0:22938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 43 00000100:00100000:2.0:1789263919.353778:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263919.353884:0:22905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888721536 00000100:00100000:0.0:1789263919.353893:0:22905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888721536 00000100:00100000:0.0:1789263919.353974:0:22905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 44 00000100:00100000:0.0:1789263919.353985:0:22905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+22:18927:x1876178888721536:12345-192.168.203.20@tcp:101:dd.0 00010000:00010000:0.0:1789263919.354006:0:22905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263919.354022:0:22905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3b400/0xce1582440fb1fd70 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d12487 expref: -99 pid: 22905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.354055:0:22905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a400/0xce1582440fb1fd77 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.354068:0:22905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a400/0xce1582440fb1fd77 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.354109:0:22905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a400/0xce1582440fb1fd77 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.354233:0:22905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3b400/0xce1582440fb1fd70 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12487 expref: 24 pid: 22905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.354249:0:22905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a400/0xce1582440fb1fd77 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12487 expref: 23 pid: 22905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.354258:0:22905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dd883dd9d00) 00010000:00010000:0.0:1789263919.354266:0:22905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789263919.354271:0:22905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9abf3a400, rc 0) 00000100:00100000:0.0:1789263919.354321:0:22905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+23:18927:x1876178888721536:12345-192.168.203.20@tcp:101:dd.0 Request processed in 337us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263919.354327:0:22905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 44 00000100:00100000:1.0:1789263919.359476:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263919.359615:0:22904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888721792 00000100:00100000:2.0:1789263919.359624:0:22904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888721792 00000100:00100000:2.0:1789263919.359761:0:22904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 45 00000100:00100000:2.0:1789263919.359777:0:22904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+23:18927:x1876178888721792:12345-192.168.203.20@tcp:36:dd.0 00010000:00010000:2.0:1789263919.360000:0:22904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683a00/0xce1582440fb1fd7e lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263919.360034:0:22904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683a00/0xce1582440fb1fd7e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263919.360046:0:22904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683a00/0xce1582440fb1fd7e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789263919.360403:0:22904:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:2.0:1789263919.360428:0:22904:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006f27b8a6 reply state 00000000a932d910 transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683a00/0xce1582440fb1fd7e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263919.360441:0:22904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683a00/0xce1582440fb1fd7e lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263919.360448:0:22904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dd883dd9d00) 00010000:00010000:2.0:1789263919.360452:0:22904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789263919.360455:0:22904:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789263919.360586:0:22904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+26:18927:x1876178888721792:12345-192.168.203.20@tcp:36:dd.0 Request processed in 811us (1118us total) trans 12884901906 rc 0/0 00000100:00100000:2.0:1789263919.360594:0:22904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 45 00000020:00080000:2.0:1789263919.360599:0:22904:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789263919.365287:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263919.365422:0:22903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888721920 00000100:00100000:2.0:1789263919.365431:0:22903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888721920 00000100:00100000:2.0:1789263919.365539:0:22903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 46 00000100:00100000:2.0:1789263919.365550:0:22903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989afca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+26:18927:x1876178888721920:12345-192.168.203.20@tcp:101:dd.0 00010000:00010000:2.0:1789263919.365573:0:22903:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789263919.365591:0:22903:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981682000/0xce1582440fb1fd85 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d1248e expref: -99 pid: 22903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263919.365643:0:22903:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981682000/0xce1582440fb1fd85 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1248e expref: 27 pid: 22903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263919.365692:0:22903:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981682000/0xce1582440fb1fd85 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1248e expref: 27 pid: 22903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263919.365712:0:22903:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dd883dd9d00) 00010000:00010000:2.0:1789263919.365715:0:22903:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789263919.365718:0:22903:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd981682000, rc 0) 00000100:00100000:2.0:1789263919.365778:0:22903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989afca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+27:18927:x1876178888721920:12345-192.168.203.20@tcp:101:dd.0 Request processed in 229us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263919.365784:0:22903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 46 00000100:00100000:3.0:1789263919.386821:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263919.387217:0:22891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888722176 00000100:00100000:2.0:1789263919.387227:0:22891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888722176 00000100:00100000:2.0:1789263919.387304:0:22891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 2 00000100:00100000:2.0:1789263919.387315:0:22891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989afc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+27:18927:x1876178888722176:12345-192.168.203.20@tcp:103:dd.0 00010000:00010000:2.0:1789263919.387330:0:22891:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789263919.387353:0:22891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981682000/0xce1582440fb1fd85 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1248e expref: 27 pid: 22903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263919.387373:0:22891:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dd883dd9d00) 00010000:00010000:2.0:1789263919.387378:0:22891:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789263919.387509:0:22891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989afc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+26:18927:x1876178888722176:12345-192.168.203.20@tcp:103:dd.0 Request processed in 195us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263919.387517:0:22891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 2 00000100:00100000:1.0:1789263919.390380:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263919.390519:0:22938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888722304 00000100:00100000:0.0:1789263919.390528:0:22938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888722304 00000100:00100000:0.0:1789263919.390616:0:22938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 47 00000100:00100000:0.0:1789263919.390628:0:22938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+26:18927:x1876178888722304:12345-192.168.203.20@tcp:58:dd.0 00010000:00010000:0.0:1789263919.390733:0:22938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3b400/0xce1582440fb1fd8c lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.390753:0:22938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3b400/0xce1582440fb1fd8c lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.390766:0:22938:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3b400/0xce1582440fb1fd8c lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789263919.391650:0:22938:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789263919.391702:0:22938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:0.0:1789263919.391852:0:22938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:0.0:1789263919.391947:0:22938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+26:18927:x1876178888722304:12345-192.168.203.20@tcp:58:dd.0 Request processed in 1320us (1574us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263919.391957:0:22938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 47 00000100:00100000:3.0:1789263919.397008:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263919.397273:0:22905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888722432 00000100:00100000:0.0:1789263919.397284:0:22905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888722432 00000100:00100000:0.0:1789263919.397451:0:22905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 48 00000100:00100000:0.0:1789263919.397467:0:22905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989aff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+26:18927:x1876178888722432:12345-192.168.203.20@tcp:101:dd.0 00010000:00010000:0.0:1789263919.397489:0:22905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263919.397527:0:22905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3be00/0xce1582440fb1fd93 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d12495 expref: -99 pid: 22905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.397594:0:22905:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3b400/0xce1582440fb1fd8c lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.397608:0:22905:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3be00/0xce1582440fb1fd93 lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12495 expref: 27 pid: 22905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.397628:0:22905:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3b400/0xce1582440fb1fd8c lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.397642:0:22905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3be00/0xce1582440fb1fd93 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12495 expref: 27 pid: 22905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.397657:0:22905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dd883dd9d00) 00010000:00010000:0.0:1789263919.397660:0:22905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789263919.397665:0:22905:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3be00/0xce1582440fb1fd93 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12495 expref: 27 pid: 22905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.397680:0:22905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9abf3be00, rc 0) 00000100:00100000:0.0:1789263919.397739:0:22905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989aff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+27:18927:x1876178888722432:12345-192.168.203.20@tcp:101:dd.0 Request processed in 275us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263919.399748:0:22905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 48 00010000:00010000:1.0:1789263919.469524:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789263919.547421:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263919.547472:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263919.547724:0:22899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888722560 00000100:00100000:2.0:1789263919.547734:0:22899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888722560 00000100:00100000:1.0:1789263919.547893:0:22904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888722688 00000100:00100000:1.0:1789263919.547898:0:22904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888722688 00000100:00100000:1.0:1789263919.547944:0:22904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 23 00000100:00100000:1.0:1789263919.547954:0:22904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989afdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+5:2399:x1876178888722688:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1789263919.548026:0:22904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989afdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+5:2399:x1876178888722688:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 73us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263919.548034:0:22904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 23 00000100:00100000:2.0:1789263919.548445:0:22899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 154 00000100:00100000:2.0:1789263919.548454:0:22899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71777701-7db4-46a4-b468-7d1ca0b29a68+13:2399:x1876178888722560:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789263919.548525:0:22899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71777701-7db4-46a4-b468-7d1ca0b29a68+13:2399:x1876178888722560:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 72us (1113us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263919.548533:0:22899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 154 00000100:00100000:2.0:1789263919.551211:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263919.551292:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263919.551322:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263919.551363:0:22903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888723200 00000100:00100000:3.0:1789263919.551385:0:22903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888723200 00000100:00100000:3.0:1789263919.551442:0:22903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 24 00000100:00100000:3.0:1789263919.551451:0:22903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:348595dd-7686-4b9f-85ef-acc7d3e74d64+5:2400:x1876178888723200:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1789263919.551519:0:22903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:348595dd-7686-4b9f-85ef-acc7d3e74d64+5:2400:x1876178888723200:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 68us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263919.551527:0:22903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 24 00000100:00100000:2.0:1789263919.552654:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263919.552711:0:24412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888722944 00000100:00100000:0.0:1789263919.552717:0:24412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888722944 00000100:00100000:0.0:1789263919.552773:0:24412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888723456 00000100:00100000:0.0:1789263919.552777:0:24412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888723456 00000100:00080000:1.0:1789263919.552814:0:22900:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789263919.552843:0:24411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 6 00000100:00100000:1.0:1789263919.552853:0:24411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+5:2400:x1876178888722944:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1789263919.552901:0:24411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+5:2400:x1876178888722944:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 50us (1697us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263919.552908:0:24411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 6 00000100:00100000:0.0:1789263919.553149:0:24412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 7 00000100:00100000:0.0:1789263919.553156:0:24412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:348595dd-7686-4b9f-85ef-acc7d3e74d64+5:2400:x1876178888723456:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789263919.553200:0:24412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:348595dd-7686-4b9f-85ef-acc7d3e74d64+5:2400:x1876178888723456:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 44us (1877us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263919.553207:0:24412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 7 00000100:00080000:1.0:1789263919.553300:0:22900:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789263919.553743:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263919.553828:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263919.553864:0:22904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888723072 00000100:00100000:0.0:1789263919.553868:0:22904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888723072 00000100:00100000:0.0:1789263919.553901:0:22904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 25 00000100:00100000:0.0:1789263919.553908:0:22904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:348595dd-7686-4b9f-85ef-acc7d3e74d64+12:2400:x1876178888723072:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789263919.553949:0:22904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:348595dd-7686-4b9f-85ef-acc7d3e74d64+12:2400:x1876178888723072:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 41us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263919.553956:0:22904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 25 00000100:00100000:3.0:1789263919.555061:0:25398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888722816 00000100:00100000:3.0:1789263919.555068:0:25398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888722816 00000100:00080000:2.0:1789263919.555166:0:22900:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789263919.555248:0:24595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888723328 00000100:00100000:1.0:1789263919.555252:0:24595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888723328 00000100:00080000:2.0:1789263919.555311:0:22900:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789263919.555364:0:25399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 8 00000100:00100000:0.0:1789263919.555374:0:25399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+5:2400:x1876178888722816:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1789263919.555514:0:25398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 9 00000100:00100000:3.0:1789263919.555522:0:25398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:348595dd-7686-4b9f-85ef-acc7d3e74d64+5:2400:x1876178888723328:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789263919.555566:0:25399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+5:2400:x1876178888722816:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 193us (2914us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263919.555573:0:25399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 8 00000100:00100000:3.0:1789263919.555736:0:25398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:348595dd-7686-4b9f-85ef-acc7d3e74d64+5:2400:x1876178888723328:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 214us (1953us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263919.555743:0:25398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 9 00000040:00080000:1.0:1789263919.597248:0:22941:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1789263919.597256:0:22941:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789263919.597280:0:22941:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:1.0:1789263919.597288:0:22941:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1789263919.597403:0:22941:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa72a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22941:1876178898187264:192.168.203.20@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789263919.597486:0:22941:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd98878ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1789263919.600532:0:22941:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa72a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22941:1876178898187264:192.168.203.20@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789263919.600953:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263919.601217:0:22903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888723584 00000100:00100000:3.0:1789263919.601225:0:22903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888723584 00000100:00100000:3.0:1789263919.601316:0:22903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 49 00000100:00100000:3.0:1789263919.601328:0:22903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+27:18928:x1876178888723584:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789263919.601356:0:22903:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789263919.601460:0:22903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+27:18928:x1876178888723584:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 Request processed in 133us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263919.601468:0:22903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 49 00000100:00100000:2.0:1789263919.603572:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263919.603678:0:22904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888723712 00000100:00100000:0.0:1789263919.603686:0:22904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888723712 00000100:00100000:0.0:1789263919.603774:0:22904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 50 00000100:00100000:0.0:1789263919.603792:0:22904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+27:18928:x1876178888723712:12345-192.168.203.20@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789263919.603854:0:22904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a600/0xce1582440fb1fd9a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.603870:0:22904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a600/0xce1582440fb1fd9a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.603881:0:22904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a600/0xce1582440fb1fd9a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.603942:0:22904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3ae00/0xce1582440fb1fda1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.603952:0:22904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3ae00/0xce1582440fb1fda1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.603960:0:22904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3ae00/0xce1582440fb1fda1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.603982:0:22904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a200/0xce1582440fb1fda8 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.603990:0:22904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a200/0xce1582440fb1fda8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.603998:0:22904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a200/0xce1582440fb1fda8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789263919.604039:0:22904:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789263919.604043:0:22904:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789263919.604057:0:22904:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a200/0xce1582440fb1fda8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.604068:0:22904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a600/0xce1582440fb1fd9a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.604074:0:22904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a600/0xce1582440fb1fd9a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.604102:0:22904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a600/0xce1582440fb1fd9a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.604117:0:22904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9abf3a600 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:0.0:1789263919.604122:0:22904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a600/0xce1582440fb1fd9a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.604130:0:22904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a600/0xce1582440fb1fd9a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.604142:0:22904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9dd9bb596d00) 00010000:00010000:0.0:1789263919.604145:0:22904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789263919.604149:0:22904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a600/0xce1582440fb1fd9a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.604156:0:22904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a600/0xce1582440fb1fd9a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.604168:0:22904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3ae00/0xce1582440fb1fda1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.604173:0:22904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3ae00/0xce1582440fb1fda1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.604179:0:22904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3ae00/0xce1582440fb1fda1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.604184:0:22904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9abf3ae00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:0.0:1789263919.604187:0:22904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3ae00/0xce1582440fb1fda1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.604193:0:22904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3ae00/0xce1582440fb1fda1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.604210:0:22904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff9dd983d91300) 00010000:00010000:0.0:1789263919.604213:0:22904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789263919.604216:0:22904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3ae00/0xce1582440fb1fda1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.604222:0:22904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3ae00/0xce1582440fb1fda1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.604234:0:22904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a200/0xce1582440fb1fda8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.604240:0:22904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a200/0xce1582440fb1fda8 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.604246:0:22904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a200/0xce1582440fb1fda8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.604251:0:22904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9abf3a200 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:0.0:1789263919.604254:0:22904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a200/0xce1582440fb1fda8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.604260:0:22904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a200/0xce1582440fb1fda8 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.604267:0:22904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dd883dd9d00) 00010000:00010000:0.0:1789263919.604269:0:22904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789263919.604272:0:22904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a200/0xce1582440fb1fda8 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.604277:0:22904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a200/0xce1582440fb1fda8 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263919.604409:0:22904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+27:18928:x1876178888723712:12345-192.168.203.20@tcp:34:lhsmtool_posix.0 Request processed in 626us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263919.604418:0:22904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 50 00000100:00100000:0.0:1789263919.606042:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263919.606432:0:22905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888723968 00000100:00100000:1.0:1789263919.606440:0:22905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888723968 00000100:00100000:1.0:1789263919.606484:0:22905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 51 00000100:00100000:1.0:1789263919.606494:0:22905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882a6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+27:18928:x1876178888723968:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789263919.606510:0:22905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263919.606526:0:22905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73c00/0xce1582440fb1fdaf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d1249c expref: -99 pid: 22905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.606606:0:22905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72a00/0xce1582440fb1fdb6 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.606619:0:22905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72a00/0xce1582440fb1fdb6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.606634:0:22905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72a00/0xce1582440fb1fdb6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789263919.606644:0:22905:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789263919.607049:0:22905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72a00/0xce1582440fb1fdb6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.607059:0:22905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72a00/0xce1582440fb1fdb6 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.607066:0:22905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72a00/0xce1582440fb1fdb6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.607073:0:22905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883e72a00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263919.607161:0:22905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72a00/0xce1582440fb1fdb6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.607182:0:22905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72a00/0xce1582440fb1fdb6 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.607194:0:22905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dd883dd9d00) 00010000:00010000:1.0:1789263919.607197:0:22905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789263919.607201:0:22905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72a00/0xce1582440fb1fdb6 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.607208:0:22905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72a00/0xce1582440fb1fdb6 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.607243:0:22905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73c00/0xce1582440fb1fdaf lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1249c expref: 29 pid: 22905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.607254:0:22905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9dd9bb596d00) 00010000:00010000:1.0:1789263919.607256:0:22905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789263919.607260:0:22905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73c00/0xce1582440fb1fdaf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d1249c expref: 29 pid: 22905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.607270:0:22905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd883e73c00, rc 0) 00000100:00100000:1.0:1789263919.607694:0:22905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882a6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+28:18928:x1876178888723968:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 1201us (1653us total) trans 12884901907 rc 301/301 00000100:00100000:1.0:1789263919.607700:0:22905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 51 00000100:00100000:1.0:1789263919.613843:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263919.614135:0:22938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888724096 00000100:00100000:2.0:1789263919.614143:0:22938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888724096 00000100:00100000:2.0:1789263919.614193:0:22938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 52 00000100:00100000:2.0:1789263919.614201:0:22938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+28:18928:x1876178888724096:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789263919.614228:0:22938:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789263919.614324:0:22938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+28:18928:x1876178888724096:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 Request processed in 123us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263919.614332:0:22938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 52 00000100:00100000:2.0:1789263919.616266:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263919.616944:0:22903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888724352 00000100:00100000:3.0:1789263919.616952:0:22903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888724352 00000100:00100000:3.0:1789263919.616997:0:22903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 53 00000100:00100000:3.0:1789263919.617006:0:22903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88431c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+28:18928:x1876178888724352:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789263919.617022:0:22903:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263919.617051:0:22903:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432600/0xce1582440fb1fdc4 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d124a3 expref: -99 pid: 22903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789263919.617481:0:22903:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x23:0x0], count =31 00000004:00080000:3.0:1789263919.617489:0:22903:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x23:0x0]+31 in llog 00000004:00080000:3.0:1789263919.617507:0:22903:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x42:0x0], index 0: 0 00010000:00010000:3.0:1789263919.620988:0:22903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432800/0xce1582440fb1fdcb lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263919.621010:0:22903:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432800/0xce1582440fb1fdcb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263919.621021:0:22903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432800/0xce1582440fb1fdcb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263919.621116:0:22903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432600/0xce1582440fb1fdc4 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d124a3 expref: 31 pid: 22903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263919.621136:0:22903:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432800/0xce1582440fb1fdcb lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d124a3 expref: 30 pid: 22903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263919.621146:0:22903:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9dd9bb596800) 00010000:00010000:3.0:1789263919.621148:0:22903:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789263919.621152:0:22903:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd990432800, rc 0) 00000100:00100000:3.0:1789263919.621222:0:22903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88431c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+30:18928:x1876178888724352:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 4215us (4960us total) trans 12884901908 rc 0/0 00000100:00100000:3.0:1789263919.621232:0:22903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 53 00000100:00100000:1.0:1789263919.623718:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263919.623800:0:22904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888724608 00000100:00100000:0.0:1789263919.623809:0:22904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888724608 00000100:00100000:0.0:1789263919.623864:0:22904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 54 00000100:00100000:0.0:1789263919.623875:0:22904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+30:18928:x1876178888724608:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789263919.623925:0:22904:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789263919.623948:0:22904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432800/0xce1582440fb1fdcb lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d124a3 expref: 30 pid: 22903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.623963:0:22904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9dd9bb596800) 00010000:00010000:0.0:1789263919.623974:0:22904:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789263919.624015:0:22904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a200/0xce1582440fb1fdd9 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.624026:0:22904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a200/0xce1582440fb1fdd9 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.624033:0:22904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a200/0xce1582440fb1fdd9 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.624043:0:22904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3ae00/0xce1582440fb1fde0 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xdd4788ac bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.624048:0:22904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3ae00/0xce1582440fb1fde0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xdd4788ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.624066:0:22904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3ae00/0xce1582440fb1fde0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xdd4788ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.624262:0:22904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a200/0xce1582440fb1fdd9 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.624268:0:22904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a200/0xce1582440fb1fdd9 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.624272:0:22904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a200/0xce1582440fb1fdd9 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.624276:0:22904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9abf3a200 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:0.0:1789263919.624282:0:22904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a200/0xce1582440fb1fdd9 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.624287:0:22904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a200/0xce1582440fb1fdd9 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.624294:0:22904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9dd9b79de400) 00010000:00010000:0.0:1789263919.624296:0:22904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789263919.624298:0:22904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a200/0xce1582440fb1fdd9 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.624306:0:22904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a200/0xce1582440fb1fdd9 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.624313:0:22904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3ae00/0xce1582440fb1fde0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xdd4788ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.624317:0:22904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3ae00/0xce1582440fb1fde0 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xdd4788ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.624338:0:22904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3ae00/0xce1582440fb1fde0 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xdd4788ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.624342:0:22904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9abf3ae00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:0.0:1789263919.624344:0:22904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3ae00/0xce1582440fb1fde0 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xdd4788ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.624348:0:22904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3ae00/0xce1582440fb1fde0 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xdd4788ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.624353:0:22904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xdd4788ac (ffff9dd983d91300) 00010000:00010000:0.0:1789263919.624355:0:22904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789263919.624357:0:22904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3ae00/0xce1582440fb1fde0 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xdd4788ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.624363:0:22904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3ae00/0xce1582440fb1fde0 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xdd4788ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263919.624447:0:22904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+29:18928:x1876178888724608:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 Request processed in 573us (735us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789263919.624460:0:22904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 54 00000100:00100000:1.0:1789263919.626460:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263919.626976:0:22905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888724736 00000100:00100000:0.0:1789263919.626984:0:22905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888724736 00000100:00100000:0.0:1789263919.627039:0:22905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 55 00000100:00100000:0.0:1789263919.627048:0:22905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+29:18928:x1876178888724736:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789263919.627066:0:22905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263919.627096:0:22905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a600/0xce1582440fb1fde7 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d124aa expref: -99 pid: 22905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.627153:0:22905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3ac00/0xce1582440fb1fdee lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.627166:0:22905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3ac00/0xce1582440fb1fdee lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.627176:0:22905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3ac00/0xce1582440fb1fdee lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.627276:0:22905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a600/0xce1582440fb1fde7 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d124aa expref: 31 pid: 22905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.627294:0:22905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3ac00/0xce1582440fb1fdee lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d124aa expref: 30 pid: 22905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.627303:0:22905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9dd983d91f00) 00010000:00010000:0.0:1789263919.627306:0:22905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789263919.627310:0:22905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9abf3ac00, rc 0) 00000100:00100000:0.0:1789263919.627360:0:22905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+30:18928:x1876178888724736:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 313us (903us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263919.627367:0:22905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 55 00000100:00100000:2.0:1789263919.629728:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263919.630369:0:22938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888724992 00000100:00100000:0.0:1789263919.630388:0:22938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888724992 00000100:00100000:1.0:1789263919.630495:0:22904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 56 00000100:00100000:1.0:1789263919.630505:0:22904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88431ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+30:18928:x1876178888724992:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789263919.630588:0:22904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72000/0xce1582440fb1fdf5 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.630603:0:22904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72000/0xce1582440fb1fdf5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.630614:0:22904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72000/0xce1582440fb1fdf5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789263919.630774:0:22904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].2, 88 off8344 00000004:00080000:1.0:1789263919.630795:0:22904:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 361920717260ns, next at 362920714936ns, rc = 0 00000004:00010000:1.0:1789263919.630843:0:22904:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fd65a78a reply state 000000001c5bffbd transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72000/0xce1582440fb1fdf5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.630856:0:22904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72000/0xce1582440fb1fdf5 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.630863:0:22904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9dd983d91f00) 00010000:00010000:1.0:1789263919.630866:0:22904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1789263919.630870:0:22904:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789263919.630957:0:22904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88431ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+32:18928:x1876178888724992:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 Request processed in 453us (1234us total) trans 12884901909 rc 0/0 00000100:00100000:1.0:1789263919.630965:0:22904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 56 00000100:00100000:1.0:1789263919.632684:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263919.632765:0:22903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888725120 00000100:00100000:3.0:1789263919.632772:0:22903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888725120 00000100:00100000:3.0:1789263919.632851:0:22903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 57 00000100:00100000:3.0:1789263919.632867:0:22903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+32:18928:x1876178888725120:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789263919.632882:0:22903:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789263919.632893:0:22903:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432600/0xce1582440fb1fdfc lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d124b1 expref: -99 pid: 22903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263919.632933:0:22903:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432600/0xce1582440fb1fdfc lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d124b1 expref: 33 pid: 22903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263919.632946:0:22903:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432600/0xce1582440fb1fdfc lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d124b1 expref: 33 pid: 22903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263919.632963:0:22903:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9dd983d91f00) 00010000:00010000:3.0:1789263919.632966:0:22903:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789263919.632969:0:22903:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd990432600, rc 0) 00000100:00100000:3.0:1789263919.633041:0:22903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+33:18928:x1876178888725120:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 175us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263919.633046:0:22903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 57 00000100:00100000:2.0:1789263919.634715:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263919.635165:0:24409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888725248 00000100:00100000:1.0:1789263919.635173:0:24409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888725248 00000100:00100000:1.0:1789263919.635712:0:24409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 20 00000100:00100000:1.0:1789263919.635724:0:24409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88431d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+5:2398:x1876178888725248:12345-192.168.203.20@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789263919.635983:0:24409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88431d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+6:2398:x1876178888725248:12345-192.168.203.20@tcp:2:lhsmtool_posix.0 Request processed in 261us (1270us total) trans 12884901891 rc 0/0 00000100:00100000:1.0:1789263919.636003:0:24409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 20 00000100:00100000:2.0:1789263919.638068:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263919.638316:0:22906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888725504 00000100:00100000:1.0:1789263919.638323:0:22906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888725504 00000100:00100000:1.0:1789263919.638393:0:22906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 9 00000100:00100000:1.0:1789263919.638400:0:22906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+33:18928:x1876178888725504:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789263919.638565:0:22906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+34:18928:x1876178888725504:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 Request processed in 164us (501us total) trans 12884901910 rc 0/0 00000100:00100000:1.0:1789263919.638573:0:22906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 9 00000100:00100000:2.0:1789263919.640231:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263919.640431:0:22938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888725760 00000100:00100000:0.0:1789263919.640438:0:22938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888725760 00000100:00100000:0.0:1789263919.640474:0:22938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 58 00000100:00100000:0.0:1789263919.640483:0:22938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+34:18928:x1876178888725760:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789263919.640576:0:22938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+34:18928:x1876178888725760:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 Request processed in 94us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263919.640583:0:22938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 58 00000100:00100000:3.0:1789263919.641921:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263919.642028:0:22903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888725888 00000100:00100000:2.0:1789263919.642035:0:22903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888725888 00000100:00100000:0.0:1789263919.642311:0:22905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 59 00000100:00100000:0.0:1789263919.642321:0:22905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989afd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+34:18928:x1876178888725888:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789263919.642335:0:22905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263919.642617:0:22905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3bc00/0xce1582440fb1fe03 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d124b8 expref: -99 pid: 22905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.642702:0:22905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3b600/0xce1582440fb1fe0a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.642717:0:22905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3b600/0xce1582440fb1fe0a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.642728:0:22905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3b600/0xce1582440fb1fe0a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789263919.642782:0:22905:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789263919.642808:0:22905:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3b600/0xce1582440fb1fe0a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.642841:0:22905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3bc00/0xce1582440fb1fe03 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d124b8 expref: 36 pid: 22905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.642858:0:22905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3b600/0xce1582440fb1fe0a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d124b8 expref: 35 pid: 22905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.642883:0:22905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9dd983d91f00) 00010000:00010000:0.0:1789263919.642886:0:22905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789263919.642890:0:22905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9abf3b600, rc 0) 00000100:00100000:0.0:1789263919.642952:0:22905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989afd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+35:18928:x1876178888725888:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 626us (1035us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263919.642959:0:22905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 59 00000100:00100000:2.0:1789263919.646545:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263919.647275:0:24411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888726016 00000100:00100000:0.0:1789263919.647284:0:24411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888726016 00000100:00100000:0.0:1789263919.647339:0:24411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 21 00000100:00100000:0.0:1789263919.647350:0:24411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+6:2398:x1876178888726016:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789263919.647367:0:24411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789263919.647384:0:24411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b97a756/0xce1582440fb1fe11 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d124bf expref: -99 pid: 24411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789263919.647409:0:24411:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa6002f, blocks: 0x0 00010000:00010000:0.0:1789263919.647426:0:24411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=361s v=(0 0) 00010000:00010000:0.0:1789263919.647430:0:24411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789263919.647439:0:24411:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b97a756/0xce1582440fb1fe11 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d124bf expref: 7 pid: 24411 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.647459:0:24411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003b97a756/0xce1582440fb1fe11 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d124bf expref: 7 pid: 24411 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.647470:0:24411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd9abf3a600, rc 0) 00000100:00100000:0.0:1789263919.648254:0:24411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+7:2398:x1876178888726016:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 904us (1726us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263919.648261:0:24411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 21 00000100:00100000:2.0:1789263919.650660:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263919.650729:0:22938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888726272 00000100:00100000:0.0:1789263919.650738:0:22938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888726272 00000100:00100000:0.0:1789263919.650793:0:22938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 60 00000100:00100000:0.0:1789263919.650803:0:22938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+35:18928:x1876178888726272:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789263919.651192:0:22938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+35:18928:x1876178888726272:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 Request processed in 390us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263919.651200:0:22938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 60 00000100:00100000:3.0:1789263919.656165:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263919.656347:0:22903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888726400 00000100:00100000:2.0:1789263919.656358:0:22903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888726400 00000100:00100000:2.0:1789263919.656469:0:22903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 61 00000100:00100000:2.0:1789263919.656480:0:22903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989aff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+35:18928:x1876178888726400:12345-192.168.203.20@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789263919.659649:0:22884:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901910 is committed 00010000:00010000:1.0:1789263919.659733:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683000/0xce1582440fb1fc04 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.659747:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683000/0xce1582440fb1fc04 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.659755:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683000/0xce1582440fb1fc04 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.659762:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981683000 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263919.659766:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683000/0xce1582440fb1fc04 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.659774:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683000/0xce1582440fb1fc04 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.659791:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9dd9b79dea00) 00010000:00010000:1.0:1789263919.659794:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263919.659799:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683000/0xce1582440fb1fc04 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.659819:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683000/0xce1582440fb1fc04 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.659839:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683800/0xce1582440fb1fc0b lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.659846:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683800/0xce1582440fb1fc0b lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.659852:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683800/0xce1582440fb1fc0b lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.659857:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981683800 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263919.659860:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683800/0xce1582440fb1fc0b lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.659865:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683800/0xce1582440fb1fc0b lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.659873:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9dd9b79de400) 00010000:00010000:1.0:1789263919.659876:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263919.659879:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683800/0xce1582440fb1fc0b lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.659884:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683800/0xce1582440fb1fc0b lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.659898:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1fceb lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.659904:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1fceb lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.659916:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1fceb lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.659921:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd8841a2e00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263919.659924:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1fceb lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.659930:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1fceb lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.659938:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9dd883dd9400) 00010000:00010000:1.0:1789263919.659940:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263919.659943:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1fceb lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.659949:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1fceb lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.659964:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683a00/0xce1582440fb1fd7e lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.659970:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683a00/0xce1582440fb1fd7e lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.659976:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683a00/0xce1582440fb1fd7e lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.659981:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981683a00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263919.659983:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683a00/0xce1582440fb1fd7e lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.659999:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683a00/0xce1582440fb1fd7e lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.660008:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dd883dd9d00) 00010000:00010000:1.0:1789263919.660010:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263919.660013:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683a00/0xce1582440fb1fd7e lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.660018:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683a00/0xce1582440fb1fd7e lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.660030:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72000/0xce1582440fb1fdf5 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.660036:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72000/0xce1582440fb1fdf5 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.660041:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72000/0xce1582440fb1fdf5 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.660046:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883e72000 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263919.660049:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72000/0xce1582440fb1fdf5 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.660055:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72000/0xce1582440fb1fdf5 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.660063:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9dd983d91f00) 00010000:00010000:1.0:1789263919.660065:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789263919.660068:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72000/0xce1582440fb1fdf5 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789263919.660140:0:22884:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:2.0:1789263919.660190:0:22884:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00000100:00100000:2.0:1789263919.660329:0:22903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989aff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+16:18928:x1876178888726400:12345-192.168.203.20@tcp:44:lhsmtool_posix.0 Request processed in 3847us (4167us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263919.660338:0:22903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 61 00010000:00010000:0.0:1789263919.660546:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683200/0xce1582440fb1fc90 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.660555:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683200/0xce1582440fb1fc90 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.660562:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683200/0xce1582440fb1fc90 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.660567:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981683200 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:0.0:1789263919.660570:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683200/0xce1582440fb1fc90 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.660576:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683200/0xce1582440fb1fc90 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.660585:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9dd9b79de400) 00010000:00010000:0.0:1789263919.660587:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1789263919.660591:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683200/0xce1582440fb1fc90 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.660603:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683200/0xce1582440fb1fc90 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263919.660839:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989afc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898187392:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789263919.661015:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789263919.661221:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72000/0xce1582440fb1fdf5 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263919.661651:0:24412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898187392 00000100:00100000:2.0:1789263919.661658:0:24412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898187392 00000100:00100000:2.0:1789263919.662258:0:24412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789263919.662268:0:24412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1876178898187392:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1789263919.662391:0:24412:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789263919.662394:0:24412:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1789263919.662397:0:24412:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789263919.662399:0:24412:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1789263919 -> 1789263919 00002000:00010000:2.0:1789263919.662401:0:24412:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1789263919.662440:0:24412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3621:x1876178898187392:12345-0@lo:2:osp-syn-0-0.0 Request processed in 173us (1424us total) trans 12884901892 rc 0/0 00000100:00100000:2.0:1789263919.662447:0:24412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000004:00080000:0.0:1789263919.662538:0:3621:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9dd989afc700/2, rc 0, transno 12884901892 00000100:00100000:0.0:1789263919.662544:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989afc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898187392:0@lo:2:osp-syn-0-0.0 00000100:00080000:1.0:1789263919.662989:0:22900:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789263919.663911:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263919.663993:0:24409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888726528 00000100:00100000:1.0:1789263919.663999:0:24409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888726528 00000100:00100000:1.0:1789263919.664069:0:24409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 23 00000100:00100000:1.0:1789263919.664112:0:24409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+7:2397:x1876178888726528:12345-192.168.203.20@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1789263919.664230:0:24409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+7:2397:x1876178888726528:12345-192.168.203.20@tcp:16:lhsmtool_posix.0 Request processed in 153us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263919.664238:0:24409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 23 00000100:00100000:2.0:1789263919.666639:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263919.666834:0:22938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888726784 00000100:00100000:0.0:1789263919.666843:0:22938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888726784 00000100:00100000:0.0:1789263919.666922:0:22938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 62 00000100:00100000:0.0:1789263919.666933:0:22938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88397ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+15:18928:x1876178888726784:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789263919.666976:0:22938:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789263919.667000:0:22938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3b600/0xce1582440fb1fe0a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d124b8 expref: 15 pid: 22905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.667017:0:22938:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9dd983d91f00) 00010000:00010000:0.0:1789263919.667021:0:22938:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789263919.667049:0:22938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3bc00/0xce1582440fb1fe18 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.667062:0:22938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3bc00/0xce1582440fb1fe18 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.667073:0:22938:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3bc00/0xce1582440fb1fe18 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789263919.667311:0:22938:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000df375063 reply state 00000000869b3ef1 transno 12884901911 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3bc00/0xce1582440fb1fe18 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.667330:0:22938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3bc00/0xce1582440fb1fe18 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.667337:0:22938:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9dd983d91f00) 00010000:00010000:0.0:1789263919.667340:0:22938:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789263919.667343:0:22938:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789263919.667432:0:22938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88397ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+16:18928:x1876178888726784:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 Request processed in 501us (799us total) trans 12884901911 rc 0/0 00000100:00100000:0.0:1789263919.667439:0:22938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 62 00000100:00100000:2.0:1789263919.669416:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263919.669485:0:24595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888726912 00000100:00100000:1.0:1789263919.669494:0:24595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888726912 00000100:00100000:1.0:1789263919.669569:0:24595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 24 00000100:00100000:1.0:1789263919.669579:0:24595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88397df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+7:2398:x1876178888726912:12345-192.168.203.20@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789263919.669775:0:24595:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789263919.669779:0:24595:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1789263919 00002000:00010000:1.0:1789263919.669781:0:24595:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 1789263919 00002000:00010000:1.0:1789263919.669783:0:24595:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1789263919 -> 1789263919 00002000:00010000:1.0:1789263919.669786:0:24595:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1789263919.669866:0:24595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88397df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+8:2398:x1876178888726912:12345-192.168.203.20@tcp:2:lhsmtool_posix.0 Request processed in 288us (452us total) trans 12884901893 rc 0/0 00000100:00100000:1.0:1789263919.669875:0:24595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 24 00000100:00100000:2.0:1789263919.671612:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263919.671708:0:24412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888727040 00000100:00100000:0.0:1789263919.671715:0:24412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888727040 00000100:00100000:0.0:1789263919.671758:0:24412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 25 00000100:00100000:0.0:1789263919.671766:0:24412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88397f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+8:2400:x1876178888727040:12345-192.168.203.20@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789263919.671809:0:24412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000000ce2f28/0xce1582440fb1fe1f lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.671823:0:24412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789263919.671828:0:24412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789263919.671834:0:24412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000ce2f28/0xce1582440fb1fe1f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.671848:0:24412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000000ce2f28/0xce1582440fb1fe1f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.671866:0:24412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000000ce2f28/0xce1582440fb1fe1f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.671891:0:24412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000000ce2f28/0xce1582440fb1fe1f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.671900:0:24412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000000ce2f28/0xce1582440fb1fe1f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.671908:0:24412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9abf3ae00 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:0.0:1789263919.671913:0:24412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000000ce2f28/0xce1582440fb1fe1f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.671922:0:24412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000000ce2f28/0xce1582440fb1fe1f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.671938:0:24412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000000ce2f28/0xce1582440fb1fe1f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.671947:0:24412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000000ce2f28/0xce1582440fb1fe1f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263919.672043:0:24412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88397f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+8:2400:x1876178888727040:12345-192.168.203.20@tcp:1:lhsmtool_posix.0 Request processed in 277us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263919.672051:0:24412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 25 00000100:00100000:2.0:1789263919.673977:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263919.674072:0:22905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888727296 00000100:00100000:0.0:1789263919.674142:0:22905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888727296 00000100:00100000:0.0:1789263919.674220:0:22905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 63 00000100:00100000:0.0:1789263919.674238:0:22905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88397c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+16:18928:x1876178888727296:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789263919.674318:0:22905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a200/0xce1582440fb1fe26 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.674334:0:22905:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a400/0xce1582440fb1fd77 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12487 expref: 16 pid: 22905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.674343:0:22905:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a200/0xce1582440fb1fe26 lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.674386:0:22905:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a400/0xce1582440fb1fd77 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12487 expref: 16 pid: 22905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.674401:0:22905:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a400/0xce1582440fb1fd77 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12487 expref: 16 pid: 22905 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263919.674415:0:22905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882a6f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22905:1876178898187520:192.168.203.20@tcp:104: 00000100:00100000:0.0:1789263919.674483:0:22905:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9abd42d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789263919.677380:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789263919.677485:0:22890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888727424 00000100:00100000:3.0:1789263919.677492:0:22890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888727424 00010000:00010000:3.0:1789263919.677523:0:22890:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a400/0xce1582440fb1fd77 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12487 expref: 17 pid: 22905 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263919.677560:0:22890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 19 00000100:00100000:3.0:1789263919.677570:0:22890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa73480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+17:2398:x1876178888727424:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789263919.677581:0:22890:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789263919.677599:0:22890:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a400/0xce1582440fb1fd77 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12487 expref: 17 pid: 22905 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263919.677612:0:22890:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a400/0xce1582440fb1fd77 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12487 expref: 17 pid: 22905 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263919.677632:0:22890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dd883dd9d00) 00010000:00010000:3.0:1789263919.677639:0:22890:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3be00/0xce1582440fb1fd93 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12495 expref: 17 pid: 22905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263919.677648:0:22890:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a200/0xce1582440fb1fe26 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263919.677656:0:22890:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a200/0xce1582440fb1fe26 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263919.677663:0:22890:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a200/0xce1582440fb1fe26 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263919.677692:0:22890:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789263919.677740:0:22890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa73480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+17:2398:x1876178888727424:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 171us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263919.677748:0:22890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 19 00010000:00010000:0.0:1789263919.678657:0:22905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a400/0xce1582440fb1fd77 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12487 expref: 16 pid: 22905 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263919.678872:0:22905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882a6f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22905:1876178898187520:192.168.203.20@tcp:104: 00010000:00010000:0.0:1789263919.678893:0:22905:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a200/0xce1582440fb1fe26 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.678933:0:22905:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a200/0xce1582440fb1fe26 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.678966:0:22905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a200/0xce1582440fb1fe26 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.679519:0:22905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1fe2d lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.679565:0:22905:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432600/0xce1582440fb1fdfc lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d124b1 expref: 16 pid: 22903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.679574:0:22905:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1fe2d lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.679619:0:22905:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432600/0xce1582440fb1fdfc lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d124b1 expref: 16 pid: 22903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.679647:0:22905:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432600/0xce1582440fb1fdfc lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d124b1 expref: 16 pid: 22903 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789263919.679661:0:22905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882a6f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22905:1876178898187648:192.168.203.20@tcp:104: 00000100:00100000:0.0:1789263919.679805:0:22905:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd9abd42000 going to sleep for 11 seconds 00000100:00100000:2.0:1789263919.683456:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263919.683530:0:22905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882a6f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22905:1876178898187648:192.168.203.20@tcp:104: 00010000:00010000:0.0:1789263919.683554:0:22905:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1fe2d lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263919.683610:0:23658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888727552 00000100:00100000:3.0:1789263919.683617:0:23658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888727552 00010000:00010000:3.0:1789263919.683648:0:23658:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432600/0xce1582440fb1fdfc lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d124b1 expref: 17 pid: 22903 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789263919.683691:0:23658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 20 00000100:00100000:3.0:1789263919.683700:0:23658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd88397d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+17:2397:x1876178888727552:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789263919.683722:0:23658:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789263919.683729:0:23658:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432600/0xce1582440fb1fdfc lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d124b1 expref: 17 pid: 22903 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263919.683741:0:23658:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432600/0xce1582440fb1fdfc lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d124b1 expref: 17 pid: 22903 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263919.683761:0:23658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd990432600/0xce1582440fb1fdfc lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d124b1 expref: 17 pid: 22903 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263919.683774:0:23658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9dd983d91f00) 00010000:00010000:3.0:1789263919.683789:0:23658:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1fe2d lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263919.683799:0:23658:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1fe2d lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263919.683806:0:23658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1fe2d lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789263919.683827:0:23658:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789263919.683890:0:22905:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1fe2d lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.683897:0:22905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1fe2d lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789263919.683992:0:22905:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901912 00000001:00080000:0.0:1789263919.684138:0:22905:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000001:00080000:0.0:1789263919.684260:0:22905:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901914 00000100:00100000:0.0:1789263919.684341:0:22905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882a6f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22905:1876178898187776:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789263919.684402:0:22905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263919.684428:0:22905:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd98878ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1789263919.684919:0:23658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88397d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+19:2397:x1876178888727552:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 1218us (1468us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263919.684927:0:23658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 20 00000100:00100000:3.0:1789263919.684961:0:22927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898187776 00000100:00100000:3.0:1789263919.684965:0:22927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898187776 00000100:00100000:3.0:1789263919.684991:0:22927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789263919.684998:0:22927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882a6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22905:x1876178898187776:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789263919.685067:0:22927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882a6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22905:x1876178898187776:12345-0@lo:1000:mdt00_002.0 Request processed in 69us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263919.685120:0:22927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789263919.685859:0:22905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882a6f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22905:1876178898187776:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1789263919.686020:0:22905:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901915 00000100:00100000:1.0:1789263919.686068:0:22905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa72d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22905:1876178898187904:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789263919.686219:0:22905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263919.686246:0:22905:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd986221240 going to sleep for 11 seconds 00000100:00100000:3.0:1789263919.686296:0:22909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898187904 00000100:00100000:3.0:1789263919.686301:0:22909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898187904 00000100:00100000:3.0:1789263919.686336:0:22909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789263919.686345:0:22909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22905:x1876178898187904:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789263919.686455:0:22909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:22905:x1876178898187904:12345-0@lo:1000:mdt00_002.0 Request processed in 111us (235us total) trans 12884901894 rc 0/0 00000100:00100000:3.0:1789263919.686462:0:22909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789263919.686828:0:22905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa72d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22905:1876178898187904:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1789263919.686859:0:22905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1fe2d lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.686869:0:22905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1fe2d lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.686877:0:22905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1fe2d lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.686883:0:22905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd8841a2e00 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263919.686888:0:22905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1fe2d lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.686896:0:22905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1fe2d lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.686911:0:22905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9dd983d91f00) 00010000:00010000:1.0:1789263919.686914:0:22905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789263919.686918:0:22905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1fe2d lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.686924:0:22905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd8841a2e00/0xce1582440fb1fe2d lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.686951:0:22905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3b400/0xce1582440fb1fd8c lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.686967:0:22905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3b400/0xce1582440fb1fd8c lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.686973:0:22905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3b400/0xce1582440fb1fd8c lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.686978:0:22905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9abf3b400 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263919.686982:0:22905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3b400/0xce1582440fb1fd8c lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.686988:0:22905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3b400/0xce1582440fb1fd8c lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.686997:0:22905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dd883dd9d00) 00010000:00010000:1.0:1789263919.687000:0:22905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789263919.687005:0:22905:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3be00/0xce1582440fb1fd93 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12495 expref: 19 pid: 22905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.687015:0:22905:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3be00/0xce1582440fb1fd93 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12495 expref: 19 pid: 22905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.687024:0:22905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3be00/0xce1582440fb1fd93 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12495 expref: 19 pid: 22905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.687073:0:22905:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3be00/0xce1582440fb1fd93 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d12495 expref: 19 pid: 22905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263919.687234:0:22905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa73100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22905:1876178898188032:192.168.203.20@tcp:105: 00000100:00100000:1.0:1789263919.687294:0:22905:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd986221540 going to sleep for 11 seconds 00000100:00100000:0.0:1789263919.690471:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263919.690540:0:22907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888727680 00000100:00100000:2.0:1789263919.690548:0:22907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888727680 00000100:00100000:2.0:1789263919.690603:0:22907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 10 00000100:00100000:2.0:1789263919.690612:0:22907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9a7087450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+20:18927:x1876178888727680:12345-192.168.203.20@tcp:49:dd.0 00000100:00100000:2.0:1789263919.690746:0:22907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9a7087450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+20:18927:x1876178888727680:12345-192.168.203.20@tcp:49:dd.0 Request processed in 135us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263919.690754:0:22907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 10 00000100:00100000:1.0:1789263919.692940:0:22905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa73100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22905:1876178898188032:192.168.203.20@tcp:105: 00010000:00010000:1.0:1789263919.692974:0:22905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3b400/0xce1582440fb1fd8c lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.692985:0:22905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3b400/0xce1582440fb1fd8c lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 22938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.693018:0:22905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73200/0xce1582440fb1fe34 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.693031:0:22905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73200/0xce1582440fb1fe34 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.693042:0:22905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73200/0xce1582440fb1fe34 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.693053:0:22905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73200/0xce1582440fb1fe34 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.693060:0:22905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73200/0xce1582440fb1fe34 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.693066:0:22905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73200/0xce1582440fb1fe34 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.693073:0:22905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883e73200 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263919.693111:0:22905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73200/0xce1582440fb1fe34 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.693120:0:22905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73200/0xce1582440fb1fe34 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.693153:0:22905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dd883dd9d00) 00010000:00010000:1.0:1789263919.693156:0:22905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789263919.693160:0:22905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73200/0xce1582440fb1fe34 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.693166:0:22905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73200/0xce1582440fb1fe34 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.693182:0:22905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a200/0xce1582440fb1fe26 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.693189:0:22905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a200/0xce1582440fb1fe26 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.693195:0:22905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a200/0xce1582440fb1fe26 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.693206:0:22905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd9abf3a200 already unused, calling callback (ffffffffc18c14f0) 00010000:00010000:1.0:1789263919.693209:0:22905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a200/0xce1582440fb1fe26 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.693215:0:22905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a200/0xce1582440fb1fe26 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.693228:0:22905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dd883dd9d00) 00010000:00010000:1.0:1789263919.693231:0:22905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789263919.693234:0:22905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a200/0xce1582440fb1fe26 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.693240:0:22905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd9abf3a200/0xce1582440fb1fe26 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22905 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263919.693544:0:22905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd88397c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+19:18928:x1876178888727296:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 Request processed in 19305us (19569us total) trans 12884901916 rc 0/0 00000100:00100000:1.0:1789263919.693553:0:22905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 63 00000020:00080000:1.0:1789263919.693558:0:22905:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789263919.694204:0:22941:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1789263919.694209:0:22941:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789263919.694232:0:22941:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:3.0:1789263919.694238:0:22941:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1789263919.696251:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263919.696320:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789263919.696596:0:22907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888728064 00000100:00100000:2.0:1789263919.696605:0:22907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888728064 00000100:00100000:2.0:1789263919.696657:0:22907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 11 00000100:00100000:2.0:1789263919.696678:0:22907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882a6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+19:18928:x1876178888728064:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789263919.697036:0:22907:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789263919.697065:0:22907:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901917 00010000:00010000:2.0:1789263919.697260:0:22907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683e00/0xce1582440fb1fe3b lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22907 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263919.697276:0:22907:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683e00/0xce1582440fb1fe3b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22907 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263919.697287:0:22907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683e00/0xce1582440fb1fe3b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22907 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263919.697295:0:22907:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683e00/0xce1582440fb1fe3b lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22907 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263919.697317:0:22907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683e00/0xce1582440fb1fe3b lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22907 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263919.697324:0:22907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683e00/0xce1582440fb1fe3b lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22907 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263919.697348:0:22907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789263919.697531:0:24436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789263919.697537:0:24436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683e00/0xce1582440fb1fe3b lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22907 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.697544:0:24436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981683e00 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:0.0:1789263919.697549:0:24436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683e00/0xce1582440fb1fe3b lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22907 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.697556:0:24436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683e00/0xce1582440fb1fe3b lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22907 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.697569:0:24436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9dd983d91f00) 00010000:00010000:0.0:1789263919.697572:0:24436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789263919.697576:0:24436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683e00/0xce1582440fb1fe3b lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22907 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.697582:0:24436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd981683e00/0xce1582440fb1fe3b lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22907 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789263919.697594:0:24436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263919.697602:0:24436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263919.697604:0:24436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789263919.697633:0:22907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882a6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+21:18928:x1876178888728064:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 Request processed in 967us (1312us total) trans 12884901918 rc 0/0 00000100:00100000:2.0:1789263919.697642:0:22907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 11 00000020:00080000:2.0:1789263919.697646:0:22907:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789263919.697730:0:22904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888727808 00000100:00100000:1.0:1789263919.697734:0:22904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888727808 00000100:00100000:1.0:1789263919.697806:0:22904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 64 00000100:00100000:1.0:1789263919.697814:0:22904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882a6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+21:18927:x1876178888727808:12345-192.168.203.20@tcp:101:dd.0 00010000:00010000:1.0:1789263919.697824:0:22904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789263919.697835:0:22904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72e00/0xce1582440fb1fe42 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b612752c1d124c6 expref: -99 pid: 22904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.697862:0:22904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73000/0xce1582440fb1fe49 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.697871:0:22904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73000/0xce1582440fb1fe49 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.697880:0:22904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73000/0xce1582440fb1fe49 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.697956:0:22904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e72e00/0xce1582440fb1fe42 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d124c6 expref: 23 pid: 22904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.697969:0:22904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd883e73000/0xce1582440fb1fe49 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d124c6 expref: 22 pid: 22904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.697977:0:22904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dd883dd9d00) 00010000:00010000:1.0:1789263919.697985:0:22904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789263919.697988:0:22904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd883e73000, rc 0) 00000100:00100000:1.0:1789263919.698261:0:22904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882a6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+22:18927:x1876178888727808:12345-192.168.203.20@tcp:101:dd.0 Request processed in 446us (2015us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263919.698267:0:22904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 64 00000100:00100000:0.0:1789263919.828952:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789263919.829010:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263919.829436:0:24416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888728192 00000100:00100000:1.0:1789263919.829450:0:24416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888728192 00000100:00100000:1.0:1789263919.829511:0:24416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888728320 00000100:00100000:1.0:1789263919.829513:0:24416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888728320 00000100:00100000:1.0:1789263919.829531:0:24416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 0 00000100:00100000:1.0:1789263919.829545:0:24416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882a6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+9:2400:x1876178888728192:12345-192.168.203.20@tcp:4:dd.0 00010000:00010000:1.0:1789263919.829581:0:24416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d74daa3f/0xce1582440fb1fe50 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.829604:0:24416:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003b97a756/0xce1582440fb1fe11 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x5b612752c1d124bf expref: 9 pid: 24411 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.829614:0:24416:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789263919.829618:0:24416:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789263919.829623:0:24416:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d74daa3f/0xce1582440fb1fe50 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.829658:0:24416:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003b97a756/0xce1582440fb1fe11 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d124bf expref: 9 pid: 24411 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.829686:0:24416:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003b97a756/0xce1582440fb1fe11 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d124bf expref: 9 pid: 24411 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789263919.829734:0:24416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa73100 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0000_UUID:24416:1876178898188160:192.168.203.20@tcp:104: 00000100:00100000:1.0:1789263919.829981:0:24416:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dd986221540 going to sleep for 11 seconds 00000100:00100000:3.0:1789263919.833836:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789263919.833909:0:24416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa73100 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0000_UUID:24416:1876178898188160:192.168.203.20@tcp:104: 00010000:00010000:1.0:1789263919.833938:0:24416:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d74daa3f/0xce1582440fb1fe50 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263919.834058:0:22891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178888728448 00000100:00100000:2.0:1789263919.834065:0:22891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178888728448 00010000:00010000:2.0:1789263919.834152:0:22891:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003b97a756/0xce1582440fb1fe11 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d124bf expref: 10 pid: 24411 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263919.834191:0:22891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 21 00000100:00100000:2.0:1789263919.834200:0:22891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989afce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+10:2398:x1876178888728448:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789263919.834222:0:22891:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789263919.834260:0:22891:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003b97a756/0xce1582440fb1fe11 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d124bf expref: 10 pid: 24411 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263919.834273:0:22891:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003b97a756/0xce1582440fb1fe11 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d124bf expref: 10 pid: 24411 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263919.834297:0:22891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b97a756/0xce1582440fb1fe11 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0x5b612752c1d124bf expref: 10 pid: 24411 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263919.834326:0:22891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789263919.834331:0:22891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789263919.834344:0:22891:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d74daa3f/0xce1582440fb1fe50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263919.834377:0:22891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d74daa3f/0xce1582440fb1fe50 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263919.834408:0:22891:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789263919.834467:0:22891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989afce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+9:2398:x1876178888728448:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 261us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263919.834476:0:22891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 21 00010000:00010000:1.0:1789263919.834544:0:24416:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d74daa3f/0xce1582440fb1fe50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789263919.834552:0:24416:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d74daa3f/0xce1582440fb1fe50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789263919.903903:0:24406:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901895 is committed 00000001:00080000:0.0:1789263919.903928:0:24406:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901894 is committed 00002000:00010000:2.0:1789263919.904420:0:24416:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:2.0:1789263919.904425:0:24416:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 1789263919 -> 1789263920 00002000:00010000:2.0:1789263919.904428:0:24416:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1789263919 -> 1789263920 00002000:00010000:2.0:1789263919.904430:0:24416:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:2.0:1789263919.904455:0:24416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d74daa3f/0xce1582440fb1fe50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263919.904469:0:24416:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d74daa3f/0xce1582440fb1fe50 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263919.904486:0:24416:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d74daa3f/0xce1582440fb1fe50 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263919.904495:0:24416:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd883e72e00 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:2.0:1789263919.904925:0:24416:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d74daa3f/0xce1582440fb1fe50 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263919.904942:0:24416:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d74daa3f/0xce1582440fb1fe50 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263919.904968:0:24416:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d74daa3f/0xce1582440fb1fe50 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263919.904976:0:24416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d74daa3f/0xce1582440fb1fe50 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263919.905525:0:24416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882a6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+6:2400:x1876178888728192:12345-192.168.203.20@tcp:4:dd.0 Request processed in 75963us (76570us total) trans 12884901895 rc 0/0 00000100:00100000:2.0:1789263919.905541:0:24416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 0 00000100:00100000:2.0:1789263919.905584:0:24416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 1 00000100:00100000:2.0:1789263919.905595:0:24416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882a6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+5:2400:x1876178888728320:12345-192.168.203.20@tcp:4:dd.0 00002000:00010000:2.0:1789263919.905647:0:24416:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 4194304, mtime: 0x6aa60030, atime: 0x6aa6002f, ctime: 0x6aa60030, blocks: 0x2000 00010000:00010000:2.0:1789263919.905654:0:24416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078915044/0xce1582440fb1fe57 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263919.905678:0:24416:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=362s v=(0 0) 00010000:00010000:2.0:1789263919.905682:0:24416:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789263919.905688:0:24416:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078915044/0xce1582440fb1fe57 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263919.905700:0:24416:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078915044/0xce1582440fb1fe57 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789263919.979919:0:24406:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901896 is committed 00002000:00010000:2.0:1789263919.980372:0:24416:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:2.0:1789263919.980378:0:24416:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:2.0:1789263919.980393:0:24416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078915044/0xce1582440fb1fe57 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263919.980407:0:24416:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078915044/0xce1582440fb1fe57 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263919.980416:0:24416:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078915044/0xce1582440fb1fe57 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263919.980424:0:24416:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd981683e00 already unused, calling callback (ffffffffc0cc9350) 00010000:00010000:2.0:1789263919.980429:0:24416:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078915044/0xce1582440fb1fe57 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263919.980438:0:24416:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078915044/0xce1582440fb1fe57 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263919.980457:0:24416:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078915044/0xce1582440fb1fe57 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789263919.980464:0:24416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078915044/0xce1582440fb1fe57 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789263919.980603:0:24416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882a6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a1dd3d55-1bb8-4234-9f91-1e9a0c707c0d+5:2400:x1876178888728320:12345-192.168.203.20@tcp:4:dd.0 Request processed in 75006us (151588us total) trans 12884901896 rc 0/0 00000100:00100000:2.0:1789263919.980624:0:24416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 1 00000100:00100000:1.0:1789263920.173583:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898188288:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789263920.173652:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263920.173710:0:22908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898188288 00000100:00100000:3.0:1789263920.173720:0:22908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898188288 00000100:00100000:3.0:1789263920.173773:0:22908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789263920.173784:0:22908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1876178898188288:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789263920.173817:0:22908:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789263920.173864:0:22908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1876178898188288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263920.173871:0:22908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789263920.174192:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882a6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898188416:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789263920.174223:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789263920.174279:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898188288:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789263920.174297:0:22927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898188416 00000100:00100000:3.0:1789263920.174302:0:22927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898188416 00000100:00100000:3.0:1789263920.174376:0:22927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789263920.174384:0:22927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1876178898188416:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789263920.174401:0:22927:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:3.0:1789263920.174452:0:22927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1876178898188416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 68us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263920.174459:0:22927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789263920.174925:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882a6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898188416:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789263920.496428:0:22892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789263921.197302:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec0ec848-5fac-4f6a-ba8a-daed864d309d:3621:1876178898188672:0@lo:400:kworker.0 00000100:00100000:1.0:1789263921.197350:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989afd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898188544:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789263921.197483:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876178898188928:0@lo:400:kworker.0 00000100:00100000:3.0:1789263921.200494:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd989aff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898188800:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789263921.200587:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263921.200604:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263921.200630:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876178898189440:0@lo:400:kworker.0 00000100:00100000:1.0:1789263921.200630:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd882a6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898189056:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789263921.200670:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263921.200698:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898189952:0@lo:400:kworker.0 00000100:00100000:2.0:1789263921.200720:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263921.200746:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3619:1876178898190464:0@lo:400:kworker.0 00000100:00100000:2.0:1789263921.200779:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263921.200828:0:22908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898188928 00000100:00100000:2.0:1789263921.200836:0:22908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898188928 00000100:00100000:2.0:1789263921.200885:0:22908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789263921.200893:0:22908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd883b6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1876178898188928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789263921.200951:0:22908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd883b6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1876178898188928:12345-0@lo:400:kworker.0 Request processed in 58us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263921.200958:0:22908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789263921.200982:0:24409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898189440 00000100:00100000:2.0:1789263921.200986:0:24409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898189440 00000100:00100000:2.0:1789263921.201020:0:24409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898189952 00000100:00100000:2.0:1789263921.201022:0:24409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898189952 00000100:00100000:2.0:1789263921.201046:0:24409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789263921.201052:0:24409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1876178898189440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789263921.201146:0:24409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1876178898189440:12345-0@lo:400:kworker.0 Request processed in 95us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263921.201153:0:24409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789263921.201177:0:24409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789263921.201183:0:24409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd98ff7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1876178898189952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789263921.201343:0:24409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd98ff7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1876178898189952:12345-0@lo:400:kworker.0 Request processed in 159us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263921.201349:0:24409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789263921.201376:0:22903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898190464 00000100:00100000:2.0:1789263921.201380:0:22903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898190464 00000100:00100000:2.0:1789263921.201422:0:22903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789263921.201429:0:22903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1876178898190464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789263921.201604:0:22903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1876178898190464:12345-0@lo:400:kworker.0 Request processed in 176us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263921.201611:0:22903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1789263921.201635:0:22900:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789263921.201639:0:22900:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789263921.201700:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876178898188928:0@lo:400:kworker.0 00000100:00100000:2.0:1789263921.201710:0:3619:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:2.0:1789263921.201724:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876178898189440:0@lo:400:kworker.0 00000100:00100000:2.0:1789263921.201735:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876178898189952:0@lo:400:kworker.0 00000100:00100000:2.0:1789263921.201743:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3619:1876178898190464:0@lo:400:kworker.0 00000100:00100000:2.0:1789263921.201779:0:24413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898188544 00000100:00100000:2.0:1789263921.201783:0:24413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898188544 00000100:00100000:2.0:1789263921.201809:0:24413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789263921.201816:0:24413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898188544:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789263921.201836:0:24413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789263921.201869:0:24413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898188544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (1283us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263921.201882:0:24413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789263921.202164:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263921.202353:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd9bfa73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898189184:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789263921.202381:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263921.202399:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898189696:0@lo:400:kworker.0 00000100:00100000:0.0:1789263921.202423:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263921.202441:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3621:1876178898190208:0@lo:400:kworker.0 00000100:00100000:0.0:1789263921.202461:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263921.202479:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1789263921.202485:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1876178898189568:0@lo:400:kworker.0 00000100:00100000:0.0:1789263921.202517:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263921.202535:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1876178898190080:0@lo:400:kworker.0 00000100:00100000:0.0:1789263921.202554:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263921.202570:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3621:1876178898190592:0@lo:400:kworker.0 00000100:00100000:0.0:1789263921.202589:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789263921.202618:0:22909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898189696 00000100:00100000:0.0:1789263921.202623:0:22909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898189696 00000100:00100000:0.0:1789263921.202648:0:22909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789263921.202667:0:22909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882a6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1876178898189696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263921.202713:0:22909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882a6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1876178898189696:12345-0@lo:400:kworker.0 Request processed in 58us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263921.202719:0:22909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789263921.202745:0:22904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898190208 00000100:00100000:0.0:1789263921.202748:0:22904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898190208 00000100:00100000:0.0:1789263921.202774:0:22904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898189568 00000100:00100000:0.0:1789263921.202777:0:22904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898189568 00000100:00100000:0.0:1789263921.202788:0:22904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898190080 00000100:00100000:0.0:1789263921.202790:0:22904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898190080 00000100:00100000:0.0:1789263921.202799:0:22904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898190592 00000100:00100000:0.0:1789263921.202802:0:22904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898190592 00000100:00100000:0.0:1789263921.202814:0:22904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789263921.202820:0:22904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882a6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1876178898190208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263921.202849:0:22904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882a6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1876178898190208:12345-0@lo:400:kworker.0 Request processed in 29us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263921.202855:0:22904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789263921.202867:0:22904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789263921.202872:0:22904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882a6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1876178898189568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263921.202897:0:22904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882a6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1876178898189568:12345-0@lo:400:kworker.0 Request processed in 25us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263921.202902:0:22904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789263921.202913:0:22904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789263921.202919:0:22904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882a6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1876178898190080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263921.202944:0:22904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882a6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1876178898190080:12345-0@lo:400:kworker.0 Request processed in 26us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263921.202950:0:22904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789263921.202960:0:22904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789263921.202974:0:22904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882a6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1876178898190592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789263921.203002:0:22904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882a6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1876178898190592:12345-0@lo:400:kworker.0 Request processed in 30us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263921.203008:0:22904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1789263921.203025:0:22900:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789263921.203029:0:22900:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789263921.203036:0:24413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898189184 00000100:00100000:0.0:1789263921.203039:0:24413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898189184 00000100:00100000:0.0:1789263921.203074:0:24413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789263921.203109:0:24413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd882a6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1876178898189184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789263921.203122:0:24413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3923501056 avail 3684274176 00000100:00100000:0.0:1789263921.203151:0:24413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd882a6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1876178898189184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 44us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1789263921.203156:0:24413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1789263921.203173:0:22900:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789263921.203214:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1876178898189568:0@lo:400:kworker.0 00000100:00100000:0.0:1789263921.203225:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1876178898190080:0@lo:400:kworker.0 00010000:00080000:0.0:1789263921.203358:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd88397d500 x1876178898190592/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263937 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789263921.203371:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3621:1876178898190592:0@lo:400:kworker.0 00000100:00100000:0.0:1789263921.203384:0:3621:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901894 gen 2 00000004:00080000:0.0:1789263921.203389:0:3621:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9dd989afc700, transno 12884901892 00000004:00080000:0.0:1789263921.203402:0:3621:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901894 committed transno 12884901894 00000100:00100000:0.0:1789263921.203426:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd9bfa73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876178898189184:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789263921.203439:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876178898189696:0@lo:400:kworker.0 00000100:00100000:0.0:1789263921.203459:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3621:1876178898190208:0@lo:400:kworker.0 00000100:00100000:2.0:1789263921.203844:0:22896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898188672 00000100:00100000:2.0:1789263921.203858:0:22896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898188672 00000100:00100000:2.0:1789263921.203954:0:22896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789263921.203962:0:22896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd9bfa62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+24:3621:x1876178898188672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789263921.204016:0:22896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd9bfa62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec0ec848-5fac-4f6a-ba8a-daed864d309d+24:3621:x1876178898188672:12345-0@lo:400:kworker.0 Request processed in 49us (1845us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263921.204022:0:22896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789263921.204150:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec0ec848-5fac-4f6a-ba8a-daed864d309d:3621:1876178898188672:0@lo:400:kworker.0 00000100:00100000:2.0:1789263921.204322:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789263921.204407:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989afd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898188544:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789263921.204459:0:24413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898189056 00000100:00100000:0.0:1789263921.204463:0:24413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898189056 00000100:00100000:1.0:1789263921.204720:0:24413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789263921.204734:0:24413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd99f9a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898189056:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789263921.204747:0:24413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3923501056 avail 3684274176 00000100:00100000:1.0:1789263921.204800:0:24413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd99f9a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1876178898189056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263921.204806:0:24413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1789263921.204841:0:22900:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789263921.204905:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd882a6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876178898189056:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789263921.207339:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263921.207428:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898189312:0@lo:400:kworker.0 00000100:00100000:3.0:1789263921.207462:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263921.207491:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898189824:0@lo:400:kworker.0 00000100:00100000:3.0:1789263921.208331:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263921.208361:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dd88397ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1876178898190336:0@lo:400:kworker.0 00000100:00100000:3.0:1789263921.208394:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789263921.208451:0:22904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898190336 00000100:00100000:3.0:1789263921.208459:0:22904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898190336 00000100:00100000:3.0:1789263921.208599:0:22904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789263921.208608:0:22904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989afe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876178898190336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789263921.208703:0:22904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989afe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876178898190336:12345-0@lo:400:kworker.0 Request processed in 96us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1789263921.208710:0:22904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1789263921.208735:0:22900:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1789263921.208767:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd88397ed80 x1876178898190336/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789263937 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789263921.208780:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1876178898190336:0@lo:400:kworker.0 00000100:00100000:1.0:1789263921.210693:0:25398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898189312 00000100:00100000:1.0:1789263921.210702:0:25398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898189312 00000100:00100000:1.0:1789263921.210754:0:25398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898189824 00000100:00100000:1.0:1789263921.210757:0:25398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898189824 00000100:00100000:1.0:1789263921.210786:0:25398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789263921.210794:0:25398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989afe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3618:x1876178898189312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789263921.210870:0:25398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989afe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3618:x1876178898189312:12345-0@lo:400:kworker.0 Request processed in 77us (3407us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263921.210877:0:25398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789263921.210901:0:25398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789263921.210908:0:25398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989afdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3618:x1876178898189824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789263921.210942:0:25398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989afdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3618:x1876178898189824:12345-0@lo:400:kworker.0 Request processed in 35us (2612us total) trans 0 rc 0/0 00000100:00100000:1.0:1789263921.210948:0:25398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789263921.210997:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898189312:0@lo:400:kworker.0 00000100:00100000:1.0:1789263921.211009:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd88397ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876178898189824:0@lo:400:kworker.0 00000100:00100000:2.0:1789263921.214707:0:24414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876178898188800 00000100:00100000:2.0:1789263921.214726:0:24414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876178898188800 00000100:00100000:2.0:1789263921.215457:0:24414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789263921.215469:0:24414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd989afea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876178898188800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789263921.215500:0:24414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789263921.215615:0:24414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd989afea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876178898188800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 149us (8280us total) trans 0 rc 0/0 00000100:00100000:2.0:1789263921.215622:0:24414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789263921.216431:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dd989aff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876178898188800:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1789263921.270374:0:23664:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:3.0:1789263921.495634:0:25983:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: expected /mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc/13a3/0x2000013a1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:1.0:1789263921.518218:0:22893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789263922.541191:0:24436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 50952 lines, 50952 kept, 0 dropped, 0 bad.